Equivalency of Sleep Estimates: Comparison of Three Research-Grade Accelerometers

in Journal for the Measurement of Physical Behaviour
View More View Less
  • 1 University of Leicester
  • 2 University Hospitals of Leicester NHS Trust
Restricted access

Purchase article

USD  $24.95

Student 1 year online subscription

USD  $38.00

1 year online subscription

USD  $51.00

Student 2 year online subscription

USD  $73.00

2 year online subscription

USD  $97.00

Introduction: This study examined the equivalency of sleep estimates from Axivity, GENEActiv, and ActiGraph accelerometers worn on the nondominant and dominant wrists and with and without using a sleep log to guide the algorithm. Methods: 47 young adults wore an Axivity, GENEActiv, and ActiGraph accelerometer continuously on both wrists for 4–7 days. Sleep time, sleep window, sleep efficiency, sleep onset, and wake time were produced using the open-source software (GGIR). For each outcome, agreement between accelerometer brands, dominant and nondominant wrists, and with and without use of a sleep log, was examined using pairwise 95% equivalence tests (±10% equivalence zone) and intraclass correlation coefficients (ICCs), with 95% confidence intervals and limits of agreement. Results: All sleep outcomes were within a 10% equivalence zone irrespective of brand, wrist, or use of a sleep log. ICCs were poor to good for sleep time (ICCs ≥ .66) and sleep window (ICCs ≥ .56). Most ICCs were good to excellent for sleep efficiency (ICCs ≥ .73), sleep onset (ICCs ≥ .88), and wake time (ICCs ≥ .87). There were low levels of mean bias; however, there were wide 95% limits of agreement for sleep time, sleep window, sleep onset, and wake time outcomes. Sleep time (up to 25 min) and sleep window (up to 29 min) outcomes were higher when use of the sleep log was not used. Conclusion: The present findings suggest that sleep outcomes from the Axivity, GENEActiv, and ActiGraph, when analyzed identically, are comparable across studies with different accelerometer brands and wear protocols at a group level. However, caution is advised when comparing studies that differ on sleep log availability.

Plekhanova is with the Diabetes Research Centre, Leicester General Hospital, University of Leicester, Leicester, United Kingdom. Rowlands, Yates, Brady, Davies, Khunti, and Edwardson are with the University of Leicester, Leicester, United Kingdom. Hall is with the University Hospitals of Leicester NHS Trust, Leicester, United Kingdom.

Plekhanova (tp177@le.ac.uk) is corresponding author.

Supplementary Materials

    • Supplementary Document S1 (PDF 162 KB)
    • Supplementary Document S2 (PDF 144 KB)
    • Supplementary Figure S1 (PDF 258 KB)
    • Supplementary Figure S2 (PDF 452 KB)
    • Supplementary Figure S3 (PDF 301 KB)
    • Supplementary Figure S4 (PDF 527 KB)
    • Supplementary Table S1 (PDF 85 KB)
  • Berger, A.M., Wielgus, K.K., Young-McCaughan, S., Fischer, P., Farr, L., & Lee, K.A. (2008). Methodological challenges when using actigraphy in research. Journal of Pain and Symptom Management, 36(2), 191199. PubMed ID: 18400460 doi:10.1016/j.jpainsymman.2007.10.008

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bland, J.M., & Altman, D. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet, 327(8476), 307310. doi:10.1016/S0140-6736(86)90837-8

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Boddy, L.M., Noonan, R.J., Kim, Y., Rowlands, A.V., Welk, G.J., Knowles, Z.R., & Fairclough, S.J. (2018). Comparability of children’s sedentary time estimates derived from wrist worn GENEActiv and hip worn ActiGraph accelerometer thresholds. Journal of Science and Medicine in Sport, 21(10), 10451049. PubMed ID: 29650338 doi:10.1016/j.jsams.2018.03.015

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Borazio, M., Berlin, E., Kücükyildiz, N., Scholl, P., & Van Laerhoven, K. (2014, September). Towards benchmarked sleep detection with wrist-worn sensing units. Paper presented at the 2014 IEEE International Conference on Healthcare Informatics (pp. 125134), Verona, Italy.

    • Search Google Scholar
    • Export Citation
  • Cole, R.J., Kripke, D.F., Gruen, W., Mullaney, D.J., & Gillin, J.C. (1992). Automatic sleep/wake identification from wrist activity. Sleep, 15(5), 461469. PubMed ID: 1455130 doi:10.1093/sleep/15.5.461

    • Crossref
    • Search Google Scholar
    • Export Citation
  • da Silva, I.C., van Hees, V.T., Ramires, V.V., Knuth, A.G., Bielemann, R.M., Ekelund, U., … Hallal, P.C. (2014). Physical activity levels in three Brazilian birth cohorts as assessed with raw triaxial wrist accelerometry. International Journal of Epidemiology, 43(6), 19591968. PubMed ID: 25361583 doi:10.1093/ije/dyu203

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dieu, O., Mikulovic, J., Fardy, P.S., Bui-Xuan, G., Béghin, L., & Vanhelst, J. (2017). Physical activity using wrist-worn accelerometers: Comparison of dominant and non-dominant wrist. Clinical Physiology and Functional Imaging, 37(5), 525529. PubMed ID: 26749436 doi:10.1111/cpf.12337

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Doherty, A., Jackson, D., Hammerla, N., Plötz, T., Olivier, P., Granat, M.H., … Owen, C.G. (2017). Large scale population assessment of physical activity using wrist worn accelerometers: The UK Biobank Study. PLoS One, 12(2), e0169649. PubMed ID: 28146576 doi:10.1371/journal.pone.0169649

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Driller, M.W., O’Donnell, S., & Tavares, F. (2017). What wrist should you wear your actigraphy device on? Analysis of dominant vs. non-dominant wrist actigraphy for measuring sleep in healthy adults. Sleep Science, 10(3), 132135. PubMed ID: 29410743 doi:10.5935/1984-0063.20170023

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Full, K.M., Kerr, J., Grandner, M.A., Malhotra, A., Moran, K., Godoble, S., … Soler, X. (2018). Validation of a physical activity accelerometer device worn on the hip and wrist against polysomnography. Sleep Health, 4(2), 209216. PubMed ID: 29555136 doi:10.1016/j.sleh.2017.12.007

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Girschik, J., Fritschi, L., Heyworth, J., & Waters, F. (2012). Validation of self-reported sleep against actigraphy. Journal of Epidemiology, 22(5), 462468. PubMed ID: 22850546 doi:10.2188/jea.JE20120012

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Knutson, K.L., & von Schantz, M. (2018). Associations between chronotype, morbidity and mortality in the UK Biobank cohort. Chronobiology International, 35(8), 19. doi:10.1080/07420528.2018.1454458

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Koo, T.K., & Li, M.Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155163. PubMed ID: 27330520 doi:10.1016/j.jcm.2016.02.012

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lauderdale, D.S., Knutson, K.L., Yan, L.L., Liu, K., & Rathouz, P.J. (2008). Sleep duration: How well do self-reports reflect objective measures? The CARDIA Sleep Study. Epidemiology, 19(6), 838845. doi:10.1097/EDE.0b013e318187a7b0

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lee, J., Kim, Y., & Welk, G.J. (2014). Validity and utility of consumer-based physical activity monitors. Medicine & Science in Sports & Exercise, 46(9), 18401848. PubMed ID: 24777201 doi:10.1249/MSS.0000000000000287

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Loprinzi, P.D., & Cardinal, B.J. (2011). Association between objectively-measured physical activity and sleep, NHANES 2005–2006. Mental Health and Physical Activity, 4(2), 6569. doi:10.1016/j.mhpa.2011.08.001

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Martin, J.L., & Hakim, A.D. (2011). Wrist actigraphy. Chest, 139(6), 15141527. PubMed ID: 21652563 doi:10.1378/chest.10-1872

  • Menai, M., Van Hees, V.T., Elbaz, A., Kivimaki, M., Singh-Manoux, A., & Sabia, S. (2017). Accelerometer assessed moderate-to-vigorous physical activity and successful ageing: Results from the Whitehall II study. Scientific Reports, 7(1), 45772. doi:10.1038/srep45772

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Montoye, A.H., Nelson, M.B., Bock, J.M., Imboden, M.T., Kaminsky, L.A., Mackintosh, K.A., … Pfeiffer, K.A. (2018). Raw and count data comparability of hip-worn ActiGraph GT3X and link accelerometers. Medicine & Science in Sports & Exercise, 50(5), 11031112. PubMed ID: 29283934 doi:10.1249/MSS.0000000000001534

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Quante, M., Kaplan, E.R., Cailler, M., Rueschman, M., Wang, R., Weng, J., … Redline, S. (2018). Actigraphy-based sleep estimation in adolescents and adults: A comparison with polysomnography using two scoring algorithms. Nature and Science of Sleep, 10, 1320. PubMed ID: 29403321 doi:10.2147/NSS.S151085

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Reutrakul, S., & Van Cauter, E. (2018). Sleep influences on obesity, insulin resistance, and risk of type 2 diabetes. Metabolism, 84, 5666. PubMed ID: 29510179 doi:10.1016/j.metabol.2018.02.010

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rosenberger, M.E., Buman, M.P., Haskell, W.L., McConnell, M.V., & Carstensen, L.L. (2016). 24 hours of sleep, sedentary behavior, and physical activity with nine wearable devices. Medicine & Science in Sports & Exercise, 48(3), 457465. PubMed ID: 26484953 doi:10.1249/MSS.0000000000000778

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rowlands, A.V., Mirkes, E.M., Yates, T., Clemes, S., Davies, M., Khunti, K., & Edwardson, C.L. (2018). Accelerometer-assessed physical activity in epidemiology: Are monitors equivalent? Medicine & Science in Sports & Exercise, 50(2), 257265. PubMed ID: 28976493 doi:10.1249/MSS.0000000000001435

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rowlands, A.V., Plekhanova, T., Yates, T., Mirkes, E., Davies, M., Khunti, K., & Edwardson, C. (2019). A basis for harmonisation of accelerometer physical activity outcomes in epidemiology. Journal for the Measurement of Physical Behaviour, 2(3), 131142. doi:10.1123/jmpb.2018-0073

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rowlands, A.V., Yates, T., Davies, M., Khunti, K., & Edwardson, C.L. (2016). Raw accelerometer data analysis with GGIR R-package: Does accelerometer brand matter? Medicine & Science in Sports & Exercise, 48(10), 19351941. PubMed ID: 27183118 doi:10.1249/MSS.0000000000000978

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sadeh, A. (2011). The role and validity of actigraphy in sleep medicine: An update. Sleep Medicine Reviews, 15(4), 259267. PubMed ID: 21237680 doi:10.1016/j.smrv.2010.10.001

    • Crossref
    • Search Google Scholar
    • Export Citation
  • van Hees, V.T., Fang, Z., Langford, J., Assah, F., Mohammad, A., da Silva, I.C., … Brage, S. (2014). Auto-calibration of accelerometer data for free-living physical activity assessment using local gravity and temperature: An evaluation on four continents. American Journal of Physiology-Heart and Circulatory Physiology, 117(7), 738744.

    • Search Google Scholar
    • Export Citation
  • van Hees, V.T., Gorzelniak, L., Dean León, E.C., Eder, M., Pias, M., Taherian, S., … Brage, S. (2013). Separating movement and gravity components in an acceleration signal and implications for the assessment of human daily physical activity. PLoS One, 8(4), e61691. doi:10.1371/journal.pone.0061691

    • Crossref
    • Search Google Scholar
    • Export Citation
  • van Hees, V.T., Sabia, S., Anderson, K.N., Denton, S.J., Oliver, J., Catt, M., … Singh-Manoux, A. (2015). A novel, open access method to assess sleep duration using a wrist-worn accelerometer. PLoS One, 10(11), e0142533. PubMed ID: 26569414 doi:10.1371/journal.pone.0142533

    • Crossref
    • Search Google Scholar
    • Export Citation
  • van Hees, V.T., Sabia, S., Jones, S.E., Wood, A.R., Anderson, K.N., Kivimaki, M., … Mazzotti, D.R. (2018). Estimating sleep parameters using an accelerometer without sleep diary. Scientific Reports, 8(1), 12975. PubMed ID: 30154500 doi:10.1038/s41598-018-31266-z

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zinkhan, M., Berger, K., Hense, S., Nagel, M., Obst, A., Koch, B., … Young, P. (2014). Agreement of different methods for assessing sleep characteristics: A comparison of two actigraphs, wrist and hip placement, and self-report with polysomnography. Sleep Medicine, 15(9), 11071114. PubMed ID: 25018025 doi:10.1016/j.sleep.2014.04.015

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 290 290 104
PDF Downloads 74 74 27