Reliability and Convergent Validity of Self-Reported Physical Activity Questionnaires for People With Mental Disorders: A Systematic Review and Meta-Analysis

in Journal of Physical Activity and Health

Click name to view affiliation

Vagner Deuel de Oliveira Tavares
Search for other papers by Vagner Deuel de Oliveira Tavares in
Current site
Google Scholar
PubMed
Close
,
Nicole Leite Galvão-Coelho
Search for other papers by Nicole Leite Galvão-Coelho in
Current site
Google Scholar
PubMed
Close
,
Joseph Firth
Search for other papers by Joseph Firth in
Current site
Google Scholar
PubMed
Close
,
Simon Rosenbaum
Search for other papers by Simon Rosenbaum in
Current site
Google Scholar
PubMed
Close
,
Brendon Stubbs
Search for other papers by Brendon Stubbs in
Current site
Google Scholar
PubMed
Close
,
Lee Smith
Search for other papers by Lee Smith in
Current site
Google Scholar
PubMed
Close
,
Davy Vancampfort
Search for other papers by Davy Vancampfort in
Current site
Google Scholar
PubMed
Close
, and
Felipe Barreto Schuch
Search for other papers by Felipe Barreto Schuch in
Current site
Google Scholar
PubMed
Close
Restricted access

Purpose: To examine the reliability and convergent validity of self-reported questionnaires (SRQs) to measure physical activity (PA). Methods: Systematic review with meta-analysis. The validity and reliability of SRQs to assess PA in people with mental disorders (January 20, 2020). Random-effects meta-analyses were performed pooling (1) test–retest correlations or (2) the convergent validity between the SRQs and objective measures (eg, accelerometry). Associations were provided in r values with the 95% confidence interval. Methodological quality was assessed. Results: A total of 9 unique studies (N = 1344; 40.5% females) were included. The authors found a moderate correlation test–retest reliability for PA SRQs in the assessment of vigorous PA (r = .69 [.38 to .85]; P = .001), moderate to vigorous PA (r = .63 [.25 to .84]; P = .003), moderate PA (r = .63 [.39 to .79]; P = .001), and good correlation total PA (r = .75 [.37 to .92]; P = .001). The SRQs have moderate correlations with objective measures for moderate to vigorous PA (r = .25 [.18 to .32]; P = .0001) and total PA (r = .47 [.28 to .62]; P = .005), a poor correlation for moderate PA (r = .18 [.03 to .36]; P = .047), and no correlation with vigorous PA (r = .06 [−.10 to .22]; P = .440). Conclusion: Current evidence indicates that SRQs are reliable over time to assess moderate, vigorous, and total PA levels and valid when assessing moderate PA.

de Oliveira Tavares and Galvão-Coelho are with the Laboratory of Hormone Measurement, Department of Physiology and Behavior, Federal University of Rio Grande do Norte, Natal, Brazil. Galvão-Coelho is also with the National Institute of Science and Technology in Translational Medicine, São Paulo, Brazil. Firth is with the Division of Psychology and Mental Health, University of Manchester, Manchester, United Kingdom. Rosenbaum is with the Faculty of Medicine, School of Psychiatry, UNSW Sydney, Sydney, NSW, Australia. Stubbs is with the Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United Kingdom; and the South London and Maudsley NHS Foundation Trust, London, United Kingdom. Smith is with The Cambridge Centre for Sport and Exercise Sciences, Anglia Ruskin University, Cambridge, United Kingdom. Vancampfort is with the Department of Rehabilitation Sciences, KU Leuven, Leuven, Belgium; and the University Parish, KU Leuven, Leuven-Kortenberg, Belgium. Schuch is with the Department of Sports Methods and Techniques, Federal University of Santa Maria, Santa Maria, Brazil.

de Oliveira Tavares (deueltavares@gmail.com) is corresponding author.

Supplementary Materials

    • Supplementary Material 1 (PDF 287 KB)
    • Supplementary Material 2 (PDF 338 KB)
  • Collapse
  • Expand
  • 1.

    Lawrence D, Kisely S, Pais J. The epidemiology of excess mortality in people with mental illness. Can J Psychiatry. 2010;55(12):752760. PubMed ID: 21172095 doi:10.1177/070674371005501202

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 2.

    Firth J, Siddiqi N, Koyanagi A, et al. The Lancet Psychiatry Commission: a blueprint for protecting physical health in people with mental illness. Lancet Psychiatry. 2019;6(8):675712. PubMed ID: 31324560 doi:10.1016/s2215-0366(19)30132-4

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 3.

    Vancampfort D, Firth J, Schuch FB, et al. Sedentary behavior and physical activity levels in people with schizophrenia, bipolar disorder and major depressive disorder: a global systematic review and meta-analysis. World Psychiatry. 2017;16(3):308315. PubMed ID: 28941119 doi:10.1002/wps.20458

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 4.

    Stubbs B, Williams J, Gaughran F, Craig T. How sedentary are people with psychosis? A systematic review and meta-analysis. Schizophr Res. 2016;171(1–3):103109. PubMed ID: 26805414 doi:10.1016/j.schres.2016.01.034

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 5.

    Schuch F, Vancampfort D, Firth J, et al. Physical activity and sedentary behavior in people with major depressive disorder: a systematic review and meta-analysis. J Affect Disord. 2017;210:139150. PubMed ID: 28033521 doi:10.1016/j.jad.2016.10.050

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 6.

    Firth J, Rosenbaum S, Stubbs B, Gorczynski P, Yung AR, Vancampfort D. Motivating factors and barriers towards exercise in severe mental illness: a systematic review and meta-analysis. Psychol Med. 2016;46(14):28692881. PubMed ID: 27502153 doi:10.1017/s0033291716001732

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 7.

    Rosenbaum S, Tiedemann A, Sherrington C, Curtis J, Ward PB. Physical activity interventions for people with mental illness: a systematic review and meta-analysis. J Clin Psychiatry. 2014;75(9):964974. PubMed ID: 24813261 doi:10.4088/jcp.13r08765

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 8.

    Stubbs B, Vancampfort D, Rosenbaum S, et al. An examination of the anxiolytic effects of exercise for people with anxiety and stress-related disorders: a meta-analysis. Psychiatry Res. 2017;249:102108. PubMed ID: 28088704 doi:10.1016/j.psychres.2016.12.020

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 9.

    Ashdown-Franks G, Firth J, Carney R, et al. Exercise as medicine for mental and substance use disorders: a meta-review of the benefits for neuropsychiatric and cognitive outcomes. Sport Med. 2020;50(1):151170. PubMed ID: 31541410 doi:10.1007/s40279-019-01187-6

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 10.

    Brokmeier L, Firth J, Vancampfort D, et al. Does physical activity reduce the risk of psychosis? A systematic review and meta-analysis of prospective studies. Psychiatry Res. 2020;284:112675. PubMed ID: 31757637 doi:10.1016/j.psychres.2019.112675

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 11.

    Schuch FB, Vancampfort D, Firth J, et al. Physical activity and incident depression: a meta-analysis of prospective cohort studies. Am J Psychiatry. 2018;175(7):631648. PubMed ID: 29690792 doi:10.1176/appi.ajp.2018.17111194

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 12.

    Schuch FB, Stubbs B. The role of exercise in preventing and treating depression. Curr Sports Med Rep. 2019;18(8):299304. PubMed ID: 31389872 doi:10.1249/jsr.0000000000000620

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 13.

    Hallgren M, Nguyen TTD, Owen N, et al. Associations of sedentary behavior in leisure and occupational contexts with symptoms of depression and anxiety. Prev Med. 2020;133:106021. PubMed ID: 32044415 doi:10.1016/j.ypmed.2020.106021

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 14.

    Griffin ÉW, Mullally S, Foley C, Warmington SA, O’Mara SM, Kelly ÁM. Aerobic exercise improves hippocampal function and increases BDNF in the serum of young adult males. Physiol Behav. 2011;104(5):934941. PubMed ID: 21722657 doi:10.1016/j.physbeh.2011.06.005

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 15.

    Loprinzi PD, Herod SM, Cardinal BJ, Noakes TD. Physical activity and the brain: a review of this dynamic, bi-directional relationship. Brain Res. 2013;1539:95104. PubMed ID: 24120986 doi:10.1016/j.brainres.2013.10.004

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 16.

    Schuch FB, Deslandes AC, Stubbs B, Gosmann NP, da Silva CTB, Fleck MPA. Neurobiological effects of exercise on major depressive disorder: a systematic review. Neurosci Biobehav Rev. 2016;61:111. PubMed ID: 26657969 doi:10.1016/j.neubiorev.2015.11.012

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 17.

    Vancampfort D, Firth J, Schuch F, et al. Physical activity and sedentary behavior in people with bipolar disorder: a systematic review and meta-analysis. J Affect Disord. 2016;201:145152. PubMed ID: 27235817 doi:10.1016/j.jad.2016.05.020

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 18.

    Soundy A, Roskell C, Stubbs B, Vancampfort D. Selection, use and psychometric properties of physical activity measures to assess individuals with severe mental illness: a narrative synthesis. Arch Psychiatr Nurs. 2014;28(2):135151. PubMed ID: 24673789 doi:10.1016/j.apnu.2013.12.002

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 19.

    Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339(7716):332336. doi:10.1136/bmj.b2535

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 20.

    American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. Arlington, VA: American Psychiatric Association; 2013. doi:10.1176/appi.books.9780890425596

    • Search Google Scholar
    • Export Citation
  • 21.

    World Health Organization. International Statistical Classification of Diseases and Related Health Problems. Geneva, Switzerland: World Health Organization; 2016;10:xii, 362 p. doi:10.1002/1520-6505(2000)9:5<201:aid-evan2>3.3.co;2-p

    • Search Google Scholar
    • Export Citation
  • 22.

    Lucas NP, Macaskill P, Irwig L, Bogduk N. The development of a quality appraisal tool for studies of diagnostic reliability (QAREL). J Clin Epidemiol. 2010;63(8):854861. PubMed ID: 20056381 doi:10.1016/j.jclinepi.2009.10.002

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 23.

    Brink Y, Louw QA. Clinical instruments: reliability and validity critical appraisal. J Eval Clin Pract. 2011;18(6):11261132. PubMed ID: 21689217 doi:10.1111/j.1365-2753.2011.01707.x

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 24.

    Duncan MJ, Arbour-nicitopoulos K, Subramanieapillai M, Remington G, Faulkner G. Revisiting the International Physical Activity Questionnaire (IPAQ): assessing physical activity among individuals with schizophrenia. Schizophr Res. 2017;179:27. PubMed ID: 27623360 doi:10.1016/j.schres.2016.09.010

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 25.

    Lindamer LA, Mckibbin C, Norman GJ, et al. Assessment of physical activity in middle-aged and older adults with schizophrenia. Schizophr Res. 2008;104(1–3):294301. PubMed ID: 18550338 doi:10.1016/j.schres.2008.04.040

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 26.

    Ma W, Chiang L, Yen W, Huang L, Tsai T. 3-Month physical activity checklist: development and validation with Taiwanese adults with mental illness. Int J Nurs Stud. 2011;48(12):15171521. PubMed ID: 21794865 doi:10.1016/j.ijnurstu.2011.06.005

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 27.

    Dubbert PM, White JD, Grothe KB, Jile JO, Kirchner KA. Physical activity in patients who are severely mentally ill : feasibility of assessment for clinical and research applications. Arch Psychiatr Nurs. 2006;20(5):205209. PubMed ID: 17010823 doi:10.1016/j.apnu.2006.04.002

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 28.

    Soundy A, Taylor A, Faulkner G, Rowlands A. Psychometric properties of the 7-day physical activity recall questionnaire in individuals with severe mental illness. Arch Psychiatr Nurs. 2007;21(6):309316. PubMed ID: 18037441 doi:10.1016/j.apnu.2007.03.001

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 29.

    Faulkner G, Cohn T, Remington G. Validation of a physical activity assessment tool for individuals with schizophrenia. Schizophr Res. 2006;82(2–3):225231. PubMed ID: 16360305 doi:10.1016/j.schres.2005.10.020

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 30.

    Firth J, Stubbs B, Vancampfort D, et al. The validity and value of self-reported physical activity and accelerometry in people with schizophrenia: a population-scale study of the UK biobank. Schizophr Bull. 2018;44(6):12931300. PubMed ID: 29069474 doi:10.1093/schbul/sbx149

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 31.

    Vancampfort D, De Hert M, Myin-Germeys I, et al. Validity and correlates of the International Physical Activity Questionnaire in first-episode psychosis. Early Interv Psychiatry. 2019;13(3):562567. PubMed ID: 29164792 doi:10.1111/eip.12521

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 32.

    Rosenbaum S, Morell R, Abdel-Baki A, et al. Assessing physical activity in people with mental illness: 23- country reliability and validity of the Simple Physical Activity Questionnaire (SIMPAQ). BMC Psychiatry. 2020;20(1):108. PubMed ID: 32143714 doi:10.1186/s12888-020-2473-0

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 33.

    Muñoz-Bermejo L, Pérez-Gómez J, Manzano F, Collado-Mateo D, Villafaina S, Adsuar JC. Reliability of isokinetic knee strength measurements in children: a systematic review and meta-analysis. PLoS One. 2019;14(12):115. doi:10.1371/journal.pone.0226274

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 34.

    Piercy KL, Troiano RP, Ballard RM, et al. The physical activity guidelines for Americans. JAMA. 2018;320(19):20202028. doi:10.1001/jama.2018.14854

  • 35.

    Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155163. PubMed ID: 27330520 doi:10.1016/j.jcm.2016.02.012

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 36.

    Portney L, Watkins M. Foundations of Clinical Research: Applications to Practice (Vol. 892). Upper Saddle River, NJ: Prentice Hall; 2009. http://www.r2library.com/public/ResourceDetail.aspx?authCheck=true&resid=765.

    • Search Google Scholar
    • Export Citation
  • 37.

    Higgins J, Thomas J, Chandler J, et al.Cochrane Handbook for Systematic Reviews of Interventions. John Wiley & Sons; 2011. www.handbook.cochrane.org.

    • Search Google Scholar
    • Export Citation
  • 38.

    Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):1088. PubMed ID: 7786990 doi:10.2307/2533446

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 39.

    Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. Br Med J. 1997;315(7109):629634. doi:10.1136/bmj.316.7129.469

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 40.

    Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method. Biometrics. 2000;56(2):455463. PubMed ID: 10877304 doi:10.1111/j.0006-341x.2000.00455.x

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 41.

    Andorko ND, Rakhshan-rouhakhtar P, Hinkle C, et al. Assessing validity of retrospective recall of physical activity in individuals with psychosis-like experiences. Psychiatry Res. 2019;273:211217. PubMed ID: 30658204 doi:10.1016/j.psychres.2019.01.029

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 42.

    Sirard JR, Pate RR. Physical activity assessment in children and adolescents. Sport Med. 2001;31(6):439454. doi:10.2165/00007256-200131060-00004

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 43.

    Dollman J, Okely AD, Hardy L, Timperio A, Salmon J, Hills AP. A hitchhiker’s guide to assessing young people’s physical activity: deciding what method to use. J Sci Med Sport. 2009;12(5):518525. PubMed ID: 19038579 doi:10.1016/j.jsams.2008.09.007

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 44.

    Tudor-Locke CE, Myers AM. Challenges and opportunities for measuring physical activity in sedentary adults. Sport Med. 2001;31(2):91100. PubMed ID: 11227981 doi:10.2165/00007256-200131020-00002

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 45.

    Harris TJ, Owen CG, Victor CR, Adams R, Ekelund U, Cook DG. A comparison of questionnaire, accelerometer, and pedometer: measures in older people. Med Sci Sports Exerc. 2009;41(7):13921402. PubMed ID: 19516162 doi:10.1249/mss.0b013e31819b3533

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 46.

    Blanchard CM, Rodgers WM, Courneya KS, Spence JC. Moderators of the exercise/feeling-state relationship: the influence of self-efficacy, baseline, and in-task feeling states at moderate- and high-intensity exercise. J Appl Soc Psychol. 2002;32(7):13791395. doi:10.1111/j.1559-1816.2002.tb01442.x

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 47.

    East-Richard C, R-Mercier A, Nadeau D, Cellard C. Transdiagnostic neurocognitive deficits in psychiatry: a review of meta-analyses. Can Psychol. 2020;61(3):190214. doi:10.1037/cap0000196

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 48.

    Sallis JF, Saelens BE. Assessment of physical activity by self-report: status, limitations, and future directions. Res Q Exerc Sport. 2000;71(suppl 2):114. PubMed ID: 25680007 doi:10.1080/02701367.2000.11082780

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 49.

    Craig CL, Marshall AL, Sjöström M, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc. 2003;35(8):13811395. PubMed ID: 12900694 doi:10.1249/01.mss.0000078924.61453.fb

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 50.

    Kim Y, Park I, Kang M. Convergent validity of the International Physical Activity Questionnaire (IPAQ): meta-analysis. Public Health Nutr. 2013;16(3):440452. PubMed ID: 22874087 doi:10.1017/s1368980012002996

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 51.

    Vijay GC, Wilson ECF, Suhrcke M, Hardeman W, Sutton S. Are brief interventions to increase physical activity cost-effective? A systematic review. Br J Sports Med. 2016;50(7):408417. PubMed ID: 26438429 doi:10.1136/bjsports-2015-094655

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 52.

    Ferrari P, Friedenreich C, Matthews CE. The role of measurement error in estimating levels of physical activity. Am J Epidemiol. 2007;166(7):832840. PubMed ID: 17670910 doi:10.1093/aje/kwm148

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 53.

    Skender S, Schrotz-King P, Böhm J, et al. Repeat physical activity measurement by accelerometry among colorectal cancer patients—feasibility and minimal number of days of monitoring. BMC Res Notes. 2015;8(1):222. PubMed ID: 26048683 doi:10.1186/s13104-015-1168-y

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 54.

    Firth J, Torous J, Stubbs B, et al. The “online brain”: how the Internet may be changing our cognition Joseph. World Psychiatry. 2019;18(2):119129. PubMed ID: 31059635 doi:10.1002/wps.20617

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 55.

    Shepard LA. Evaluating test validity. Rev Res Educ. 1993;19(1):405450. doi:10.3102/0091732x019001405

  • 56.

    Jakicic JM, Winters C, Lagally K, Ho J, Robertson RJ, Wing RR. The accuracy of the TriTrac-R3D accelerometer to estimate energy expenditure. Med Sci Sport Exerc. 1999;31(5):747754. PubMed ID: 10331898 doi:10.1097/00005768-199905000-00020

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 57.

    Hendelman D, Miller K, Bagget C, Debold E, Freedson P. Validity of accelerometry for the assessment of moderate intensity physical activity in the field. Med Sci Sports Exerc. 2000;32(suppl 9):S442S449. PubMed ID: 10993413 doi:10.1097/00005768-200009001-00002

    • Crossref
    • PubMed
    • Search Google Scholar
    • Export Citation
  • 58.

    Atienza AA, Moser RP, Perna F, et al. Self-reported and objectively measured activity related to biomarkers using NHANES. Med Sci Sport Exerc. 2011;43(5):815821. PubMed ID: 20962693 doi:10.1249/mss.obo13e3181fdfc32

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 3160 1118 86
Full Text Views 38 12 0
PDF Downloads 36 11 0