Responsiveness of Device-Based and Self-Report Measures of Physical Activity to Detect Behavior Change in Men Taking Part in the Football Fans in Training (FFIT) Program

in Journal for the Measurement of Physical Behaviour
View More View Less
  • 1 University of Glasgow
  • 2 University of Stirling
  • 3 University of Edinburgh
Restricted access

Purchase article

USD  $24.95

Student 1 year online subscription

USD  $38.00

1 year online subscription

USD  $51.00

Student 2 year online subscription

USD  $73.00

2 year online subscription

USD  $97.00

The capacity of physical activity (PA) measures to detect changes in PA within interventions is crucial. This is the first study to examine the responsiveness of activPAL3 and the International Physical Activity Questionnaire (IPAQ; Short Form) in detecting PA change during a 12-week group-based, men-only weight management program—Football Fans in Training (FFIT). Participants wore an activPAL3 and completed the IPAQ pre- and post-program (n = 30). Relationships between change scores were assessed by Spearman’s correlations. Mean or median changes in PA were measured using paired samples t-tests and Wilcoxon signed-rank tests. Responsiveness to change was assessed utilizing Standardized Response Mean (SRM). Both device-based and self-report measures demonstrated significant changes pre-post intervention, although these changes were not significantly correlated. The SRM values for changes in activPAL3 metrics were: 0.54 (for MET-mins/day); 0.53 (for step counts/day); and 0.44 (for MVPA/day), indicating a small to medium responsiveness to change. SRM values for changes in IPAQ scores were: 0.59 (for total PA mins/day); 0.54 (for total MET-mins/day); 0.59 (for walking MET-mins/day); 0.38 (for vigorous MET-mins/day); and 0.38 (for moderate MET-mins/day), revealing a small to medium responsiveness to change. These findings reveal that two commonly used device-based and self-report measures demonstrated responsiveness to changes in PA. While inclusion of both device-based and self-report measures is desirable within interventions it is not always feasible. The results from this study support that self-reported measures can detect PA change within behavioral interventions, although may have a tendency to overestimate changes compared with device-based measures on absolute values, but not standardized response values.

Donnachie is with the MRC/CSO Social and Public Health Sciences Unit, Institute of Health and Wellbeing, University of Glasgow, Glasgow, United Kingdom. Hunt is with the Institute for Social Marketing, Faculty of Health Sciences and Sport, University of Stirling, Stirling, United Kingdom. Mutrie and Kelly are with the Physical Activity for Health Research Centre, Institute for Sport, Physical Education and Health Sciences, Moray House School of Education, University of Edinburgh, Edinburgh, United Kingdom. Gill is with the BHF Glasgow Cardiovascular Research Centre, Institute of Cardiovascular and Medical Sciences, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, United Kingdom.

Donnachie (Craig.Donnachie@glasgow.ac.uk) is corresponding author.
  • Adams, S.A., Matthews, C.E., Ebbeling, C.B., Moore, C.G., Cunningham, J.E., Fulton, J., & Hebert, J.R. (2005). The effect of social desirability and social approval on self-reports of physical activity. American Journal of Epidemiology, 161(4), 389398. PubMed ID: 15692083 doi:10.1093/aje/kwi054

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Almeida, G.J., Terhorst, L., Irrgang, J.J., Fitzgerald, G.K., Jakicic, J.M., & Piva, S.R. (2017). Responsiveness of physical activity measures following exercise programs after total knee arthroplasty. Journal of Exercise, Sports & Orthopedics, 4(3), 18. doi:10.15226/2374-6904/4/3/00164

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Baumann, S., Gross, S., Voigt, L., Ullrich, A., Weymar, F., Schwaneberg, T., . . . Ulbricht, S. (2018). Pitfalls in accelerometer-based measurement of physical activity: The presence of reactivity in an adult population. Scandinavian Journal of Medicine & Science in Sports, 28(3), 10561063. PubMed ID: 28921747 doi:10.1111/sms.12977

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Beaton, D.E., Bombardier, C., Katz, J.N., & Wright, J.G. (2001). A taxonomy for responsiveness. Journal of Clinical Epidemiology, 54(12), 12041217. PubMed ID: 11750189 doi:10.1016/S0895-4356(01)00407-3

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Clevenger, K.A., Moore, R.W., Suton, D., Montoye, A.H.K., Trost, S.G., & Pfeiffer, K.A. (2018). Accelerometer responsiveness to change between structured and unstructured physical activity in children and adolescents. Measurement in Physical Education and Exercise Science, 22(3), 224230. doi:10.1080/1091367X.2017.1419956

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cohen, J. (1977). Statistical power analysis for the behavioral sciences. New York, NY: Academic Press.

  • Craig, C.L., Marshall, A.L., Sjostrom, M., Bauman, A.E., Booth, M.L., Ainsworth, B.E., . . . Oja, P. (2003). International physical activity questionnaire: 12-Country reliability and validity. Medicine & Science in Sports & Exercise, 35(8), 13811395. PubMed ID: 12900694 doi:10.1249/01.MSS.0000078924.61453.FB

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dankel, S.J., & Loenneke, J.P. (2018). Effect sizes for paired data should use the change score variability rather than the pre-test variability. Journal of Strength and Conditioning Research. Advance online publication. doi:10.1519/jsc.0000000000002946

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Donnachie, C., Wyke, S., & Hunt, K. (2018). Men’s reactions to receiving objective feedback on their weight, BMI and other health risk indicators. BMC Public Health, 18(1), 291. PubMed ID: 29486743 doi:10.1186/s12889-018-5179-1

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Donnachie, C., Wyke, S., Mutrie, N., & Hunt, K. (2017). ‘It’s like a personal motivator that you carried around wi’ you’: utilising self-determination theory to understand men’s experiences of using pedometers to increase physical activity in a weight management programme. International Journal of Behavioral Nutrition and Physical Activity, 14(1), 61. PubMed ID: 28476118 doi:10.1186/s12966-017-0505-z

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Edwardson, C.L., Winkler, E.A.H., Bodicoat, D.H., Yates, T., Davies, M.J., Dunstan, D.W., & Healy, G.N. (2017). Considerations when using the activPAL monitor in field-based research with adult populations. Journal of Sport and Health Science, 6(2), 162178. PubMed ID: 30356601 doi:10.1016/j.jshs.2016.02.002

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Field, A. (2009). Discovering statistics using SPSS: (and sex and drugs and rock ‘n’ roll) (3rd ed.). London, England: SAGE.

  • Fulton, J.E., Carlson, S.A., Ainsworth, B.E., Berrigan, D., Carlson, C., Dorn, J.M., . . . Wendel, A. (2016). Strategic priorities for physical activity surveillance in the United States. Medicine & Science in Sports & Exercise, 48(10), 20572069. PubMed ID: 27187094 doi:10.1249/MSS.0000000000000989

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Grant, P.M., Dall, P.M., Mitchell, S.L., & Granat, M.H. (2008). Activity-monitor accuracy in measuring step number and cadence in community-dwelling older adults. Journal of Aging and Physical Activity, 16(2), 201214. PubMed ID: 18483442 doi:10.1123/japa.16.2.201

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gray, C., Hunt, K., Mutrie, N., Anderson, A., Leishman, J., Dalgarno, L., & Wyke, S. (2013). Football Fans in Training: the development and optimization of an intervention delivered through professional sports clubs to help men lose weight, become more active and adopt healthier eating habits. BMC Public Health, 13(1), 232. doi:10.1186/1471-2458-13-232

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gray, C., Hunt, K., Mutrie, N., Anderson, A., Treweek, S., & Wyke, S. (2013). Weight management for overweight and obese men delivered through professional football clubs: a pilot randomized trial. International Journal of Behavioral Nutrition and Physical Activity, 10(1), 121. doi:10.1186/1479-5868-10-121

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Guthold, R., Stevens, G.A., Riley, L.M., & Bull, F.C. (2018). Worldwide trends in insufficient physical activity from 2001 to 2016: A pooled analysis of 358 population-based surveys with 1·9 million participants. The Lancet Global Health, 6(10), e1077e1086. PubMed ID: 30193830 doi:10.1016/S2214-109X(18)30357-7

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Guyatt, G., Walter, S., & Norman, G. (1987). Measuring change over time: Assessing the usefulness of evaluative instruments. Journal of Chronic Diseases, 40(2), 171178. PubMed ID: 3818871 doi:10.1016/0021-9681(87)90069-5

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hoos, T., Espinoza, N., Marshall, S., & Arredondo, E.M. (2012). Validity of the global physical activity questionnaire (GPAQ) in adult Latinas. Journal of physical activity & health, 9(5), 698705. PubMed ID: 22733873 doi:10.1123/jpah.9.5.698

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hunt, K., Gray, C., Maclean, A., Smillie, S., Bunn, C., & Wyke, S. (2014). Do weight management programmes delivered at professional football clubs attract and engage high risk men? A mixed-methods study. BMC Public Health, 14(1), 50. doi:10.1186/1471-2458-14-50

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hunt, K., Wyke, S., Gray, C.M., Anderson, A.S., Brady, A., Bunn, C., . . . Treweek, S. (2014). A gender-sensitised weight loss and healthy living programme for overweight and obese men delivered by Scottish Premier League football clubs (FFIT): A pragmatic randomised controlled trial. The Lancet, 383(9924), 12111221. doi:10.1016/S0140-6736(13)62420-4

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Husted, J.A., Cook, R.J., Farewell, V.T., & Gladman, D.D. (2000). Methods for assessing responsiveness: A critical review and recommendations. Journal of Clinical Epidemiology, 53(5), 459468. PubMed ID: 10812317 doi:10.1016/S0895-4356(99)00206-1

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kelly, M.P., & Barker, M. (2016). Why is changing health-related behaviour so difficult? Public Health, 136, 109116. PubMed ID: 27184821 doi:10.1016/j.puhe.2016.03.030

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kelly, P., Fitzsimons, C., & Baker, G. (2016). Should we reframe how we think about physical activity and sedentary behaviour measurement? Validity and reliability reconsidered. International Journal of Behavioral Nutrition and Physical Activity, 13(1), 110. doi:10.1186/s12966-016-0351-4

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kowalski, K., Rhodes, R., Naylor, P.J., Tuokko, H., & MacDonald, S. (2012). Direct and indirect measurement of physical activity in older adults: A systematic review of the literature. International Journal of Behavioral Nutrition and Physical Activity, 9(1):148. doi:10.1186/1479-5868-9-148

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863. PubMed ID: 24324449 doi:10.3389/fpsyg.2013.00863

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lee, P., Macfarlane, D., Lam, T., & Stewart, S. (2011). Validity of the international physical activity questionnaire short form (IPAQ-SF): A systematic review. International Journal of Behavioral Nutrition and Physical Activity, 8(1), 115. doi:10.1186/1479-5868-8-115

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lee, W.Y.H., Clark, B.K., Winkler, E., Eakin, E.G., & Reeves, M.M. (2015). Responsiveness to change of self-report and device-based physical activity measures in the living well with diabetes trial. Journal of Physical Activity and Health, 12(8), 10821087. PubMed ID: 25243708 doi:10.1123/jpah.2013-0265

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Liang, M.H., Fossel, A.H., & Larson, M.G. (1990). Comparisons of five health status instruments for orthopedic evaluation. Medical Care, 28(7), 632642. PubMed ID: 2366602 doi:10.1097/00005650-199007000-00008

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lord, S., Chastin, S.F.M., McInnes, L., Little, L., Briggs, P., & Rochester, L. (2011). Exploring patterns of daily physical and sedentary behaviour in community-dwelling older adults. Age and Ageing, 40(2), 205210. PubMed ID: 21239410 doi:10.1093/ageing/afq166

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Middel, B., & van Sonderen, E. (2002). Statistical significant change versus relevant or important change in (quasi) experimental design: Some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. International Journal of Integrated Care, 2(4), e15. PubMed ID: 16896390 doi:10.5334/ijic.65

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Montoye, A.H., Pfeiffer, K.A., Suton, D., & Trost, S.G. (2014). Evaluating the responsiveness of accelerometry to detect change in physical activity. Measurement in Physical Education & Exercise Science, 18(4), 273285. PubMed ID: 25284973 doi:10.1080/1091367X.2014.942454

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Morelhão, P.K., Franco, M.R., Oliveira, C.B., Hisamatsu, T.M., Ferreira, P.H., Costa, L.O.P., . . . Pinto, R.Z. (2018). Physical activity and disability measures in chronic non-specific low back pain: A study of responsiveness. Clinical Rehabilitation, 32(12), 16841695. doi:10.1177/0269215518787015

    • Crossref
    • Search Google Scholar
    • Export Citation
  • National Institute for Health and Clinical Excellence. (2006). Obesity: The prevention, identification, assessment and management of overweight and obesity in adults and children. London, UK: NICE.

    • Search Google Scholar
    • Export Citation
  • Nicaise, V., Crespo, N.C., & Marshall, S. (2014). Agreement between the IPAQ and accelerometer for detecting intervention-related changes in physical activity in a sample of Latina women. Journal of Physical Activity and Health, 11(4), 846852. PubMed ID: 23575348 doi:10.1123/jpah.2011-0412

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pedišić, Ž., & Bauman, A. (2015). Accelerometer-based measures in physical activity surveillance: Current practices and issues. British Journal of Sports Medicine, 49(4), 219223. doi:10.1136/bjsports-2013-093407

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Prince, S., Adamo, K., Hamel, M., Hardt, J., Gorber, S., & Tremblay, M. (2008). A comparison of direct versus self-report measures for assessing physical activity in adults: A systematic review. International Journal of Behavioral Nutrition and Physical Activity, 5(1), 56. doi:10.1186/1479-5868-5-56

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Prous, M.J., Salvanés, F.R., & Ortells, L.C. (2008). Responsiveness of outcome measures. Reumatología Clínica (English Edition), 4(6), 240247. PubMed ID: 29443025 doi:10.1016/S2173-5743(08)70197-7

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Reeves, M.M., Marshall, A.L., Owen, N., Winkler, E.A.H., & Eakin, E.G. (2010). Measuring physical activity change in broad-reach intervention trials. Journal of Physical Activity and Health, 7(2), 194202. PubMed ID: 20484758 doi:10.1123/jpah.7.2.194

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Scottish Intercollegiate Guidelines Network. (2010). Management of obesity: a national clinical guideline. Edinburgh, UK: Scottish Intercollegiate Guidelines Network.

    • Search Google Scholar
    • Export Citation
  • Silfee, V.J., Haughton, C.F., Jake-Schoffman, D.E., Lopez-Cepero, A., May, C.N., Sreedhara, M., . . . Lemon, S.C. (2018). Objective measurement of physical activity outcomes in lifestyle interventions among adults: A systematic review. Preventive Medicine Reports, 11, 7480. PubMed ID: 29984142 doi:10.1016/j.pmedr.2018.05.003

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Skender, S., Ose, J., Chang-Claude, J., Paskow, M., Brühmann, B., Siegel, E.M., . . . Ulrich, C.M. (2016). Accelerometry and physical activity questionnaires - A systematic review. BMC Public Health, 16(1), 110. doi:10.1186/s12889-016-3172-0

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sloane, R., Snyder, D.C., Demark-Wahnefried, W., Lobach, D., & Kraus, W.E. (2009). Comparing the 7-day physical activity recall with a triaxial accelerometer for measuring time in exercise. Medicine & Science in Sports & Exercise, 41(6), 13341340. PubMed ID: 19461530 doi:10.1249/MSS.0b013e3181984fa8

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Slootmaker, S.M., Schuit, A.J., Chinapaw, M.J.M., Seidell, J.C., & van Mechelen, W. (2009). Disagreement in physical activity assessed by accelerometer and self-report in subgroups of age, gender, education and weight status. The International Journal of Behavioral Nutrition and Physical Activity, 6(1), 1717. PubMed ID: 19320985 doi:10.1186/1479-5868-6-17

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Stratford, P.W., & Riddle, D.L. (2005). Assessing sensitivity to change: Choosing the appropriate change coefficient. Health and Quality of Life Outcomes, 3(1), 2323. PubMed ID: 15811176 doi:10.1186/1477-7525-3-23

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Stucki, G., Liang, M.H., Fossel, A.H., & Katz, J.N. (1995). Relative responsiveness of condition-specific and generic health status measures in degenerative lumbar spinal stenosis. Journal of Clinical Epidemiology, 48(11), 13691378. PubMed ID: 7490600 doi:10.1016/0895-4356(95)00054-2

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Swartz, A.M., Rote, A.E., Cho, Y.I., Welch, W.A., & Strath, S.J. (2014). Responsiveness of motion sensors to detect change in sedentary and physical activity behaviour. British Journal of Sports Medicine, 48(13), 10431047. PubMed ID: 24825854 doi:10.1136/bjsports-2014-093520

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Thompson, D., Batterham, A.M., Markovitch, D., Dixon, N.C., Lund, A.J.S., & Walhin, J.-P. (2009). Confusion and conflict in assessing the physical activity status of middle-aged men. PLoS One, 4(2), e4337. PubMed ID: 19183812 doi:10.1371/journal.pone.0004337

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Troiano, R.P., Gabriel, K.K.P., Welk, G.J., Owen, N., & Sternfeld, B. (2012). Reported physical activity and sedentary behavior: Why do you ask? Journal of Physical Activity and Health, 9(s1), S68S75. doi:doi:10.1123/jpah.9.s1.s68

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Troiano, R.P., McClain, J.J., Brychta, R.J., & Chen, K.Y. (2014). Evolution of accelerometer methods for physical activity research. British Journal of Sports Medicine, 48(13), 10191023. PubMed ID: 24782483 doi:10.1136/bjsports-2014-093546

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Trost, S.G., McIver, K.L., & Pate, R.R. (2005). Conducting accelerometer-based activity assessments in field-based research. Medicine & Science in Sports & Exercise, 37(Suppl. 11), S531S543. doi:10.1249/01.mss.0000185657.86065.98

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tudor-Locke, C., & Rowe, D.A. (2012). Using cadence to study free-living ambulatory behaviour. Sports Medicine, 42(5), 381398. PubMed ID: 22462794 doi:10.2165/11599170-000000000-00000

    • Crossref
    • Search Google Scholar
    • Export Citation
  • van Nassau, F., Chau, J.Y., Lakerveld, J., Bauman, A.E., & van der Ploeg, H.P. (2015). Validity and responsiveness of four measures of occupational sitting and standing. International Journal of Behavioral Nutrition and Physical Activity, 12(1), 144. doi:10.1186/s12966-015-0306-1

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Warburton, D.E.R., & Bredin, S.S.D. (2017). Health benefits of physical activity: A systematic review of current systematic reviews. Current Opinion in Cardiology, 32(5), 541556. PubMed ID: 28708630 doi:10.1097/HCO.0000000000000437

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ward, D.S., Evenson, K.R., Vaughn, A., Rodgers, A.B., & Troiano, R.P. (2005). Accelerometer use in physical activity: Best practices and research recommendations. Medicine & Science in Sports & Exercise, 37(Suppl. 11), S582S588. doi:10.1249/01.mss.0000185292.71933.91

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Warren, J.M., Ekelund, U., Besson, H., Mezzani, A., Geladas, N., & Vanhees, L. (2010). Assessment of physical activity– a review of methodologies with reference to epidemiological research: A report of the exercise physiology section of the European Association of Cardiovascular Prevention and Rehabilitation. European Journal of Cardiovascular Prevention & Rehabilitation, 17(2), 127139. PubMed ID: 20215971 doi:10.1097/HJR.0b013e32832ed875

    • Crossref
    • Search Google Scholar
    • Export Citation
  • World Health Organization. (2018). Global action plan on physical activity 2018–2030: More active people for a healthier world. Geneva, Switzerland: Author.

    • Search Google Scholar
    • Export Citation
  • Wijndaele, K., Westgate, K., Stephens, S.K., Blair, S.N., Bull, F.C., Chastin, S.F.M., . . . Healy, G.N. (2015). Utilization and harmonization of adult accelerometry data: Review and expert consensus. Medicine & Science in Sports & Exercise, 47(10), 21292139. PubMed ID: 25785929 doi:10.1249/MSS.0000000000000661

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Winkler, E., Waters, L., Eakin, E., Fjeldsoe, B., Owen, N., & Reeves, M. (2013). Is measurement error altered by participation in a physical activity intervention? Medicine & Science in Sports & Exercise, 45(5), 10041011. PubMed ID: 23190599 doi:10.1249/MSS.0b013e31827ccf7d

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wyke, S., Hunt, K., Gray, C., Fenwick, E., Bunn, C., Donnan, P., . . . Treweek, S. (2015). Football Fans in Training (FFIT): A randomised controlled trial of a gender-sensitised weight loss and healthy living programme for men– end of study report. Public Health Research, 3(2), 1129. doi:10.3310/phr03020

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 478 478 43
Full Text Views 4 4 0
PDF Downloads 4 4 0