Poor Reliability of Measurement Instruments to Assess Acute Responses to Load in Soccer Players Irrespective of Biological Maturity Status

Click name to view affiliation

Ludwig Ruf Saarland University
TSG ResearchLab gGmbH

Search for other papers by Ludwig Ruf in
Current site
Google Scholar
PubMed
Close
*
,
Barry Drust University of Birmingham

Search for other papers by Barry Drust in
Current site
Google Scholar
PubMed
Close
,
Paul Ehmann TSG ResearchLab gGmbH

Search for other papers by Paul Ehmann in
Current site
Google Scholar
PubMed
Close
,
Sabrina Forster Saarland University

Search for other papers by Sabrina Forster in
Current site
Google Scholar
PubMed
Close
,
Anne Hecksteden Saarland University

Search for other papers by Anne Hecksteden in
Current site
Google Scholar
PubMed
Close
, and
Tim Meyer Saarland University

Search for other papers by Tim Meyer in
Current site
Google Scholar
PubMed
Close
Restricted access

Purpose: To assess the short-term reliability of measurement instruments to quantify the acute psychophysiological response to load in adolescent soccer players in relation to biological maturity. Methods: Data were collected from 108 U12 to U17 soccer players on 2 consecutive weeks (pre, n = 32; at, n = 34; and post, n = 42 estimated peak height velocity). Measurements consisted of the Short Recovery and Stress Scale, a countermovement jump, assessment of leg stiffness, and a submaximal run to assess exercise heart rate and heart rate recovery. Test–retest reliability was assessed with the coefficient of variation (CV) and intraclass correlation coefficient (ICC). Results: Items of the Short Recovery and Stress Scale showed poor reliability across maturity groups (CV = 7.0%–53.5%; ICC = .28 to .79). Only few countermovement jump variables (jump height, concentric impulse, and concentric velocity) possessed good reliability. For most variables of the countermovement jump, reliability was better for the post peak height velocity group followed by at-peak height velocity and prepeak height velocity. Very high levels of reliability across maturity groups were observed for exercise heart rate (CV < 1.8%; ICC > .94), while heart rate recovery was more variable (CV < 16.5%; ICC > .48). Conclusion: Results suggest that the majority of investigated variables have poor reliability, questioning their ability to detect small, yet meaningful changes in acute responses to load in adolescent soccer players.

Ruf, Forster, Hecksteden, and Meyer are with the Institute of Sports and Preventive Medicine, Saarland University, Saarbrücken, Germany. Ruf and Ehmann are with the TSG ResearchLab gGmbH, Zuzenhausen, Germany. Drust is with the School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham, UK.

Ruf (Ludwig.Ruf@uni-saarland.de) is corresponding author.

Supplementary Materials

    • Supplementary Material (PDF 66 KB)
  • Collapse
  • Expand
  • 1.

    Akenhead R, Nassis GP. Training load and player monitoring in high-level football: current practice and perceptions. Int J Sports Physiol Perform. 2016;11(5):58793. PubMed ID: 26456711 doi:10.1123/ijspp.2015-0331

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 2.

    Beunen G, Malina RM. Growth and physical performance relative to the timing of the adolescent spurt. Exerc Sport Sci Rev. 1988;16:50340. PubMed ID: 3292266 doi:10.1249/00003677-198800160-00018

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 3.

    Blakemore S, Burnett S, Dahl RE. The role of puberty in the developing adolescent brain. Hum Brain Mapp. 2010;31(6):92633. PubMed ID: 20496383

  • 4.

    Bland JM, Altman DG. Measurement error proportional to the mean. BMJ. 1996;313(7049):106. PubMed ID: 8688716 doi:10.1136/bmj.313.7049.106

  • 5.

    Buchheit M. Monitoring training status with HR measures: do all roads lead to Rome? Front Physiol. 2014;5:73. PubMed ID: 24578692 doi:10.3389/fphys.2014.00073

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 6.

    Buchheit M, Al Haddad H, Laursen PB, Ahmaidi S. Effect of body posture on postexercise parasympathetic reactivation in men. Exp Physiol. 2009;94(7):795804. PubMed ID: 19395660 doi:10.1113/expphysiol.2009.048041

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 7.

    Buchheit M, Mendez-Villanueva A. Reliability and stability of anthropometric and performance measures in highly-trained young soccer players: effect of age and maturation. J Sports Sci. 2013;31(12):133243. PubMed ID: 23656211 doi:10.1080/02640414.2013.781662

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 8.

    Buchheit M, Mendez-Villanueva A, Quod MJ, Poulos N, Bourdon P. Determinants of the variability of heart rate measures during a competitive period in young soccer players. Eur J Appl Physiol. 2010;109(5):86978. PubMed ID: 20229253 doi:10.1007/s00421-010-1422-x

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 9.

    Canty A, Ripley B. boot: Bootstrap R (S-Plus) Functions, version 13-25. Cambridge:Cambridge University Press; 2020.

  • 10.

    Chavda S, Bromley T, Jarvis P, et al. Force-time characteristics of the countermovement jump: analyzing the curve in excel. Strength Cond J. 2018;40(2):6777. doi:10.1519/SSC.0000000000000353

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 11.

    Dalleau G, Belli A, Viale F, Lacour JR, Bourdin M. A simple method for field measurements of leg stiffness in hopping. Int J Sports Med. 2004;25(3):1706. PubMed ID: 15088239 doi:10.1055/s-2003-45252

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 12.

    de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurement in Medicine: A Practical Guide. Cambridge, UK: Cambridge University Press; 2011.

  • 13.

    Doncaster G, Scott M, Iga J, Unnithan V. Reliability of heart rate responses both during and following a 6 min Yo-Yo IR1 test in highly trained youth soccer players. Sci Med Footb. 2019;3(1):1420. doi:10.1080/24733938.2018.1476775

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 14.

    Epstein LH, Valoski AM, Kalarchian MA, McCurley J. Do children lose and maintain weight easier than adults: a comparison of child and parent weight changes from six months to ten years. Obes Res. 1995;3(5):4117. PubMed ID: 8521160 doi:10.1002/j.1550-8528.1995.tb00170.x

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 15.

    Fitzpatrick JF, Hicks KM, Russell M, Hayes P. The reliability of potential fatigue-monitoring measures in elite youth soccer players [published online ahead of print September 6, 2019]. J Strength Cond Res, 35(12), 34483452. doi:10.1519/jsc.0000000000003317

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 16.

    Frost G, Dowling J, Dyson K, Bar-Or O. Cocontraction in three age groups of children during treadmill locomotion. J Electromyogr Kinesiol. 1997;7(3):17986. PubMed ID: 20719703 doi:10.1016/S1050-6411(97)84626-3

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 17.

    Gathercole R, Sporer B, Stellingwerff T, Sleivert G. Alternative countermovement-jump analysis to quantify acute neuromuscular fatigue. Int J Sports Physiol Perform. 2015;10(1):8492. PubMed ID: 24912201 doi:10.1123/ijspp.2013-0413

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 18.

    Goddings AL. The Impact of Puberty on Adolescent Brain Development. London, UK: University College London; 2015.

  • 19.

    Hopkins WG, Marshall SW, Batterham AM, Hanin J. Progressive statistics for studies in sports medicine and exercise science. Med Sci Sports Exercise. 2009;41(1):312. doi:10.1249/MSS.0b013e31818cb278

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 20.

    Impellizzeri FM, Marcora SM, Coutts AJ. Internal and external training load: 15 years on. Int J Sports Physiol Perform. 2019;14(2):2703. PubMed ID: 30614348 doi:10.1123/ijspp.2018-0935

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 21.

    Impellizzeri FM, Rampinini E, Marcora SM. Physiological assessment of aerobic training in soccer. J Sports Sci. 2005;23(6):58392. PubMed ID: 16195007 doi:10.1080/02640410400021278

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 22.

    Jeffries AC, Wallace L, Coutts AJ, McLaren SJ, McCall A, Impellizzeri FM. Athlete-reported outcome measures for monitoring training responses: a systematic review of risk of bias and measurement property quality according to the COSMIN guidelines [published online ahead of print September 21, 2020]. Int J Sports Physiol Perform, 15(9), 12031215. doi:10.1123/ijspp.2020-0386

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 23.

    Kellmann M, Kölling S, Hitzschke B. Das Akutmaß und die Kurzskala zur Erfassung von Erholung und Beanspruchung im Sport: Manual. 1 Auflage. Hellenthal, Germany: Sportverlag Strauß; 2016. 124 p. (Schriftenreihe des Bundesinstituts für Sportwissenschaft).

    • Search Google Scholar
    • Export Citation
  • 24.

    Khamis HJ, Roche AF. Predicting adult stature without using skeletal age: the Khamis-Roche method. Pediatrics. 1994;94(4 pt 1):5047. (Erratum Pediatrics 1995; 95:457 for corrected tables) PubMed ID: 7936860

    • Search Google Scholar
    • Export Citation
  • 25.

    Koo TK, Li MY. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):15563. PubMed ID: 27330520 doi:10.1016/j.jcm.2016.02.012

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 26.

    Lake J, Mundy P, Comfort P, McMahon JJ, Suchomel TJ, Carden P. Concurrent validity of a portable force plate using vertical jump force-time characteristics. J Appl Biomech. 2018;34(5):4103. PubMed ID: 29809100 doi:10.1123/jab.2017-0371

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 27.

    Lamberts RP, Lambert MI. Day-to-day variation in heart rate at different levels of submaximal exertion: implications for monitoring training. J Strength Cond Res. 2009;23(3):100510. PubMed ID: 19387374 doi:10.1519/JSC.0b013e3181a2dcdc

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 28.

    Lloyd RS, Oliver JL, Hughes MG, Williams CA. Age-related differences in the neural regulation of stretch-shortening cycle activities in male youths during maximal and sub-maximal hopping. J Electromyogr Kinesiol. 2012;22(1):3743. PubMed ID: 22000942 doi:10.1016/j.jelekin.2011.09.008

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 29.

    Lloyd RS, Oliver JL, Hughes MG, Williams CA. Reliability and validity of field-based measures of leg stiffness and reactive strength index in youths. J Sports Sci. 2009;27(14):156573. PubMed ID: 19967591 doi:10.1080/02640410903311572

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 30.

    Malina RM, Rogol AD, Cumming SP, Coelho-e-Silva MJ, Figueiredo AJ. Biological maturation of youth athletes: assessment and implications. Br J Sports Med. 2015;49(13):8529. PubMed ID: 26084525 doi:10.1136/bjsports-2015-094623

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 31.

    Maloney SJ, Fletcher IM. Lower limb stiffness testing in athletic performance: a critical review. Sports Biomech. 2021;20(1):10930. PubMed ID: 29768094 doi:10.1080/14763141.2018.1460395

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 32.

    Meade T, Dowswell E. Adolescents’ health-related quality of life (HRQoL) changes over time: a three year longitudinal study. Health Qual Life Outcomes. 2016;14(1):14. doi:10.1186/s12955-016-0415-9

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 33.

    Meylan CMP, Nosaka K, Green J, Cronin JB. The effect of three different start thresholds on the kinematics and kinetics of a countermovement jump. J Strength Cond Res. 2011;25(4):11647. PubMed ID: 20664368 doi:10.1519/JSC.0b013e3181c699b9

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 34.

    Molinari L, Gasser T, Largo R. A comparison of skeletal maturity and growth. Ann Hum Biol. 2013;40(4):33340. PubMed ID: 23327630 doi:10.3109/03014460.2012.756122

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 35.

    Nässi A, Ferrauti A, Meyer T, Pfeiffer M, Kellmann M. Development of two short measures for recovery and stress in sport. Eur J Sport Sci. 2017;17(7):894903. PubMed ID: 28463598 doi:10.1080/17461391.2017.1318180

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 36.

    Owen C, Jones P, Comfort P. The reliability of the submaximal version of the Yo-Yo intermittent recovery test in elite youth soccer. J Trainol. 2017;6(1):314. doi:10.17338/trainology.6.1_31

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 37.

    Pelka M, Schneider P, Kellmann M. Development of pre- and post-match morning recovery-stress states during in-season weeks in elite youth football. Sci Med Footb. 2018;2(2):12732. doi:10.1080/24733938.2017.1384560

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 38.

    Quatman-Yates CC, Quatman CE, Meszaros AJ, Paterno MV, Hewett TE. A systematic review of sensorimotor function during adolescence: a developmental stage of increased motor awkwardness? Br J Sports Med. 2012;46(9):64955. PubMed ID: 21459874 doi:10.1136/bjsm.2010.079616

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 39.

    Rabbani A, Kargarfard M, Twist C. The reliability and validity of a submaximal warm-up test for monitoring training status in professional soccer players. J Strength Cond Res. 2018;32(2):32633. PubMed ID: 29210958 doi:10.1519/JSC.0000000000002335

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 40.

    Radnor JM, Oliver JL, Waugh CM, Myer GD, Moore IS, Lloyd RS. The influence of growth and maturation on stretch-shortening cycle function in youth. Sports Med. 2018;48(1):5771. PubMed ID: 28900862 doi:10.1007/s40279-017-0785-0

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 41.

    Romeo RD. The teenage brain: the stress response and the adolescent brain. Curr Dir Psychol Sci. 2013;22(2):1405. PubMed ID: 25541572 doi:10.1177/0963721413475445

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 42.

    Ryan S, Pacecca E, Tebble J, Hocking J, Kempton T, Coutts AJ. Measurement characteristics of athlete monitoring tools in Professional Australian Football [published online ahead of print October 14, 2019]. Int J Sports Physiol Perform, 15(4), 457463. doi:10.1123/ijspp.2019-0060

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 43.

    Salter J, Croix MBADS, Hughes JD. The moderating impact of maturation on acute neuromuscular and psycho-physiological responses to simulated soccer activity in academy soccer players. Eur J Sport Sci. 2021;21(12):163747. PubMed ID: 33315522 doi:10.1080/17461391.2020.1851775

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 44.

    Sands WA, Kavanaugh AA, Murray SR, McNeal JR, Jemni M. Modern techniques and technologies applied to training and performance monitoring. Int J Sports Physiol Perform. 2017;12(suppl):S26372. doi:10.1123/ijspp.2016-0405

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 45.

    Sawczuk T, Jones B, Scantlebury S, Till K. Relationships between training load, sleep duration, and daily well-being and recovery measures in youth athletes. Pediatr Exerc Sci. 2018;30(3):34552. PubMed ID: 29478381 doi:10.1123/pes.2017-0190

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 46.

    Scott TJ, Delaney JA, Duthie GM, et al. Reliability and usefulness of the 30-15 intermittent fitness test in rugby league. J Strength Cond Res. 2015;29(7):198590. PubMed ID: 26102261 doi:10.1519/JSC.0000000000000846

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 47.

    Silva JR, Rumpf MC, Hertzog M, et al. Acute and residual soccer match-related fatigue: a systematic review and meta-analysis. Sports Med. 2018;48(3):53983. PubMed ID: 29098658 doi:10.1007/s40279-017-0798-8

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 48.

    Ste Croix M, Hughes J, Lloyd RS, Oliver JL, Read P. Leg stiffness in female soccer players: inter-session reliability and the fatiguing effects of soccer-specific exercise. J Strength Cond Res. 2017;31(11):30528. PubMed ID: 29065079 doi:10.1519/JSC.0000000000001715

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 49.

    Streiner DL, Norman GR, Cairney J. Reliability. Health Measurement Scales: A Practical Guide to Their Development and Use. 5th ed. Oxford:Oxford University Press; 2015. pp. 15999.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 50.

    Taylor K-L, Cronin J, Gill ND, Chapman DW, Sheppard J. Sources of variability in iso-inertial jump assessments. Int J Sports Physiol Perform. 2010;5(4):54658. PubMed ID: 21266738 doi:10.1123/ijspp.5.4.546

    • Crossref
    • Search Google Scholar
    • Export Citation
  • 51.

    Veugelers KR, Naughton GA, Duncan CS, Burgess DJ, Graham SR. Validity and reliability of a submaximal intermittent running test in elite Australian football players. J Strength Cond Res. 2016;30(12):334753. PubMed ID: 27870695 doi:10.1519/JSC.0000000000001441

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 2030 579 37
Full Text Views 59 35 2
PDF Downloads 58 20 1