Inter- and Intrarater Reliabilities of the Test of Gross Motor Development—Third Edition Among Experienced TGMD-2 Raters

in Adapted Physical Activity Quarterly

Click name to view affiliation

Hyokju MaengGeorgia State University

Search for other papers by Hyokju Maeng in
Current site
Google Scholar
PubMedClose
*
,
E. Kipling WebsterLouisiana State University

Search for other papers by E. Kipling Webster in
Current site
Google Scholar
PubMedClose
*
,
E. Andrew PitchfordIowa State University

Search for other papers by E. Andrew Pitchford in
Current site
Google Scholar
PubMedClose
*
, and
Dale A. UlrichUniversity of Michigan

Search for other papers by Dale A. Ulrich in
Current site
Google Scholar
PubMedClose
*
DOI:
https://doi.org/10.1123/apaq.2016-0026
Keywords:
reliability; TGMD-3; motor skills; assessment
In Print:
Volume 34: Issue 4
Page Range:
442–455
Restricted access

The purpose of this study was to examine the inter- and intrarater reliabilities of the Test of Gross Motor Development—third edition (TGMD-3). The TGMD-3 was administered to 10 typically developing children. Five raters with experience using the Test of Gross Motor Development—second edition (TGMD-2) scored the digitally recorded performances and then rescored the same performances after a period of 2 weeks. Intraclass correlation (ICC) was used to examine both inter- and intrarater reliabilities of scores. Interrater reliability for the total score, locomotor subscale, and ball skills subscale (ICC: 0.92–0.96) were all excellent, while individual skills (ICC: 0.51–0.93) had fair-to-excellent reliability. Intrarater reliability across all raters was also excellent (ICC: 0.77–0.98) but varied widely for individual raters (ICC: 0.28–1.00) including multiple examples of poor reliability. While raters experienced with the TGMD-2 can produce consistent scores for TGMD-3 total scale and subscales, additional training is needed to improve skill-specific reliability.

Maeng is with the Dept. of Kinesiology and Health, Georgia State University, Atlanta, GA. Webster is with the School of Kinesiology, Louisiana State University, Baton Rouge, LA. Pitchford is with the Dept. of Kinesiology, Iowa State University, Ames, IA. Ulrich is with the School of Kinesiology, University of Michigan, Ann Arbor, MI.

Address author correspondence to Hyokju Maeng at hmaeng1@student.gsu.edu.
  • Collapse
  • Expand

Adapted Physical Activity Quarterly

Cover Adapted Physical Activity Quarterly

  • American Education Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

    • Search Google Scholar
    • Export Citation

  • Barnett, L.M., Minto, C., Lander, N., & Hardy, L.L. (2013). Interrater reliability assessment using the Test of Gross Motor Development-2. Journal of Science and Medicine in Sport, 17(6), 667–670. PubMed doi:10.1016/j.jsams.2013.09.013

    • Search Google Scholar
    • Export Citation

  • Brennan, R.L. (2001). An essay on the history and future of reliability from the perspective of replications. Journal of Educational Measurement, 38(4), 295–317. doi:10.1111/j.1745-3984.2001.tb01129.x

    • Search Google Scholar
    • Export Citation

  • Breslin, C.M., & Rudisill, M.E. (2011). The effect of visual supports on performance of the TGMD-2 for children with autism spectrum disorder. Adapted Physical Activity Quarterly, 28(4), 342–353. PubMed doi:10.1123/apaq.28.4.342

    • Search Google Scholar
    • Export Citation

  • Burton, A.W., & Miller, D.E. (1998). Movement skill assessment. Champaign, IL: Human Kinetics.

  • Cicchetti, D.V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi:10.1037/1040-3590.6.4.284

    • Search Google Scholar
    • Export Citation

  • Eliasziw, M., Young, S.L., Woodbury, M.G., & Fryday-Field, K. (1994). Statistical methodology for the concurrent assessment of interrater and intrarater reliability: Using goniometric measurements as an example. Physical Therapy, 74(8), 777–788. PubMed doi:10.1093/ptj/74.8.777

    • Search Google Scholar
    • Export Citation

  • Estevan, I., Molina-Garcia, J., Queralt, A., Álvarez, O., Castillo, I., & Barnett, L. (2017). Validity and reliability of the Spanish version of the Test of Gross Motor Development-3. Journal of Motor Learning and Development, 5(1), 69–81. doi:10.1123/jmld.2016-0045

    • Search Google Scholar
    • Export Citation

  • Farrokhi, A., Zareh, M., Karimi, L., Kazemnejad, A., & Ilbeigi, S. (2014). Reliability and validity of Test of Gross Motor Development-2 (Ulrich, 2000) among 3-10 aged children of Tehrran City. Journal of Physical Education and Sports Management, 5(2), 18–28. doi:10.5897/JPESM12.003

    • Search Google Scholar
    • Export Citation

  • Gallahue, D.L., & Ozmun, J.C. (2006). Motor development in young children: Handbook of research on the education of young children (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.

    • Search Google Scholar
    • Export Citation

  • Hardy, L.L., King, L., Farrell, L., Macniven, R., & Howlett, S. (2010). Fundamental movement skills among Australian preschool children. Journal of Science and Medicine in Sport, 13(5), 503–508. PubMed doi:10.1016/j.jsams.2009.05.010

    • Search Google Scholar
    • Export Citation

  • Harvey, W.J., Reid, G., Grizenko, N., Mbekou, V., Ter-Stepanian, M., & Joober, R. (2007). Fundamental movement skills and children with attention-deficit hyperactivity disorder: Peer comparisons and stimulant effects. Journal of Abnormal Child Psychology, 35(5), 871–882. PubMed doi:10.1007/s10802-007-9140-5

    • Search Google Scholar
    • Export Citation

  • Holfelder, B., & Schott, N. (2014). Relationship of fundamental movement skills and physical activity in children and adolescents: A systematic review. Psychology of Sport and Exercise, 15(4), 382–391. doi:10.1016/j.psychsport.2014.03.005

    • Search Google Scholar
    • Export Citation

  • Houwen, S., Hartman, E., Jonker, L., & Visscher, C. (2010). Reliability and validity of the TGMD-2 in primary-school-age children with visual impairments. Adapted Physical Activity Quarterly, 27(2), 143–159. PubMed doi:10.1123/apaq.27.2.143

    • Search Google Scholar
    • Export Citation

  • IBM Corp. (2013). IBM SPSS statistics for Windows, Version 22.0. Armonk, NY: IBM Corp.

  • Kelly, L. (2006). Adapted physical education national standards (2nd ed.). Champaign, IL: Human Kinetics.

  • Kim, S., Kim, M.J., Valentini, N.C., & Clark, J.E. (2015). Validity and reliability of the TGMD-2 for South Korean children. Journal of Motor Behavior, 46(5), 351–356. PubMed doi:10.1080/00222895.2014.914886

    • Search Google Scholar
    • Export Citation

  • Kim, Y., Park, I., & Kang, M. (2012). Examining rater effects of the TGMD-2 on children with intellectual disability. Adapted Physical Activity Quarterly, 29(4), 346–365. PubMed doi:10.1123/apaq.29.4.346

    • Search Google Scholar
    • Export Citation

  • Koch, G.G. (1982). Intraclass correlation coefficient. In S. Kotz & N.L. Johnson (Eds.), Encyclopedia of statistical sciences (pp. 213–217). New York, NY: John Wiley & Sons. doi:10.1002/0471667196.ess1275.pub2

    • Search Google Scholar
    • Export Citation

  • Logan, S.W., Robinson, L.E., Wilson, A.E., & Lucas, W.A. (2012). Getting the fundamentals of movement: A meta-analysis of the effectiveness of motor skill interventions in children. Child: Care, Health and Development, 38(3), 305–315. PubMed doi:10.1111/j.1365-2214.2011.01307.x

    • Search Google Scholar
    • Export Citation

  • McGraw, K.O., & Wong, S.P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30–46. doi:10.1037/1082-989X.1.1.30

    • Search Google Scholar
    • Export Citation

  • Palmer, K.K., & Brian, A. (2016). Test of Gross Motor Development-2 scores differ between expert and novice coders. Journal of Motor Learning and Development, 4, 142–151. doi:10.1123/jmld.2015-0035

    • Search Google Scholar
    • Export Citation

  • Rintala, P.O., Sääkslahti, A.K., & Iivonen, S. (2017). Reliability assessment of scores from video-recorded TGMD-3 performances. Journal of Motor Learning and Development, 5(1), 59–68. doi:10.1123/jmld.2016-0007

    • Search Google Scholar
    • Export Citation

  • Rousson, V., Casser, T., & Seifert, B. (2002). Assessing intrarater, interrater and test-retest reliability of continuous measurements. Statistics in Medicine, 21(22), 3421–3446. PubMed doi:10.1002/sim.1253

    • Search Google Scholar
    • Export Citation

  • SHAPE America. (2014). National standards & grade-level outcomes for K-12 physical education. Champaign, IL: Human Kinetics.

  • Shrout, P.E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7(3), 301–317. PubMed doi:10.1177/096228029800700306

    • Search Google Scholar
    • Export Citation

  • Shrout, P.E., & Fleiss, J.L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428. PubMed doi:10.1037/0033-2909.86.2.420

    • Search Google Scholar
    • Export Citation

  • Simons, J., Daly, D., Theodorou, F., Caron, C., Simons, J., & Andoniadou, E. (2007). Validity and reliability of the TGMD-2 in 7-10-year-old Flemish children with intellectual disability. Adapted Physical Activity Quarterly, 25(1), 71–82. PubMed doi:10.1123/apaq.25.1.71

    • Search Google Scholar
    • Export Citation

  • Sun, S., Sun, H., Zhu, Y., Huang, L., & Hsieh, Y. (2011). Concurrent validity of preschooler gross motor quality scale with Test of Gross Motor Development-2. Research in Developmental Disabilities, 32(3), 1163–1168. PubMed doi:10.1016/j.ridd.2011.01.007

    • Search Google Scholar
    • Export Citation

  • Ulrich, D.A. (1985). The test of gross motor development. Austin, TX: Pro-Ed Publishers.

  • Ulrich, D.A. (2000). The test of gross motor development-2. Austin, TX: Pro-Ed Publishers.

  • Ulrich, D.A. (in press). The test of gross motor development-3. Austin, TX: Pro-Ed Publishers.

  • Valentini, N.C. (2012). Validity and reliability of the TGMD-2 for Brazilian children. Journal of Motor Behavior, 44(4), 275–280. PubMed doi:10.1080/00222895.2012.700967

    • Search Google Scholar
    • Export Citation

  • Valentini, N.C., & Rudisill, M.E. (2004). Motivational climate, motor-skill development, and perceived competence: Two studies of developmentally delayed kindergarten children. Journal of Teaching in Physical Education, 23(3), 216–234. doi:10.1123/jtpe.23.3.216

    • Search Google Scholar
    • Export Citation

  • Wagner, M.O., Webster, E.K., & Ulrich, D.A. (2017). Psychometric properties of the Test of Gross Motor Development, 3rd edition (German translation): Results of a pilot study. Journal of Motor Learning and Development, 5(1), 29–44. doi:10.1123/jmld.2016-0006

    • Search Google Scholar
    • Export Citation

  • Webster, E.K., & Ulrich, D.A. (2017). Evaluation of the psychometric properties of the Test of Gross Motor Development—Third edition. Journal of Motor Learning and Development, 5, 45–58. doi:10.1123/jmld.2016-0003

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 4382 1445 49
Full Text Views 113 29 2
PDF Downloads 94 35 4