Inter- and Intrarater Reliabilities of the Test of Gross Motor Development—Third Edition Among Experienced TGMD-2 Raters

in Adapted Physical Activity Quarterly
Restricted access

Purchase Article

USD $24.95

Student 1 year subscription

USD $63.00

1 year subscription

USD $84.00

Student 2 year subscription

USD $119.00

2 year subscription

USD $156.00

The purpose of this study was to examine the inter- and intrarater reliabilities of the Test of Gross Motor Development—third edition (TGMD-3). The TGMD-3 was administered to 10 typically developing children. Five raters with experience using the Test of Gross Motor Development—second edition (TGMD-2) scored the digitally recorded performances and then rescored the same performances after a period of 2 weeks. Intraclass correlation (ICC) was used to examine both inter- and intrarater reliabilities of scores. Interrater reliability for the total score, locomotor subscale, and ball skills subscale (ICC: 0.92–0.96) were all excellent, while individual skills (ICC: 0.51–0.93) had fair-to-excellent reliability. Intrarater reliability across all raters was also excellent (ICC: 0.77–0.98) but varied widely for individual raters (ICC: 0.28–1.00) including multiple examples of poor reliability. While raters experienced with the TGMD-2 can produce consistent scores for TGMD-3 total scale and subscales, additional training is needed to improve skill-specific reliability.

Maeng is with the Dept. of Kinesiology and Health, Georgia State University, Atlanta, GA. Webster is with the School of Kinesiology, Louisiana State University, Baton Rouge, LA. Pitchford is with the Dept. of Kinesiology, Iowa State University, Ames, IA. Ulrich is with the School of Kinesiology, University of Michigan, Ann Arbor, MI.Address author correspondence to Hyokju Maeng at hmaeng1@student.gsu.edu.
Adapted Physical Activity Quarterly
Article Sections
References
  • American Education Research Association American Psychological Association & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

    • Search Google Scholar
    • Export Citation
  • BarnettL.M.MintoC.LanderN. & HardyL.L. (2013). Interrater reliability assessment using the Test of Gross Motor Development-2. Journal of Science and Medicine in Sport 17(6) 667670. PubMed doi:10.1016/j.jsams.2013.09.013

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BrennanR.L. (2001). An essay on the history and future of reliability from the perspective of replications. Journal of Educational Measurement 38(4) 295317. doi:10.1111/j.1745-3984.2001.tb01129.x

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BreslinC.M. & RudisillM.E. (2011). The effect of visual supports on performance of the TGMD-2 for children with autism spectrum disorder. Adapted Physical Activity Quarterly 28(4) 342353. PubMed doi:10.1123/apaq.28.4.342

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BurtonA.W. & MillerD.E. (1998). Movement skill assessment. Champaign, IL: Human Kinetics.

  • CicchettiD.V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment 6(4) 284290. doi:10.1037/1040-3590.6.4.284

    • Crossref
    • Search Google Scholar
    • Export Citation
  • EliasziwM.YoungS.L.WoodburyM.G. & Fryday-FieldK. (1994). Statistical methodology for the concurrent assessment of interrater and intrarater reliability: Using goniometric measurements as an example. Physical Therapy 74(8) 777788. PubMed doi:10.1093/ptj/74.8.777

    • Crossref
    • Search Google Scholar
    • Export Citation
  • EstevanI.Molina-GarciaJ.QueraltA.ÁlvarezO.CastilloI. & BarnettL. (2017). Validity and reliability of the Spanish version of the Test of Gross Motor Development-3. Journal of Motor Learning and Development 5(1) 6981. doi:10.1123/jmld.2016-0045

    • Crossref
    • Search Google Scholar
    • Export Citation
  • FarrokhiA.ZarehM.KarimiL.KazemnejadA. & IlbeigiS. (2014). Reliability and validity of Test of Gross Motor Development-2 (Ulrich, 2000) among 3-10 aged children of Tehrran City. Journal of Physical Education and Sports Management 5(2) 1828. doi:10.5897/JPESM12.003

    • Search Google Scholar
    • Export Citation
  • GallahueD.L. & OzmunJ.C. (2006). Motor development in young children: Handbook of research on the education of young children (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.

    • Search Google Scholar
    • Export Citation
  • HardyL.L.KingL.FarrellL.MacnivenR. & HowlettS. (2010). Fundamental movement skills among Australian preschool children. Journal of Science and Medicine in Sport 13(5) 503508. PubMed doi:10.1016/j.jsams.2009.05.010

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HarveyW.J.ReidG.GrizenkoN.MbekouV.Ter-StepanianM. & JooberR. (2007). Fundamental movement skills and children with attention-deficit hyperactivity disorder: Peer comparisons and stimulant effects. Journal of Abnormal Child Psychology 35(5) 871882. PubMed doi:10.1007/s10802-007-9140-5

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HolfelderB. & SchottN. (2014). Relationship of fundamental movement skills and physical activity in children and adolescents: A systematic review. Psychology of Sport and Exercise 15(4) 382391. doi:10.1016/j.psychsport.2014.03.005

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HouwenS.HartmanE.JonkerL. & VisscherC. (2010). Reliability and validity of the TGMD-2 in primary-school-age children with visual impairments. Adapted Physical Activity Quarterly 27(2) 143159. PubMed doi:10.1123/apaq.27.2.143

    • Crossref
    • Search Google Scholar
    • Export Citation
  • IBM Corp. (2013). IBM SPSS statistics for Windows Version 22.0. Armonk, NY: IBM Corp.

  • KellyL. (2006). Adapted physical education national standards (2nd ed.). Champaign, IL: Human Kinetics.

  • KimS.KimM.J.ValentiniN.C. & ClarkJ.E. (2015). Validity and reliability of the TGMD-2 for South Korean children. Journal of Motor Behavior 46(5) 351356. PubMed doi:10.1080/00222895.2014.914886

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KimY.ParkI. & KangM. (2012). Examining rater effects of the TGMD-2 on children with intellectual disability. Adapted Physical Activity Quarterly 29(4) 346365. PubMed doi:10.1123/apaq.29.4.346

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KochG.G. (1982). Intraclass correlation coefficient. In S. Kotz & N.L. Johnson (Eds.) Encyclopedia of statistical sciences (pp. 213217). New York, NY: John Wiley & Sons. doi:10.1002/0471667196.ess1275.pub2

    • Search Google Scholar
    • Export Citation
  • LoganS.W.RobinsonL.E.WilsonA.E. & LucasW.A. (2012). Getting the fundamentals of movement: A meta-analysis of the effectiveness of motor skill interventions in children. Child: Care Health and Development 38(3) 305315. PubMed doi:10.1111/j.1365-2214.2011.01307.x

    • Search Google Scholar
    • Export Citation
  • McGrawK.O. & WongS.P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods 1(1) 3046. doi:10.1037/1082-989X.1.1.30

    • Crossref
    • Search Google Scholar
    • Export Citation
  • PalmerK.K. & BrianA. (2016). Test of Gross Motor Development-2 scores differ between expert and novice coders. Journal of Motor Learning and Development 4142151. doi:10.1123/jmld.2015-0035

    • Crossref
    • Search Google Scholar
    • Export Citation
  • RintalaP.O.SääkslahtiA.K. & IivonenS. (2017). Reliability assessment of scores from video-recorded TGMD-3 performances. Journal of Motor Learning and Development 5(1) 5968. doi:10.1123/jmld.2016-0007

    • Crossref
    • Search Google Scholar
    • Export Citation
  • RoussonV.CasserT. & SeifertB. (2002). Assessing intrarater, interrater and test-retest reliability of continuous measurements. Statistics in Medicine 21(22) 34213446. PubMed doi:10.1002/sim.1253

    • Crossref
    • Search Google Scholar
    • Export Citation
  • SHAPE America. (2014). National standards & grade-level outcomes for K-12 physical education. Champaign, IL: Human Kinetics.

  • ShroutP.E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research 7(3) 301317. PubMed doi:10.1177/096228029800700306

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ShroutP.E. & FleissJ.L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin 86(2) 420428. PubMed doi:10.1037/0033-2909.86.2.420

    • Crossref
    • Search Google Scholar
    • Export Citation
  • SimonsJ.DalyD.TheodorouF.CaronC.SimonsJ. & AndoniadouE. (2007). Validity and reliability of the TGMD-2 in 7-10-year-old Flemish children with intellectual disability. Adapted Physical Activity Quarterly 25(1) 7182. PubMed doi:10.1123/apaq.25.1.71

    • Crossref
    • Search Google Scholar
    • Export Citation
  • SunS.SunH.ZhuY.HuangL. & HsiehY. (2011). Concurrent validity of preschooler gross motor quality scale with Test of Gross Motor Development-2. Research in Developmental Disabilities 32(3) 11631168. PubMed doi:10.1016/j.ridd.2011.01.007

    • Crossref
    • Search Google Scholar
    • Export Citation
  • UlrichD.A. (1985). The test of gross motor development. Austin, TX: Pro-Ed Publishers.

  • UlrichD.A. (2000). The test of gross motor development-2. Austin, TX: Pro-Ed Publishers.

  • UlrichD.A. (in press). The test of gross motor development-3. Austin, TX: Pro-Ed Publishers.

  • ValentiniN.C. (2012). Validity and reliability of the TGMD-2 for Brazilian children. Journal of Motor Behavior 44(4) 275280. PubMed doi:10.1080/00222895.2012.700967

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ValentiniN.C. & RudisillM.E. (2004). Motivational climate, motor-skill development, and perceived competence: Two studies of developmentally delayed kindergarten children. Journal of Teaching in Physical Education 23(3) 216234. doi:10.1123/jtpe.23.3.216

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WagnerM.O.WebsterE.K. & UlrichD.A. (2017). Psychometric properties of the Test of Gross Motor Development, 3rd edition (German translation): Results of a pilot study. Journal of Motor Learning and Development 5(1) 2944. doi:10.1123/jmld.2016-0006

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WebsterE.K. & UlrichD.A. (2017). Evaluation of the psychometric properties of the Test of Gross Motor Development—Third edition. Journal of Motor Learning and Development 54558. doi:10.1123/jmld.2016-0003

    • Crossref
    • Search Google Scholar
    • Export Citation
Article Metrics
All Time Past Year Past 30 Days
Abstract Views 68 68 19
Full Text Views 12 12 3
PDF Downloads 5 5 1
Altmetric Badge
PubMed
Google Scholar
Cited By