Measuring the Concurrent Validity of the Athletic Skills Track Using Expert Judgment

in Journal of Teaching in Physical Education

Click name to view affiliation

Johanna E.A. BrockenFaculty of Behavioral and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands

Search for other papers by Johanna E.A. Brocken in
Current site
Google Scholar
PubMedClose
,
John van der KampFaculty of Behavioral and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
Human Movement and Education Research Centre, Windesheim University of Applied Sciences, Zwolle, The Netherlands

Search for other papers by John van der Kamp in
Current site
Google Scholar
PubMedClose
,
Rene WormhoudtKNVB, Zeist, Utrecht, The Netherlands

Search for other papers by Rene Wormhoudt in
Current site
Google Scholar
PubMedClose
,
Matthieu L. LenoirDepartment of Movement and Sports Sciences, Ghent University, Gent, Belgium

Search for other papers by Matthieu L. Lenoir in
Current site
Google Scholar
PubMedClose
, and
Geert J.P. SavelsberghFaculty of Behavioral and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
Faculty of Sports and Nutrition, Amsterdam University of Applied Sciences, Amsterdam, The Netherlands

Search for other papers by Geert J.P. Savelsbergh in
Current site
Google Scholar
PubMedClose
*
DOI:
https://doi.org/10.1123/jtpe.2021-0209
Keywords:
motor development; motor skills; assessment tool; interrater reliability; intrarater reliability
First Published Online:
21 Apr 2022
In Print:
Ahead of Print
Page Range:
1–8
Restricted access

Purpose: The aim of this study is to measure the concurrent validity of the Athletic Skills Track (AST) by examining whether its outcome score correlates with the holistic judgments of experts about the quality of movement. Method: Video recordings of children performing the AST were shown to physical education teachers who independently gave a holistic rating of the movement quality of each child. Results: Both intra- and interrater reliability of the teachers’ ratings were moderate to good. The holistic judgments on movement quality were significantly correlated with AST time, showing that higher ratings were associated with less time required to complete the track. Next, hierarchical stepwise regression indicated that in addition to the holistic rating, also age, but not gender, explained part of the variance in AST time. Conclusion: The findings show that the AST has good concurrent validity and provides a fast, indirect indication for quality of movement.

Savelsbergh (g.j.p.savelsbergh@vu.nl) is corresponding author, https://orcid.org/0000-0001-5795-2828

  • Collapse
  • Expand

Journal of Teaching in Physical Education

Cover Journal of Teaching in Physical Education

  • Barkaoui, K. (2011). Effects of marking method and rater experience on ESL essay scores and rater performance. Assessment in Education: Principles, Policy and Practice, 18(3), 279–293. https://doi.org/10.1080/0969594X.2010.526585

    • Search Google Scholar
    • Export Citation

  • Barnett, L.M., Stodden, D.F., Cohen, K.E., Smith, J.J., Lubans, D.R., Lenoir, M., Livonen, S., Miller, A.D., Laukkanen, A., Dudley, D., Lander, N.J., Brown, H., & Morgan, P.J. (2016). Fundamental movement skills: An important focus. Journal of Teaching in Physical Education, 35(3), 219–225. https://doi.org/10.1123/jtpe.2014-0209

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Barnett, L.M., van Beurden, E., Morgan, P.J., Lincoln, D., Zask, A., & Beard, J.R. (2009). Interrater objectivity for field-based fundamental motor skill assessment. Research Quarterly for Exercise & Sport, 80(2), 363–368. https://doi.org/10.1080/02701367.2009.10599571

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Bernstein, N. (1967). The coordination and regulation of movements. Pergamon Press.

  • Bouwer, R., & Koster, M. (2016). Bringing writing research into the classroom. Universiteit Utrecht.

  • Bowerman, B.L., & O’Connell, R.T. (1990). Linear statistical models: An applied approach (2nd ed.). Duxbury.

  • Button, C., MacLeod, M., Sanders, R., & Coleman, S. (2003). Examining movement variability in the basketball free-throw action at different skill levels. Research Quarterly for Exercise & Sport, 74(3), 257–269. https://doi.org/10.1080/02701367.2003.10609090

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Cattuzzo, M.T., Santos Henrique, R., Re, A.H.N., Oliveira, I.S., Melo, B.M., Sousa Moura, M., Araujo, R.C., & Stodden, D. (2016). Motor competence and health related physical fitness in youth: A systematic review. Journal of Science and Medicine in Sport, 19(2), 123–129. https://doi.org/10.1016/j.jsams.2014.12.004

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Clark, J.E. (2007). On the problem of motor skill development. Journal of Physical Education, Recreation & Dance, 78(5), 39–44. https://doi.org/10.1080/07303084.2007.10598023

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Clark, J.E., & Metcalfe, J.S. (2002). The mountain of motor development: A metaphor. In J.E. Clark& J. Humphrey (Eds.), Motor development: Research and reviews (Vol. 2, pp. 163–190). NASPE Publications.

    • Search Google Scholar
    • Export Citation

  • Cools, W., De Martelaer, K., Samaey, C., & Andries, C. (2009). Movement skill assessment of typically developing preschool children: A review of seven movement skill assessment tools. Journal of Sports Science & Medicine, 8, 154–168. https://doi.org/10.1016/S0031-9406(05)66164-0

    • Search Google Scholar
    • Export Citation

  • Dreyfus, H.L. (2008). Spinoza Lecture I: From Socrates to artificial intelligence. In Skilled coping as higher intelligibility in Heidegger’s ‘Being and Time’ (pp. 15–30). Van Gorcum.

    • Search Google Scholar
    • Export Citation

  • Durbin, J., & Watson, G.S. (1950). Testing for serial correlation in least squares regression. Biometrika, 37(3/4), 409–428. https://doi.org/10.2307/2332391

    • Search Google Scholar
    • Export Citation

  • Field, A. (2013). Discovering statistics using IBM SPSS statistics (4th ed.). Sage Publications Ltd.

  • Fitts, P., & Posner, M.I. (1967). Human performance. Brooks/Cole.

  • Gallahue, D.L., & Ozmun, J.C. (2006). Understanding motor development: Infants, children, adolescents, adults (6th ed.). McGraw-Hill.

  • Glazier, P.S., & Lamb, P.F. (2018). Inter- and intra-individual movement variability in the golf swing. In M. Toms, S. MacKenzie, S. Robertson, M. Lochbaum, K. Kingston, & A. Fradkin (Eds.), Routledge international handbook of golf science (pp. 49–63). https://doi.org/10.4324/9781315641782-6

    • Search Google Scholar
    • Export Citation

  • Hands, B.P. (2002). How can we best measure fundamental movement skills? Paper presented at the 23rd Biennial National/International Conference.

    • Search Google Scholar
    • Export Citation

  • Hoeboer, J., De Vries, S., Krijger-Hombergen, M., Wormhoudt, R., Drent, A., Krabben, K., & Savelsbergh, G.J.P. (2016). Validity of an athletic skills track among 6- to 12-year-old children. Journal of Sports Sciences, 34(21), 2095–2105. https://doi.org/10.1080/02640414.2016.1151920

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Hoeboer, J., De Vries, S., Mast, D., & Savelsbergh, G. (2017). Children’s enjoyment of a motor skill test in physical education. Journal of Physical Education Research, 4(IV), 1–16.

    • Search Google Scholar
    • Export Citation

  • Hulteen, R.M., Barnett, L.M., True, L., Lander, N.J., del Pozo Cruz, B., & Lonsdale, C. (2020). Validity and reliability evidence for motor competence assessments in children and adolescents: A systematic review. Journal of Sports Sciences, 38(15), 1717–1798. https://doi.org/10.1080/02640414.2020.1756674

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Hulteen, R.M., True, L., & Pfeiffer, K.A. (2020). Differences in associations of product- and process-oriented motor competence assessments with physical activity in children. Journal of Sports Sciences, 38(4), 375–382. https://doi.org/10.1080/02640414.2019.1702279

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kiphard, E.J., & Schilling, F. (2007). Körperkoordinationstest für Kinder. 2. Überarbeitete und ergänzte Auflage. Beltz Test GmbH.

  • Klingberg, B., Hoeboer, J.J.A., Schranz, N., Barnett, L.M., De Vries, S.I., & Ferrar, K. (2019). Validity and feasibility of an obstacle course to assess fundamental movement skills in a pre-school setting. Journal of Sports Sciences, 37(13), 1534–1542. https://doi.org/10.1080/02640414.2019.1575326

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Koffka, K. (1935). Principles of Gestalt psychology. Brace.

  • Koo, T.K., & Li, M.Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kroes, M., Vissers, Y.L.J., Sleijpen, F.A.M., Feron, F.J.M., Kessels, A.G.H., Bakker, E., Kalff, A.C., Hendriksen, J.G.M., Troost, J., Jolles, J., & Vles, J.S.H. (2004). Reliability and validity of a qualitative and quantitative motor test for 5- to 6-year-old children. European Journal of Paediatric Neurology, 8(3), 135–143. https://doi.org/10.1016/j.ejpn.2004.01.007

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Landers, R. (2015). Computing Intraclass Correlations (ICC) as estimates of interrater reliability in SPSS. Winnower, 2, 1–4. https://doi.org/10.15200/winn.143518.81744

    • Search Google Scholar
    • Export Citation

  • Lenoir, M. & Vandorpe, B. (2013). DeKörperkoordinationstest für Kinder: KTK-NL Volledig herwerkte en vertaalde versie, met nieuwe normen voor Vlaanderen/Nederland. Signaal, 4–17.

    • Search Google Scholar
    • Export Citation

  • Logan, S.W., Barnett, L.M., Goodway, J.D., & Stodden, D.F. (2017). Comparison of performance on process- and product-oriented assessments of fundamental motor skills across childhood. Journal of Sports Sciences, 35(7), 634–641. https://doi.org/10.1080/02640414.2016.1183803

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Mokkink, L.B., Terwee, C.B., Patrick, D.L., Alonso, J., Stratford, P.W., Knol, D.L., Bouter, L.M., de Vet, H.C.W.W., Prinsen, C.A.C., Mokkink, L.B., & de Vet, H.C.W.W. (2014). The COSMIN checklist for evaluating the methodological quality of studies on measurement properties. Quality of Life Research, 63(7), 32. https://doi.org/10.1016/j.jclinepi.2010.02.006

    • Search Google Scholar
    • Export Citation

  • Myers, R. (1990). Classical and modern regression with applications (2nd ed.). Duxbury.

  • Perinetti, G. (2018). StaTips Part IV: Selection, interpretation and reporting of the intraclass correlation coefficient. South European Journal of Orthodontics and Dentofacial Research, 4(1), 3–4. https://doi.org/10.5937/sejodr4-1283

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Reijgersberg, N., Werff, H., & Lucassen, J. (2013). Nulmeting bewegingsonderwijs. Mulier Instituut. https://www.kennisbanksportenbewegen.nl/?file=2750&m=1422883218&action=file.download

    • Search Google Scholar
    • Export Citation

  • Robinson, L.E., Stodden, D.F., Barnett, L.M., Lopes, V.P., Logan, S.W., Rodrigues, L.P., & D’Hondt, E. (2015). Motor competence and its effect on positive developmental trajectories of health. Sports Medicine, 45(9), 1273–1284. https://doi.org/10.1007/s40279-015-0351-6

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Schöllhorn, W.I., & Bauer, H.U. (1998). Identifying individual movement styles in high performance sports by means of self-organizing Kohonen maps. 16 International Symposium on Biomechanics in Sports, 9, 574–577.

    • Search Google Scholar
    • Export Citation

  • Schorer, J., Baker, J., Fath, F., & Jaitner, T. (2007). Identification of interindividual and intraindividual movement patterns in handball players of varying expertise levels. Journal of Motor Behavior, 39(5), 409–421. https://doi.org/10.3200/JMBR.39.5.409-422

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Stodden, D.F., Goodway, J.D., Langendorfer, S.J., Roberton, M.A., Rudisill, M.E., Garcia, C., & Garcia, L.E. (2008). A developmental perspective on the role of motor skill competence in physical activity: An emergent relationship. Quest, 60(2), 290–306. https://doi.org/10.1080/00336297.2008.10483582

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Tidén, A., Lundqvist, C., & Nyberg, M. (2015). Development and initial validation of the NyTid test: A movement assessment tool for compulsory school pupils. Measurement in Physical Education and Exercise Science, 19(1), 34–43. https://doi.org/10.1080/1091367X.2014.975228

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Ulrich, D.A. (2013). The test of gross motor development-3 (TGMD-3): Administration, scoring, & international norms. Hacettepe Journal of Sport Sciences, 24(2), 27–33.

    • Search Google Scholar
    • Export Citation

  • Wattie, N., Schorer, J., & Baker, J. (2015). The relative age effect in sport: A developmental systems model. Sports Medicine, 45(1), 83–94. https://doi.org/10.1007/s40279-014-0248-9

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Wilson, C., Simpson, S.E., van Emmerik, R.E.A., & Hamill, J. (2008). Coordination variability and skill development in expert triple jumpers. Sports Biomechanics, 7(1), 2–9. https://doi.org/10.1080/14763140701682983

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 938 895 98
Full Text Views 15 14 1
PDF Downloads 14 13 1