Interrater Reliability of the New Sport-Specific Evidence-Based Classification System for Para Va'a

in Adapted Physical Activity Quarterly

Click name to view affiliation

Johanna S. RosénThe Swedish School of Sport and Health Sciences (GIH)

Search for other papers by Johanna S. Rosén in
Current site
Google Scholar
PubMedClose
*
,
Victoria L. Goosey-TolfreyLoughborough University

Search for other papers by Victoria L. Goosey-Tolfrey in
Current site
Google Scholar
PubMedClose
*
,
Keith TolfreyLoughborough University

Search for other papers by Keith Tolfrey in
Current site
Google Scholar
PubMedClose
*
,
Anton ArndtThe Swedish School of Sport and Health Sciences (GIH)
Karolinska Institute

Search for other papers by Anton Arndt in
Current site
Google Scholar
PubMedClose
*
, and
Anna BjerkeforsThe Swedish School of Sport and Health Sciences (GIH)
Karolinska Institute

Search for other papers by Anna Bjerkefors in
Current site
Google Scholar
PubMedClose
*
DOI:
https://doi.org/10.1123/apaq.2019-0141
Keywords:
impairment; outrigger; paddling; paracanoe; Paralympics
First Published Online:
06 Mar 2020
In Print:
Volume 37: Issue 3
Page Range:
241–252
Restricted access

The purpose of this study was to examine the interrater reliability of a new evidence-based classification system for Para Va'a. Twelve Para Va'a athletes were classified by three classifier teams each consisting of a medical and a technical classifier. Interrater reliability was assessed by calculating intraclass correlation for the overall class allocation and total scores of trunk, leg, and on-water test batteries and by calculating Fleiss’s kappa and percentage of total agreement in the individual tests of each test battery. All classifier teams agreed with the overall class allocation of all athletes, and all three test batteries exhibited excellent interrater reliability. At a test level, agreement between classifiers was almost perfect in 14 tests, substantial in four tests, moderate in four tests, and fair in one test. The results suggest that a Para Va'a athlete can expect to be allocated to the same class regardless of which classifier team conducts the classification.

Rosén, Arndt, and Bjerkefors are with the Swedish School of Sport and Health Sciences (GIH), Stockholm, Sweden. Goosey-Tolfrey and Tolfrey are with the Peter Harrison Centre for Disability Sport, School of Sport, Exercise and Health Sciences, Loughborough University, Loughborough, United Kingdom. Arndt is also with the Dept. of Clinical Science, Intervention and Technology (CLINTEC), and Bjerkefors, the Dept. of Neuroscience, Karolinska Inst., Stockholm, Sweden.

Rosén (johanna.rosen@gih.se) is corresponding author.

Supplementary Materials

    • Supplementary Material 1 (PDF 747 KB)
    • Supplementary Material 2 (PDF 1 MB)
    • Supplementary Material 3 (PDF 1 MB)
  • Collapse
  • Expand

Adapted Physical Activity Quarterly

Cover Adapted Physical Activity Quarterly

  • Altmann, V.C., Groen, B.E., van Limbeek, J., Vanlandewijck, Y.C., & Keijsers, N.L. (2013). Reliability of the revised wheelchair rugby trunk impairment classification system. Spinal Cord, 51(12), 913–918. PubMed ID: 24042992 doi:10.1038/sc.2013.109

    • Search Google Scholar
    • Export Citation

  • Beckman, E.M., Connick, M.J., & Tweedy, S.M. (2017). Assessing muscle strength for the purpose of classification in Paralympic sport: A review and recommendations. Journal of Science and Medicine in Sport, 20(4), 391–396. PubMed ID: 27692576 doi:10.1016/j.jsams.2016.08.010

    • Search Google Scholar
    • Export Citation

  • Bjerkefors, A., Carpenter, M.G., Cresswell, A.G., & Thorstensson, A. (2009). Trunk muscle activation in a person with clinically complete thoracic spinal cord injury. Journal of Rehabilitation Medicine, 41(5), 390–392. PubMed ID: 19363574 doi:10.2340/16501977-0336

    • Search Google Scholar
    • Export Citation

  • Cicchetti, D.V. (1994). Guidelines, criteria and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. doi:10.1037/1040-3590.6.4.284

    • Search Google Scholar
    • Export Citation

  • Connick, M.J., Beckman, E.M., Deuble, R., & Tweedy, S.M. (2016). Developing tests of impaired coordination for Paralympic classification: Normative values and test-retest reliability. Sports Engineering, 19(3), 147–154. doi:10.1007/s12283-016-0199-5

    • Search Google Scholar
    • Export Citation

  • Escolar, D.M., Henricson, E.K., Mayhew, J., Florence, J., Leshner, R., Patel, K.M., & Clemens, P.R. (2001). Clinical evaluator reliability for quantitative and manual muscle testing measures of strength in children. Muscle Nerve, 24(6), 787–793. PubMed ID: 11360262 doi:10.1002/mus.1070

    • Search Google Scholar
    • Export Citation

  • Feinstein, A.R., & Cicchetti, D.V. (1990). High agreement but low kappa: I. The problems of two paradoxes. Journal of Clinical Epidemiology, 43(6), 543–549. PubMed ID: 2348207 doi:10.1016/0895-4356(90)90158-L

    • Search Google Scholar
    • Export Citation

  • Hislop, H.J., & Montgomery, J. (1995). Daniels and Worthingham’s muscle testing—Techniques of manual examination (6th ed.). Philadelphia, PA: W.B. Saunders Co.

    • Search Google Scholar
    • Export Citation

  • Landis, J.R., & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. PubMed ID: 843571 doi:10.2307/2529310

    • Search Google Scholar
    • Export Citation

  • Pernot, H.F.M., Lannem, A.M., Geers, R.P.J., Ruijters, E.F.G., Bloemendal, M., & Seelen, H.A.M. (2011). Validity of the test–table–test for Nordic skiing for classification of Paralympic sit-ski sports participants. Spinal Cord, 49(8), 935–941. PubMed ID: 21537336 doi:10.1038/sc.2011.30

    • Search Google Scholar
    • Export Citation

  • Potten, Y.J., Seelen, H.A., Drukker, J., Reulen, J.P., & Drost, M.R. (1999). Postural muscle responses in the spinal cord injured persons during forward reaching. Ergonomics, 42(9), 1200–1215. PubMed ID: 10503054 doi:10.1080/001401399185081

    • Search Google Scholar
    • Export Citation

  • Rosén, J.S., Arndt, A., Goosey-Tolfrey, V.L., Mason, B.S., Hutchinson, M.J., Tarassova, O., & Bjerkefors, A. (2019). The impact of impairment on kinematic and kinetic variables in Va'a paddling: Towards a sport-specific evidence-based classification system for Para Va'a. Journal of Sports Sciences, 37(17), 1942–1950. doi:10.1080/02640414.2019.1606763

    • Search Google Scholar
    • Export Citation

  • Seelen, H.A., Potten, Y.J., Drukker, J., Reulen, J.P., & Pons, C. (1998). Development of new muscle synergies in postural control in spinal cord injured subjects. Journal of Electromyography and Kinesiology, 8(1), 23–34. PubMed ID: 9667031 doi:10.1016/S1050-6411(97)00002-3

    • Search Google Scholar
    • Export Citation

  • Tweedy, S.M., Beckman, E.M., & Connick, M.J. (2014). Paralympic classification: Conceptual basis, current methods and research update. PM&R: The Journal of Injury, Function, and Rehabilitation, 6(Suppl. 8), S11–S17. doi:10.1016/j.pmrj.2014.04.013

    • Search Google Scholar
    • Export Citation

  • Tweedy, S.M., Connick, M.J., & Beckman, E.M. (2018). Applying scientific principles to enhance Paralympic classification now and in the future: A research primer for rehabilitation specialists. Physical Medicine and Rehabilitation Clinics of North America, 29(2), 313–332. PubMed ID: 29627091 doi:10.1016/j.pmr.2018.01.010

    • Search Google Scholar
    • Export Citation

  • Tweedy, S.M., & Vanlandewijck, Y.C. (2011). International Paralympic Committee position stand-background and scientific principles of classification in Paralympic sport. British Journal of Sports Medicine, 45(4), 259–269. PubMed ID: 19850575 doi:10.1136/bjsm.2009.065060

    • Search Google Scholar
    • Export Citation

  • Tweedy, S.M., Williams, G., & Bourke, J. (2010). Selecting and modifying methods of manual muscle testing for classification in Paralympic sport. European Journal of Adapted Physical Activity, 3(2), 7–16. doi:10.5507/euj.2010.005

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 2801 880 6
Full Text Views 79 10 1
PDF Downloads 55 9 1