Development and Validation of a Monitoring Instrument for Sport Psychology Practice: The Sport Psychology Outcomes and Research Tool (SPORT)

in Journal of Clinical Sport Psychology
Restricted access

Purchase article

USD $24.95

Student 1 year subscription

USD $58.00

1 year subscription

USD $77.00

Student 2 year subscription

USD $110.00

2 year subscription

USD $144.00

Evidence for the mechanisms of change by which sport psychology interventions enhance performance is limited and treatment monitoring and outcomes measures would assist in establishing evidence-based practices. The present paper fills a gap in sport psychology literature by demonstrating the development and validation of a new measure (Sport Psychology Outcomes and Research Tool; SPORT). Study 1 described test construction and pilot item selection with 73 collegiate student-athletes. Twenty-three pilot items contributed unique variance while maintaining the original constructs and were selected from 80 initial items. In Study 2, exploratory and confirmatory factor analyses were conducted with collegiate student-athletes (n = 220), revealing a 17-item, four-factor model measuring Athlete Wellbeing, Self-Regulation, Performance Satisfaction, and Sport-Related Distress. Concurrent validity was supported through correlational analyses. Overall, results supported the SPORT as a new transtheoretical tool for monitoring effectiveness and outcomes of sport psychology interventions.

Hansen, Lace, Montgomery, and Ross are with the Department of Psychology, Saint Louis University, St. Louis, MO. Perry is with the Orthopedic Service Line, Novant Health, Charlotte, NC. Merz is with the Department of Physical Medicine & Rehabilitation, University of North Carolina at Chapel Hill, Chapel Hill, NC.

Hansen (Ashley.hansen@slu.edu) is corresponding author.
Journal of Clinical Sport Psychology
Article Sections
References
  • AndersonE.M. & LambertM.J. (2001). A survival analysis of clinically significant change in outpatient psychotherapy. Journal of Clinical Psychology 57875888. PubMed ID: 11406801 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BecksteadD.J.HatchA.L.LambertM.J.EggettD.L.GoatesM.K. & VermeerschD.A. (2003). Clinical significance of the outcome questionnaire (OQ-45.2). The Behavior Analyst Today 4(1) 8697. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BirrerD. & MorganG. (2010). Psychological skills training as a way to enhance an athlete’s performance in high-intensity sports. Scandinavian Journal of Medicine & Science in Sports 20(s2) 7887. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BirrerD.RothlinP. & MorganG. (2012). Mindfulness to enhance athletic performance: Theoretical considerations and possible impact mechanisms. Mindfulness 3(3) 235246. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BrownD. & FletcherD. (2017). Effects of psychological and psychosocial interventions on sport performance: A meta-analysis. Sports Medicine 47(1) 7799. PubMed ID: 27241124 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • BuschA.M.WagenerT.L.GregorK.L.RingK.T. & BorrelliB. (2011). Utilizing reliable and clinically significant change criteria to assess for the development of depression during smoking cessation treatment: The importance of tracking idiographic change. Addictive Behaviors 36(12) 12281232. PubMed ID: 21872401 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • CarronA.V.BrayS.R. & EysM.A. (2002). Team cohesion and team success in sport. Journal of Sports Sciences 20(2) 119126. PubMed ID: 11811568 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • CheungG.W. & RensvoldR.B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal 9(2) 233255. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ClarkL.A. & WatsonD. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment 7(3) 309319. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • CostelloA.B. & OsborneJ.W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment Research & Evaluation 10(7) 19.

    • Search Google Scholar
    • Export Citation
  • CrockerL. & AlginaJ. (2006). Introduction to classical and modern test theory. Belmont, CA: Wadsworth Publishing Company.

  • CrowneD.P. & MarloweD. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology 24(4) 349. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • De WittD.J. (1980). Cognitive and biofeedback training for stress reduction with university athletes. Journal of Sport Psychology 2(4) 288294. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DowneyR.G. & KingC. (1998). Missing data in Likert ratings: A comparison of replacement methods. Journal of General Psychology 125(2) 175191. PubMed ID: 9935342 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • DziubanC.D. & ShirkeyE.C. (1974). When is a correlation matrix appropriate for factor analysis? Some decision rules. Psychological Bulletin 81(6) 358361. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • EvansC.MargisonF. & BarkhamM. (1998). The contribution of reliable and clinically significant change methods to evidence-based mental health. Evidence-Based Mental Health 1(3) 7072. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • FranklinS.B.GibsonD.J.RobertsonP.A.PohlmannJ.T. & FralishJ.S. (1995). Parallel analysis: A method for determining significant principal components. Journal of Vegetation Science 6(1) 99106. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • GardnerF.L. & MooreZ.E. (2006). Clinical sport psychology. Champaign, IL: Human Kinetics.

  • GardnerF.L. & MooreZ.E. (2007). The psychology of enhancing human performance: The mindfulness-acceptance-commitment (MAC) approach. New York, NY: Springer.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • GardnerF.L. & MooreZ.E. (2012). Mindfulness and acceptance models in sport psychology: A decade of basic and applied scientific advancements. Canadian Psychology/Psychologie Canadienne 53(4) 309318. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • GardnerF.L. & MooreZ.E. (2017). Mindfulness-based and acceptance-based interventions in sport and performance contexts. Current Opinion Psychology 16180184. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HaaseA.M. & PrapavessisH. (2004). Assessing the factor structure and composition of the positive and negative perfectionism scale in sport. Personality and Individual Differences 36(7) 17251740. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HairJ.BlackW.BabinB.AndersonR. & TathamR. (2006). Multivariate data analysis (6th ed.). Upper Saddle River, NJ: Pearson Educational, Inc.

    • Search Google Scholar
    • Export Citation
  • HaninY.L. (2010). Coping with anxiety in sport. In A. R. Nicholls (Ed.) Coping in sport: Theory methods and related constructs (pp. 159175). Hauppauge, NY: Nova Science Publishers.

    • Search Google Scholar
    • Export Citation
  • HardyL.JonesJ.G. & GouldD. (1996). Understanding psychological preparation for sport: Theory and practice of elite performers. Hoboken, NJ: John Wiley & Sons Inc.

    • Search Google Scholar
    • Export Citation
  • HatzigeorgiadisA.ZourbanosN.GalanisE. & TheodorakisY. (2011). Self-talk and sports performance: A meta-analysis. Perspectives on Psychological Science: A Journal of the Association for Psychological Science 6(4) 348356. PubMed ID: 26167788 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HooperD.CoughlanJ. & MullenM. (2008). Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods 65360.

    • Search Google Scholar
    • Export Citation
  • HowardK.I.KoptaS.M.KrauseM.S. & OrlinskyD.E. (1986). The dose– effect relationship in psychotherapy [Review]. American Psychologist 41159164. PubMed ID: 3516036 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HowardW.L. & ReardonJ.P. (1986). Changes in the self concept and athletic performance of weight lifters through a cognitive-hypnotic approach: An empirical study. American Journal of Clinical Hypnosis 28(4) 248257. PubMed ID: 3717057 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • HuL.T. & BentlerP.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal 6(1) 155. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • IzquierdoI.OleaJ. & AbadF.J. (2014). Exploratory factor analysis in validation studies: Uses and recommendations. Psicothema 26(3) 395400. PubMed ID: 25069561 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • JohanssonP. & HøglendP. (2007). Identifying mechanisms of change in psychotherapy: Mediators of treatment outcome. Clinical Psychology & Psychotherapy 14(1) 19. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • JohnS.VermaS.K. & GulshanK. (2011). The effect of mindfulness meditation on HPA axis in reducing pre competition stress to improve performance of elite shooters. National Journal of Integrated Research in Medicine 21521.

    • Search Google Scholar
    • Export Citation
  • JohnsonL.D. & ShahaS. (1996). Improving quality in psychotherapy. Psychotherapy: Theory Research Practice Training33(2) 225236. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kabat-ZinnJ. (2005). Bringing mindfulness to medicine: An interview with Jon Kabat-Zinn, PhD. Interview by Karolyn Gazella. Advances in Mind-Body Medicine 21(2) 2227. PubMed ID: 16170903

    • Search Google Scholar
    • Export Citation
  • KaufmanK.A.GlassC.R. & ArnkoffD.B. (2009). Evaluation of Mindful Sport Performance Enhancement (MSPE): A new approach to promote flow in athletes. Journal of Clinical Sport Psychology 3(4) 334356. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KoptaS.M. (2003). The dose-effect relationship in psychotherapy: A defining achievement for Dr. Kenneth Howard. Journal of Clinical Psychology 59(7) 727733. PubMed ID: 12808579 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • KylloL. & LandersD. (1995). Goal setting in sport and exercise: A research synthesis to resolve the controversy. Journal of Sport & Exercise Psychology 17(2) 117137. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MacCallumR.C.BrowneM.W. & SugawaraH.M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods 1(2) 130149. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MacFarlaneI.M.HenryC.L.NashT.KisselS. & BushD. (2015). Clinical Utility of the CCAPS, CAS, and OQ-45. Journal of College Student Psychotherapy 29(1) 1128. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MalingM.S.GurtmanM.B. & HowardK.I. (1995). The response of interpersonal problems to varying doses of psychotherapy. Psychotherapy Research 56375. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MoghadamM.S.SayadiE.SamimifarM.MoharerA. (2013). Impact assessment of mindfulness techniques education on anxiety and sports performance in Badminton players Isfahan. International Research Journal of Applied and Basic Sciences 4(5) 11701175.

    • Search Google Scholar
    • Export Citation
  • MooreZ.E. & BonaguraK. (2017). Current opinion in clinical sport psychology: From athletic performance to psychological well-being. Current Opinion in Psychology 16176179. PubMed ID: 28813346 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • MummeryK. (2005). Essay: Depression in sport. The Lancet 366S36S37. doi:

  • NtoumanisN. & VazouS. (2005). Peer motivational climate in youth sport: Measurement development and validation. Journal of Sport and Exercise Psychology 27(4) 432455. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • RaubenheimerJ. (2004). An item selection procedure to maximize scale reliability and validity. SA Journal of Industrial Psychology 30(4) 5964. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • RiemerH.A. & ChelladuraiP. (1998). Development of the athlete satisfaction questionnaire (ASQ). Journal of Sport and Exercise Psychology 20(2) 127156.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • RöthlinP.BirrerD.HorvathS. & Grosse HoltforthM. (2016). Psychological skills training and a mindfulness-based intervention to enhance functional athletic performance: Design of a randomized controlled trial using ambulatory assessment. BMC Psychology 4(1) 39. PubMed ID: 27457721 doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • RöthlinP.HorvathS.BirrerD. & Grosse HoltforthM. (2016). Mindfulness promotes the ability to deliver performance in highly demanding situations. Mindfulness 7(3) 727733. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • SchreiberJ.B.NoraA.StageF.K.BarlowE.A. & KingJ. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research 99(6) 323338. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • SteigerJ.H. (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences 42 (5) 893898. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ThelwellR. & MaynardI. (2003). The effects of a mental skills package on ‘repeatable good performance’ in cricketers. Psychology of Sport & Exercise 4(4) 377. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • VealeyR.S. (2007). Mental skills training in sport. In G. TenenbaumR.C. EklundG. Tenenbaum & R.C. Eklund (Eds.) Handbook of sport psychology (pp. 287309). Hoboken, NJ: John Wiley & Sons Inc.

    • Search Google Scholar
    • Export Citation
  • WeissM.R. & FriedrichsW.D. (1986). The influence of leader behaviors, coach attributes, and institutional variables on performance and satisfaction of collegiate basketball teams. Journal of Sport Psychology 8(4) 332346. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • WorthingtonR.L. & WhittakerT.A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist 34(6) 806838. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • YongA.G. & PearceS. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology 9(2) 7994. doi:

    • Crossref
    • Search Google Scholar
    • Export Citation
  • ZakrajsekR. & BlantonJ. (2017). Evaluation of psychological interventions in sport and exercise settings. Oxford Research Encyclopedia of Psychology. Retrieved from https://perma.cc/44EC-7HWZ

    • Crossref
    • Search Google Scholar
    • Export Citation
Article Metrics
All Time Past Year Past 30 Days
Abstract Views 37 37 15
Full Text Views 4 4 1
PDF Downloads 5 5 1
Altmetric Badge
PubMed
Google Scholar