Development and Validation of a Monitoring Instrument for Sport Psychology Practice: The Sport Psychology Outcomes and Research Tool (SPORT)

in Journal of Clinical Sport Psychology

Click name to view affiliation

Ashley A. Hansen Saint Louis University

Search for other papers by Ashley A. Hansen in
Current site
Google Scholar
PubMed Close
*
,
Joanne E. Perry Novant Health

Search for other papers by Joanne E. Perry in
Current site
Google Scholar
PubMed Close
*
,
John W. Lace Saint Louis University

Search for other papers by John W. Lace in
Current site
Google Scholar
PubMed Close
*
,
Zachary C. Merz University of North Carolina at Chapel Hill

Search for other papers by Zachary C. Merz in
Current site
Google Scholar
PubMed Close
*
,
Taylor L. Montgomery Saint Louis University

Search for other papers by Taylor L. Montgomery in
Current site
Google Scholar
PubMed Close
*
, and
Michael J. Ross Saint Louis University

Search for other papers by Michael J. Ross in
Current site
Google Scholar
PubMed Close
*
DOI:
https://doi.org/10.1123/jcsp.2018-0063
Keywords:
measure validation; mindfulness; mindfulness-based intervention; psychological skills training; sport psychology consultation
In Print:
Volume 13: Issue 4
Page Range:
543–560
Restricted access

Evidence for the mechanisms of change by which sport psychology interventions enhance performance is limited and treatment monitoring and outcomes measures would assist in establishing evidence-based practices. The present paper fills a gap in sport psychology literature by demonstrating the development and validation of a new measure (Sport Psychology Outcomes and Research Tool; SPORT). Study 1 described test construction and pilot item selection with 73 collegiate student-athletes. Twenty-three pilot items contributed unique variance while maintaining the original constructs and were selected from 80 initial items. In Study 2, exploratory and confirmatory factor analyses were conducted with collegiate student-athletes (n = 220), revealing a 17-item, four-factor model measuring Athlete Wellbeing, Self-Regulation, Performance Satisfaction, and Sport-Related Distress. Concurrent validity was supported through correlational analyses. Overall, results supported the SPORT as a new transtheoretical tool for monitoring effectiveness and outcomes of sport psychology interventions.

Hansen, Lace, Montgomery, and Ross are with the Department of Psychology, Saint Louis University, St. Louis, MO. Perry is with the Orthopedic Service Line, Novant Health, Charlotte, NC. Merz is with the Department of Physical Medicine & Rehabilitation, University of North Carolina at Chapel Hill, Chapel Hill, NC.

Hansen (Ashley.hansen@slu.edu) is corresponding author.
  • Collapse
  • Expand

Journal of Clinical Sport Psychology

Cover Journal of Clinical Sport Psychology

  • Anderson, E.M., & Lambert, M.J. (2001). A survival analysis of clinically significant change in outpatient psychotherapy. Journal of Clinical Psychology, 57 ,875–888. PubMed ID: 11406801 doi:10.1002/jclp.1056

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Beckstead, D.J., Hatch, A.L., Lambert, M.J., Eggett, D.L., Goates, M.K., & Vermeersch, D.A. (2003). Clinical significance of the outcome questionnaire (OQ-45.2). The Behavior Analyst Today, 4(1), 86–97. doi:10.1037/h0100015

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Birrer, D., & Morgan, G. (2010). Psychological skills training as a way to enhance an athlete’s performance in high-intensity sports. Scandinavian Journal of Medicine & Science in Sports, 20(s2), 78–87. doi:10.1111/j.1600-0838.2010.01188.x

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Birrer, D., Rothlin, P., & Morgan, G. (2012). Mindfulness to enhance athletic performance: Theoretical considerations and possible impact mechanisms. Mindfulness, 3(3), 235–246. doi:10.1007/s12671-012-0109-2

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Brown, D., & Fletcher, D. (2017). Effects of psychological and psychosocial interventions on sport performance: A meta-analysis. Sports Medicine, 47(1), 77–99. PubMed ID: 27241124 doi:10.1007/s40279-016-0552-7

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Busch, A.M., Wagener, T.L., Gregor, K.L., Ring, K.T., & Borrelli, B. (2011). Utilizing reliable and clinically significant change criteria to assess for the development of depression during smoking cessation treatment: The importance of tracking idiographic change. Addictive Behaviors, 36(12), 1228–1232. PubMed ID: 21872401 doi:10.1016/j.addbeh.2011.07.031

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Carron, A.V., Bray, S.R., & Eys, M.A. (2002). Team cohesion and team success in sport. Journal of Sports Sciences, 20(2), 119–126. PubMed ID: 11811568 doi:10.1080/026404102317200828

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Cheung, G.W., & Rensvold, R.B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. doi:10.1207/s15328007sem0902_5

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Clark, L.A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. doi:10.1037/1040-3590.7.3.309

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Costello, A.B., & Osborne, J.W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1–9.

    • Search Google Scholar
    • Export Citation

  • Crocker, L., & Algina, J. (2006). Introduction to classical and modern test theory. Belmont, CA: Wadsworth Publishing Company.

  • Crowne, D.P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24(4), 349. doi:10.1037/h0047358

    • Crossref
    • Search Google Scholar
    • Export Citation

  • De Witt, D.J. (1980). Cognitive and biofeedback training for stress reduction with university athletes. Journal of Sport Psychology, 2(4), 288–294. doi:10.1123/jsp.2.4.288

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Downey, R.G., & King, C. (1998). Missing data in Likert ratings: A comparison of replacement methods. Journal of General Psychology, 125(2), 175–191. PubMed ID: 9935342 doi:10.1080/00221309809595542

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Dziuban, C.D., & Shirkey, E.C. (1974). When is a correlation matrix appropriate for factor analysis? Some decision rules. Psychological Bulletin, 81(6), 358–361. doi:10.1037/h0036316

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Evans, C., Margison, F., & Barkham, M. (1998). The contribution of reliable and clinically significant change methods to evidence-based mental health. Evidence-Based Mental Health, 1(3), 70–72. doi:10.1136/ebmh.1.3.70

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Franklin, S.B., Gibson, D.J., Robertson, P.A., Pohlmann, J.T., & Fralish, J.S. (1995). Parallel analysis: A method for determining significant principal components. Journal of Vegetation Science, 6(1), 99–106. doi:10.2307/3236261

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Gardner, F.L., & Moore, Z.E. (2006). Clinical sport psychology. Champaign, IL: Human Kinetics.

  • Gardner, F.L., & Moore, Z.E. (2007). The psychology of enhancing human performance: The mindfulness-acceptance-commitment (MAC) approach. New York, NY: Springer.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Gardner, F.L., & Moore, Z.E. (2012). Mindfulness and acceptance models in sport psychology: A decade of basic and applied scientific advancements. Canadian Psychology/Psychologie Canadienne, 53(4), 309–318. doi:10.1037/a0030220

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Gardner, F.L., & Moore, Z.E. (2017). Mindfulness-based and acceptance-based interventions in sport and performance contexts. Current Opinion Psychology, 16 ,180–184. doi:10.1016/j.copsyc.2017.06.001

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Haase, A.M., & Prapavessis, H. (2004). Assessing the factor structure and composition of the positive and negative perfectionism scale in sport. Personality and Individual Differences, 36(7), 1725–1740. doi:10.1016/j.paid.2003.07.013

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Hair, J., Black, W., Babin, B., Anderson, R., & Tatham, R. (2006). Multivariate data analysis (6th ed.). Upper Saddle River, NJ: Pearson Educational, Inc.

    • Search Google Scholar
    • Export Citation

  • Hanin, Y.L. (2010). Coping with anxiety in sport. In A. R. Nicholls (Ed.) Coping in sport: Theory, methods and related constructs (pp. 159–175). Hauppauge, NY: Nova Science Publishers.

    • Search Google Scholar
    • Export Citation

  • Hardy, L., Jones, J.G., & Gould, D. (1996). Understanding psychological preparation for sport: Theory and practice of elite performers. Hoboken, NJ: John Wiley & Sons Inc.

    • Search Google Scholar
    • Export Citation

  • Hatzigeorgiadis, A., Zourbanos, N., Galanis, E., & Theodorakis, Y. (2011). Self-talk and sports performance: A meta-analysis. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 6(4), 348–356. PubMed ID: 26167788 doi:10.1177/1745691611413136

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Hooper, D., Coughlan, J., & Mullen, M. (2008). Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6 ,53–60.

    • Search Google Scholar
    • Export Citation

  • Howard, K.I., Kopta, S.M., Krause, M.S., & Orlinsky, D.E. (1986). The dose– effect relationship in psychotherapy [Review]. American Psychologist, 41 ,159–164. PubMed ID: 3516036 doi:10.1037/0003-066X.41.2.159

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Howard, W.L., & Reardon, J.P. (1986). Changes in the self concept and athletic performance of weight lifters through a cognitive-hypnotic approach: An empirical study. American Journal of Clinical Hypnosis, 28(4), 248–257. PubMed ID: 3717057 doi:10.1080/00029157.1986.10402661

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Hu, L.T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. doi:10.1080/10705519909540118

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Izquierdo, I., Olea, J., & Abad, F.J. (2014). Exploratory factor analysis in validation studies: Uses and recommendations. Psicothema, 26(3), 395–400. PubMed ID: 25069561 doi:10.7334/psicothema2013.349

    • Search Google Scholar
    • Export Citation

  • Johansson, P., & Høglend, P. (2007). Identifying mechanisms of change in psychotherapy: Mediators of treatment outcome. Clinical Psychology & Psychotherapy, 14(1), 1–9. doi:10.1002/cpp.514

    • Crossref
    • Search Google Scholar
    • Export Citation

  • John, S., Verma, S.K., & Gulshan, K. (2011). The effect of mindfulness meditation on HPA axis in reducing pre competition stress to improve performance of elite shooters. National Journal of Integrated Research in Medicine, 2 ,15–21.

    • Search Google Scholar
    • Export Citation

  • Johnson, L.D., & Shaha, S. (1996). Improving quality in psychotherapy. Psychotherapy: Theory, Research, Practice, Training, 33(2), 225–236. doi:10.1037/0033-3204.33.2225

    • Search Google Scholar
    • Export Citation

  • Kabat-Zinn, J. (2005). Bringing mindfulness to medicine: An interview with Jon Kabat-Zinn, PhD. Interview by Karolyn Gazella. Advances in Mind-Body Medicine, 21(2), 22–27. PubMed ID: 16170903

    • Search Google Scholar
    • Export Citation

  • Kaufman, K.A., Glass, C.R., & Arnkoff, D.B. (2009). Evaluation of Mindful Sport Performance Enhancement (MSPE): A new approach to promote flow in athletes. Journal of Clinical Sport Psychology, 3(4), 334–356. doi:10.1123/jcsp.3.4.334

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kopta, S.M. (2003). The dose-effect relationship in psychotherapy: A defining achievement for Dr. Kenneth Howard. Journal of Clinical Psychology, 59(7), 727–733. PubMed ID: 12808579 doi:10.1002/jclp.10167

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kyllo, L., & Landers, D. (1995). Goal setting in sport and exercise: A research synthesis to resolve the controversy. Journal of Sport & Exercise Psychology, 17(2), 117–137. doi:10.1123/jsep.17.2.117

    • Crossref
    • Search Google Scholar
    • Export Citation

  • MacCallum, R.C., Browne, M.W., & Sugawara, H.M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. doi:10.1037/1082-989X.1.2.130

    • Crossref
    • Search Google Scholar
    • Export Citation

  • MacFarlane, I.M., Henry, C.L., Nash, T., Kissel, S., & Bush, D. (2015). Clinical Utility of the CCAPS, CAS, and OQ-45. Journal of College Student Psychotherapy, 29(1), 11–28. doi:10.1080/87568225.2015.973821

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Maling, M.S., Gurtman, M.B., & Howard, K.I. (1995). The response of interpersonal problems to varying doses of psychotherapy. Psychotherapy Research, 5 ,63–75. doi:10.1080/10503309512331331146

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Moghadam, M.S., Sayadi, E., Samimifar, M., Moharer, A. (2013). Impact assessment of mindfulness techniques education on anxiety and sports performance in Badminton players Isfahan. International Research Journal of Applied and Basic Sciences, 4(5), 1170–1175.

    • Search Google Scholar
    • Export Citation

  • Moore, Z.E., & Bonagura, K. (2017). Current opinion in clinical sport psychology: From athletic performance to psychological well-being. Current Opinion in Psychology, 16 ,176–179. PubMed ID: 28813346 doi:10.1016/j.copsyc.2017.05.016

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Mummery, K. (2005). Essay: Depression in sport. The Lancet, 366 ,S36–S37. doi:10.1016/s0140-6736(05)67840-3

  • Ntoumanis, N., & Vazou, S. (2005). Peer motivational climate in youth sport: Measurement development and validation. Journal of Sport and Exercise Psychology, 27(4), 432–455. doi:10.1123/jsep.27.4.432

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Raubenheimer, J. (2004). An item selection procedure to maximize scale reliability and validity. SA Journal of Industrial Psychology, 30(4), 59–64. doi:10.4102/sajip.v30i4.168

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Riemer, H.A., & Chelladurai, P. (1998). Development of the athlete satisfaction questionnaire (ASQ). Journal of Sport and Exercise Psychology, 20(2), 127–156.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Röthlin, P., Birrer, D., Horvath, S., & Grosse Holtforth, M. (2016). Psychological skills training and a mindfulness-based intervention to enhance functional athletic performance: Design of a randomized controlled trial using ambulatory assessment. BMC Psychology, 4(1), 39. PubMed ID: 27457721 doi:10.1186/s40359-016-0147-y

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Röthlin, P., Horvath, S., Birrer, D., & Grosse Holtforth, M. (2016). Mindfulness promotes the ability to deliver performance in highly demanding situations. Mindfulness, 7(3), 727–733. doi:10.1007/s12671-016-0512-1

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Schreiber, J.B., Nora, A., Stage, F.K., Barlow, E.A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. The Journal of Educational Research, 99(6), 323–338. doi:10.3200/JOER.99.6.323-338

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Steiger, J.H. (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences, 42 (5), 893–898. doi:10.1016/j.paid.2006.09.017

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Thelwell, R., & Maynard, I. (2003). The effects of a mental skills package on ‘repeatable good performance’ in cricketers. Psychology of Sport & Exercise, 4(4), 377. doi:10.1016/S1469-0292(02)00036-5

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Vealey, R.S. (2007). Mental skills training in sport. In G. Tenenbaum, R.C. Eklund, G. Tenenbaum, & R.C. Eklund (Eds.), Handbook of sport psychology (pp. 287–309). Hoboken, NJ: John Wiley & Sons Inc.

    • Search Google Scholar
    • Export Citation

  • Weiss, M.R., & Friedrichs, W.D. (1986). The influence of leader behaviors, coach attributes, and institutional variables on performance and satisfaction of collegiate basketball teams. Journal of Sport Psychology, 8(4), 332–346. doi:10.1123/jsp.8.4.332

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Worthington, R.L., & Whittaker, T.A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. doi:10.1177/0011000006288127

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Yong, A.G., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79–94. doi:10.20982/tqmp.09.2.p079

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Zakrajsek, R., & Blanton, J. (2017). Evaluation of psychological interventions in sport and exercise settings. Oxford Research Encyclopedia of Psychology. Retrieved from https://perma.cc/44EC-7HWZ

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 3778 977 21
Full Text Views 94 13 1
PDF Downloads 100 20 1