Empirical Development of a Screening Method to Assist Mental Health Referrals in Collegiate Athletes

Click name to view affiliation

Bradley Donohue University of Nevada

Search for other papers by Bradley Donohue in
Current site
Google Scholar
PubMed Close
*
,
Marina Galante University of Nevada

Search for other papers by Marina Galante in
Current site
Google Scholar
PubMed Close
*
,
Julia Maietta University of Nevada

Search for other papers by Julia Maietta in
Current site
Google Scholar
PubMed Close
*
,
Bern Lee University of Nevada

Search for other papers by Bern Lee in
Current site
Google Scholar
PubMed Close
*
,
Nina Paul University of Nevada

Search for other papers by Nina Paul in
Current site
Google Scholar
PubMed Close
*
,
Joanne E. Perry Novant Health

Search for other papers by Joanne E. Perry in
Current site
Google Scholar
PubMed Close
*
,
Arianna Corey University of Nevada

Search for other papers by Arianna Corey in
Current site
Google Scholar
PubMed Close
*
, and
Daniel N. Allen University of Nevada

Search for other papers by Daniel N. Allen in
Current site
Google Scholar
PubMed Close
*
DOI:
https://doi.org/10.1123/jcsp.2018-0070
In Print:
Volume 13: Issue 4
Page Range:
561–579
Restricted access

The conspicuous absence of validated screening measures specific to mental health symptomology in collegiate athletes has negatively affected clinical practice in this population. Therefore, this study was performed to develop a sport specific measure to optimally identify collegiate athletes who are particularly likely to benefit from mental health programming. Participants were 289 collegiate-athletes who were assessed for mental health symptomology using the Global Severity Index of Symptom Checklist-90-Revised (GSI), factors that interfere with sport performance using the Problems in Sport Competition Scale (PSCS) and Problems in Sport Training Scale (PSTS), and motivation to pursue professional counseling using the Desire to Pursue Sport Psychology Scale (DSPS). As hypothesized, a hierarchical multiple regression analysis indicated that PSCS, PSTS and DSPS scores significantly predicted GSI scores, controlling gender and sport status (NCAA, club, intramural). Receiver operating characteristic (ROC) analysis indicated that high-risk athletes (GSI T-scores ≥ 60) could be correctly classified by PSTS and PSCS scores. Results suggest the PSCS and PSTS may assist identification of collegiate athletes who are especially appropriate for mental health programs. These scales additionally identify factors directly relevant to athletes’ sport performance.

Donohue, Galante, Maietta, Lee, Paul, Corey, and Allen are with the Psychology Department, University of Nevada, Las Vegas, NV. Perry is with the Orthopedic and Sports Medicine Institute, Novant Health, Charlotte, NC.

Address author correspondence to Bradley Donohue at Bradley.Donohue@unlv.edu.
  • Collapse
  • Expand
Cover Journal of Clinical Sport Psychology

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.

    • Search Google Scholar
    • Export Citation

  • Barry, A.E., Howell, S.M., Riplinger, A., & Piazza-Gardner, A.K. (2015). Alcohol use among college athletes: Do intercollegiate, club, or intramural student athletes drink differently?. Substance Use & Misuse, 50 ,302–307. doi:10.3109/10826084.2014.977398

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Bauman, N.J. (2015). The stigma of mental health in athletes: Are mental toughness and mental health seen as contradictory in elite sport? British Journal of Sports Medicine, 50 ,135–136. PubMed ID: 26626270 doi:10.1136/bjsports-2015-095570

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Buckman, J.F., Farris, S.G., & Yusko, D.A. (2013). A national study of substance use behaviors among NCAA male athletes who use banned performance enhancing substances. Drug & Alcohol Dependence, 131 ,50–55. PubMed ID: 23688842 doi:10.1016/j.drugalcdep.2013.04.023

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Comeaux, E., Bachman, T., Burton, R.M., & Aliyeva, A. (2017). Undergraduate experiences of Division I athlete science, technology, engineering, and mathematics (STEM) graduates. Journal of Science Education and Technology, 26 ,24–32. doi:10.1007/s10956-016-9648-y

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Conley, K.M., Bolin, D.J., Carek, P.J., Konin, J.G., Neal, T.L., & Violette, D. (2014). National Athletic Trainers’ Association position statement: Pre-preparation physical examinations and disqualifying conditions. Journal of Athletic Training, 49 ,102–120. PubMed ID: 24499039 doi:10.4085/1062-6050-48.6.05

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Cottone, J. (1999). Preparticipation physical examinations. Athletic Therapy Today, 4(5), 55–60. doi:10.1123/att.4.5.55

  • Derogatis, L.R. (1994). SCL-90-R: Administration, scoring, and procedures manual (3rd ed.). Minneapolis, MN: Derogatis.

  • Devins, G.M., Orme, C.M., Costello, C.G., Binik, Y.M., Frizzell, B., Stam, H.J., & Pullin, W.M. (1988). Measuring depressive symptoms in illness populations: Psychometric properties of the Center for Epidemiologic Studies depression (CES-D) scale. Psychology and Health, 2 ,139–156. doi:10.1080/08870448808400349

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Donohue, B., Chow, G.M., Pitts, M., Loughran, T., Schubert, K.N., Gavrilova, Y., & Allen, D.N. (2014). Piloting a family-supporting approach to concurrently optimize mental health and sport performance in athletes. Clinical Case Studies, 14 ,159–177. doi:10.1177/1534650114548311

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Donohue, B., Dickens, Y., Lancer, K., Covassin, T., Hash, A., Miller, A., & Genet, J. (2004). Improving athletes’ perspectives of sport psychology consultation: A controlled evaluation of two interview methods. Behavior Modification, 28 ,182–193. PubMed ID: 14997947 doi:10.1177/0145445503259399

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Donohue, B., Dowd, A., Philips, C., Plant, C.P., Loughran, T., & Gavrilova, Y. (2016). Controlled evaluation of a method to assist recruitment of participants into treatment outcome research and engage student-athletes into substance abuse intervention. Journal of Clinical Sport Psychology, 10 ,272–288. doi:10.1123/jcsp.2015-0022

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Donohue, B., Gavrilova, Y., Galante, M., Burnstein, B., Aubertin, B., Gavrilova, E., . . . Benning, S. (2018). Empirical development of a screening method for mental, social, and physical wellness in amateur and professional circus artists. Psychology of Aesthetics, Creativity, and the Arts. doi:10.1037/aca0000199

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Donohue, B., Gavrilova, Y., Galante, M., Gavrilova, E., Loughran, T., Scott, J., . . . Allen, D.N. (2018). Controlled evaluation of optimization approach to mental health and sport performance. Journal of Clinical Sport Psychology, 12 ,234–267. doi:10.1123/jcsp.2017-0054

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Donohue, B., Pitts, M., Gavrilova, Y., Ayarza, A., & Cintron, K.I. (2013). A culturally sensitive approach to treating substance abuse in athletes using evidence-supported methods. Journal of Clinical Sport Psychology, 7 ,98–119. doi:10.1123/jcsp.7.2.98

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Donohue, B., Silver, N.C., Dickens, Y., Covassin, T., & Lancer, K. (2007). Development and psychometric evaluation of the sport interference checklist. Behavior Modification, 31 ,937–957. PubMed ID: 17932245 doi:10.1177/0145445507303827

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Etzel, E.F., & Watson, J.C. (2007). Ethical challenges for psychological consultations in intercollegiate athletics. Journal of Clinical Sport Psychology, 1(3), 304–317. doi:10.1123/jcsp.1.3.304

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Etzel, E.F., Watson, J.C., Visek, A.J., & Maniar, S.D. (2006). Understanding and promoting college student-athlete health: Essential issues for student affairs professionals. The National Association for Sport and Physical Education Journal, 43 ,518–546. doi:10.2202/1949-6605.1682

    • Search Google Scholar
    • Export Citation

  • Fluss, R., Faraggi, D., & Reiser, B. (2005). Estimation of the Youden index and its associated cutoff point. Biometric Journal, 47 ,458–472. doi:10.1002/bimj.200410135

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Gulliver, A., Griffiths, K.M., & Christensen, H. (2012). Barriers and facilitators to mental health help-seeking for young elite athletes: A qualitative study. BMC Psychiatry, 12(157), 1–14. doi:10.1186/1471-244X-12-157

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Hanley, J.A., & McNeil, B.J. (1983). A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148 ,839–843. PubMed ID: 6878708 doi:10.1148/radiology.148.3.6878708

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Horowitz, L.M., Rosenberg, S.E., Baer, B.A., Ureño, G., & Villaseñor, V.S. (1998). Inventory of interpersonal problems: Psychometric properties and clinical applications. Journal of Consulting and Clinical Psychology, 56 ,885–892. doi:10.1037/0022-006X.56.6.885

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Hosmer, D.W., Lemeshow, S., & Sturdivant, R.X. (2013). Introduction to the logistic regression model. In: D. Hosmer, S. Lemeshow, & R. Sturdivant (Eds.), Applied logistic regression (3rd ed., pp. 1–30). Hoboken, NJ: Wiley.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kroenke, K., Spitzer, R.L., & Williams, J.B. (2001). The PHQ-9. Journal of General Internal Medicine, 16 ,606–613. PubMed ID: 11556941 doi:10.1046/j.1525-1497.2001.016009606.x

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kroshus, E. (2016). Variability in institutional screening practices related to collegiate student-athlete mental health. Journal of Athletic Training, 51 ,389–397. PubMed ID: 27111587 doi:10.4085/1062-6050-51.5.07

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Lopez, R.L., & Levy, J.J. (2013). Student athletes’ perceived barriers to and preferences for seeking counseling. Journal of College Counseling, 16 ,19–31. doi:10.1002/j.2161-1882.2013.00024.x

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Martin, A., Rief, W., Klaiberg, A., & Braehler, E. (2006). Validity of the brief patient health questionnaire mood scale (PHQ-9) in the general population. General Hospital Psychiatry, 28 ,71–77. PubMed ID: 16377369 doi:10.1016/j.genhosppsych.2005.07.003

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Marzell, M., Morrison, C., Mair, C., Moynihan, S., & Gruenewald, P.J. (2015). Examining drinking patterns and high-risk drinking environments among college athletes at different competition levels. Journal of Drug Education, 45(1), 5–16. doi:10.1177/0047237915575281

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Miller, W.R., & Rollnick, S. (2013). Motivational interviewing: Helping people change (3rd ed.). New York, NY: Guilford Press.

  • National Collegiate Athletic Association. Mental Health Task Force. (2013). Inter-association consensus document: Best practices for understanding and supporting student-athlete mental wellness. Retrieved from https://www.ncaa.org/sites/default/files/HS_Mental-Health-Best-Practices_20160317.pdf

    • Search Google Scholar
    • Export Citation

  • NCAA Sport Science Institute and the NCAA. (2016, January). Mental health best practices: Inter-Association consensus document: Best practices for understanding and supporting student-athlete mental wellness. Indianapolis, IN: Author.

    • Search Google Scholar
    • Export Citation

  • Neal, T.L., Diamond, A.B., Goldman, S., Klossner, D., Morse, E.D., Pajak, D.E., . . . Welzant, V. (2013). Inter-association recommendations for developing a plan to recognize and refer student-athletes with psychological concerns at the collegiate level: An executive summary of a consensus statement. Journal of Athletic Training, 48 ,716–720. PubMed ID: 24067154 doi:10.4085/1062-6050-48.4.13

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Pinkerton, R.S., Hinz, L.D., & Barrow, J.C. (1989). The college student-athlete: Psychological considerations and interventions. Journal of American College Health, 37 ,218–226. PubMed ID: 2649528 doi:10.1080/07448481.1989.9939063

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Putukian, M. (2016). The psychological response to injury in student athletes: A narrative review with a focus on mental health. British Journal of Sports Medicine, 50 ,145–148. PubMed ID: 26719498 doi:10.1136/bjsports-2015-095586

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Radloff, L.S. (1991). The use of the center for epidemiologic studies depression Scale in adolescents and young adults. Journal of Youth and Adolescence, 20 ,149–166. PubMed ID: 24265004 doi:10.1007/BF01537606

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Reardon, C.L., & Factor, R.M. (2010). Sport psychiatry: A systematic review of diagnosis and medical treatment of mental illness in athletes. Sports Medicine, 40 ,961–980. PubMed ID: 20942511 doi:10.2165/11536580-000000000-00000

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Rice, S.M., Purcell, R., De Silva, S., Mawren, D., McGorry, P., & Parker, A.G. (2016). Mental health of elite athletes: A narrative systematic review. Sports Medicine, 46 ,1333–1353. PubMed ID: 26896951 doi:10.1007/s40279-016-0492-2

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Rice, S.M., Parker, A.G., Mawren, D., Clifton, P., Lloyd, M., Kountouris, A., . . . Purcell, R. (2019). Preliminary psychometric validation of a brief screening tool for athlete mental health among male elite athletes: the Athlete Psychological Strain Questionnaire. International Journal of Sport and Exercise Psychology. doi:10.1080/1612197X.2019.1611900

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Smith, J., & Laskowski, E.R. (1998). The preparticipation physical examination: Mayo clinic experience with 2, 739 examinations. Mayo Clinic Proceedings, 73 ,419–429. PubMed ID: 9581581 doi:10.1016/S0025-6196(11)63723-3

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Spitzer, R.L., Kroenke, K., Williams, J.B.W., & Lowe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166 ,1092–1097. PubMed ID: 16717171 doi:10.1001/archinte.166.10.1092

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Stojanovic, M., Apostolovic, M., Stojanovic, D., Milosevic, Z., Toplaovic, A., Lakusic, V.M., & Golubovic, M. (2014). Understanding sensitivity, specificity, and predictive values. Practical Advices for Physicians, 7 ,1062–1065. doi:10.2298/VSP1411062S

    • Search Google Scholar
    • Export Citation

  • Sudano, L.E., Collins, G., & Miles, C.M. (2017). Reducing barriers to mental health care for student-athletes: An integrated care model. Families, Systems, & Health, 35 ,77–84. PubMed ID: 27893262 doi:10.1037/fsh0000242

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Tabachnick, B.G., & Fidell, L.S. (2013). Using multivariate statistics (6th ed.). Boston, MA: Allyn & Bacon/Pearson Education.

  • U.S. Department of Health & Human Services. (2013). Substance abuse and mental health services administration. United States: Behavioral Health. https://store.samhsa.gov/product/Behavioral-Health-United-States-2012/SMA13-4797

    • Search Google Scholar
    • Export Citation

  • Watson, J.C. (2005). College student-athletes’ attitudes toward help-seeking behavior and expectations of counseling services. Journal of College Student Development, 46 ,442–449. doi:10.1353/csd.2005.0044

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Wolanin, A., Gross, M., & Hong, E. (2015). Depression in athletes: Prevalence and risk factors. Current Sports Medicine Reports, 14 ,56–60. PubMed ID: 25574886 doi:10.1249/JSR.0000000000000123

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 6100 798 102
Full Text Views 293 208 1
PDF Downloads 104 26 2