The Importance of an Organization’s Reputation: Application of the Rasch Model to the Organizational Reputation Questionnaire for Sports Fans

in International Journal of Sport Communication

Click name to view affiliation

Seomgyun LeeDepartment of Health, Exercise Science, and Recreation & Sport Management, University of Mississippi, Oxford, MS, USA

Search for other papers by Seomgyun Lee in
Current site
Google Scholar
PubMedClose
https://orcid.org/0000-0002-2345-7228*
,
Kyungun Ryan KimDepartment of Sport Management, University of Central Missouri, Warrensburg, MO, USA

Search for other papers by Kyungun Ryan Kim in
Current site
Google Scholar
PubMedClose
https://orcid.org/0000-0003-0287-2497
, and
Minsoo KangDepartment of Health, Exercise Science, and Recreation & Sport Management, University of Mississippi, Oxford, MS, USA

Search for other papers by Minsoo Kang in
Current site
Google Scholar
PubMedClose
https://orcid.org/0000-0002-9225-1004
DOI:
https://doi.org/10.1123/ijsc.2022-0118
Keywords:
Organizational Reputation Scale; situational crisis communication theory; scale calibration; professional sports
First Published Online:
13 Oct 2022
Corrected:
13 Oct 2022
In Print:
Volume 16: Issue 1
Page Range:
21–31
ERRATUM TO THIS ARTICLE
Restricted access

Crises are unavoidable in the sport world, and their relationship with reputation is inextricable. Protecting its reputation is a top priority for a sport organization in a crisis; thus, developing a valid and reliable instrument should be a precedent. In this study, Rasch analysis was applied to evaluate a 10-item Organizational Reputation Scale (ORP), extensively used in general and sport communication research, but whose development was made under classical test theory. This traditional method has several limitations (i.e., item and sample dependencies, nonaddictive features of ordinal data, and item category functioning). The main purposes of the study were to calibrate ORP items and evaluate their category functions. A total of 373 sport fans responded to the ORP on a 5-point Likert scale. Several analytic steps were applied to provide psychometric properties of each item in the ORP. The findings provided evidence that supports the unidimensional structure of the ORP with eight items. All items and a person’s ability exhibited satisfactory levels of variability along the continuum. The 5-category rating scale in Likert format functioned properly. As a better alternative to classical test theory, Rasch analysis provided information about the practicality of each ORP item in measuring individuals’ perceptual level of an organization’s reputation within a sport setting. Our study proposed some insights for enhancing each item’s quality and encouraging future scholars to make informed decisions when using the ORP.

  • Collapse
  • Expand

International Journal of Sport Communication

Cover International Journal of Sport Communication

  • Alexandrov, A. (2010). Characteristics of single-item measures in Likert scale format. Electronic Journal of Business Research Methods, 8(1), 1–12.

    • Search Google Scholar
    • Export Citation

  • American Educational Research Association, American Psychological Association and National Council on Measurement in Education. (2014). Standards for educational and psychological testing.

    • Search Google Scholar
    • Export Citation

  • Anderson, S.M. (2020). United we stand, divided we kneel: Examining perceptions of the NFL anthem protest on organizational reputation. Communication & Sport, 8(4–5), 591–610. https://doi.org/10.1177/2167479519893661

    • Search Google Scholar
    • Export Citation

  • Anshel, M.H., Kang, M., & Jubenville, C. (2013). Sources of acute sport stress scale for sports officials: Rasch calibration. Psychology of Sport and Exercise, 14(3), 362–370. https://doi.org/10.1016/j.psychsport.2012.12.003

    • Search Google Scholar
    • Export Citation

  • Aryadoust, V., & Raquel, M. (Eds.). (2019). Quantitative data analysis for language assessment volume I: Fundamental techniques. Routledge.

    • Search Google Scholar
    • Export Citation

  • Behrend, T.S., Baker, B.A., & Thompson, L.F. (2009). Effects of pro-environmental recruiting messages: The role of organizational reputation. Journal of Business and Psychology, 24(3), 341–350. https://doi.org/10.1007/s10869-009-9112-6

    • Search Google Scholar
    • Export Citation

  • Bond, T.G., & Fox, C.M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Lawrence Erlbaum Associates.

    • Search Google Scholar
    • Export Citation

  • Boone, W.J. (2016). Rasch analysis for instrument development: Why, when, and how? CBE—Life Sciences Education, 15(4), rm4 rm4. https://doi.org/10.1187/cbe.16-04-0148

    • Search Google Scholar
    • Export Citation

  • Boyd, B.K., Bergh, D.D., & Ketchen, D.J., Jr. (2010). Reconsidering the reputation—Performance relationship: A resource-based view. Journal of Management, 36(3), 588–609. https://doi.org/10.1177/0149206308328507

    • Search Google Scholar
    • Export Citation

  • Brønn, C., & Brønn, P.S. (2015). A systems approach to understanding how reputation contributes to competitive advantage. Corporate Reputation Review, 18(2), 69–86. https://doi.org/10.1057/crr.2015.5

    • Search Google Scholar
    • Export Citation

  • Brown, K.A., Adamson, A., & Park, B. (2020). Applying situational crisis communication theory to sports: Investigating the impact of athlete reputational crises on team perception. Journal of Global Sport Management, 5(2), 202–222. https://doi.org/10.1080/24704067.2019.1604077

    • Search Google Scholar
    • Export Citation

  • Brown, K.A., & White, C.L. (2010). Organization–public relationships and crisis response strategies: Impact on attribution of responsibility. Journal of Public Relations Research, 23(1), 75–92. https://doi.org/10.1080/1062726X.2010.504792

    • Search Google Scholar
    • Export Citation

  • Brown, N.A., & Billings, A.C. (2013). Sports fans as crisis communicators on social media websites. Public Relations Review, 39(1), 74–81. https://doi.org/10.1016/j.pubrev.2012.09.012

    • Search Google Scholar
    • Export Citation

  • Brown-Devlin, N., & Brown, K.A. (2020). When crises change the game: Establishing a typology of sports-related crises. Journal of International Crisis and Risk Communication Research, 3(1), 49–70. https://doi.org/10.30658/jicrcr.3.1.3

    • Search Google Scholar
    • Export Citation

  • Brown-Devlin, N., Brown, K.A., Britt, B.C., & Adamson, A.C. (2021). What inspired that tweet: A comparative analysis of official and stakeholder-enacted crisis responses during the Urban Meyer/Zach Smith scandal. Communication & Sport. Advance online publication. https://doi.org/10.1177/2167479521989308

    • Search Google Scholar
    • Export Citation

  • Buffett, W.E. (1995). Buffett: The making of an American capitalist. Broadway Books.

  • Caruana, A., & Chircop, S. (2000). Measuring corporate reputation: A case example. Corporate Reputation Review, 3(1), 43–57. https://doi.org/10.1057/palgrave.crr.1540098

    • Search Google Scholar
    • Export Citation

  • Casidy, R., & Wymer, W. (2015). The impact of brand strength on satisfaction, loyalty and WOM: An empirical examination in the higher education sector. Journal of Brand Management, 22(2), 117–135. https://doi.org/10.1057/bm.2015.6

    • Search Google Scholar
    • Export Citation

  • Chang, C.C., Lin, C.Y., Gronholm, P.C., & Wu, T.H. (2018). Cross-validation of two commonly used self-stigma measures, Taiwan versions of the Internalized Stigma Mental Illness scale and Self-Stigma Scale–Short, for people with mental illness. Assessment, 25(6), 777–792. https://doi.org/10.1177/1073191116658547

    • Search Google Scholar
    • Export Citation

  • Chen, W.H., Lenderking, W., Jin, Y., Wyrwich, K.W., Gelhorn, H., & Revicki, D.A. (2014). Is Rasch model analysis applicable in small sample size pilot studies for assessing item characteristics? An example using PROMIS pain behavior item bank data. Quality of Life Research, 23(2), 485–493. https://doi.org/10.1007/s11136-013-0487-5

    • Search Google Scholar
    • Export Citation

  • Christensen, K.B., Makransky, G., & Horton, M. (2017). Critical values for Yen’s Q3: Identification of local dependence in the Rasch model using residual correlations. Applied Psychological Measurement, 41(3), 178–194. https://doi.org/10.1177/0146621616677520

    • Search Google Scholar
    • Export Citation

  • Confente, I., Siciliano, G.G., Gaudenzi, B., & Eickhoff, M. (2019). Effects of data breaches from user-generated content: A corporate reputation analysis. European Management Journal, 37(4), 492–504. https://doi.org/10.1016/j.emj.2019.01.007

    • Search Google Scholar
    • Export Citation

  • Coombs, W.T. (1998). An analytic framework for crisis situations: Better responses from a better understanding of the situation. Journal of Public Relations Research, 10(3), 177–191. https://doi.org/10.1207/s1532754xjprr1003_02

    • Search Google Scholar
    • Export Citation

  • Coombs, W.T. (2007). Protecting organization reputations during a crisis: The development and application of situational crisis communication theory. Corporate Reputation Review, 10(3), 163–176. https://doi.org/10.1057/palgrave.crr.1550049

    • Search Google Scholar
    • Export Citation

  • Coombs, W.T. (2013). Situational theory of crisis: Situational crisis communication theory and corporate reputation. In C.E. Carroll (Ed.), The handbook of communication and corporate reputation (pp. 262–278). Wiley-Blackwell.

    • Search Google Scholar
    • Export Citation

  • Coombs, W.T., & Holladay, S.J. (1996). Communication and attributions in a crisis: An experimental study in crisis communication. Journal of Public Relations Research, 8(4), 279–295. https://doi.org/10.1207/s1532754xjprr0804_04

    • Search Google Scholar
    • Export Citation

  • Coombs, W.T., & Holladay, S.J. (2002). Helping crisis managers protect reputational assets: Initial tests of the situational crisis communication theory. Management Communication Quarterly, 16(2), 165–186. https://doi.org/10.1177/089331802237233

    • Search Google Scholar
    • Export Citation

  • Coombs, W.T., & Holladay, S.J. (2007). The negative communication dynamic: Exploring the impact of stakeholder affect on behavioral intentions. Journal of Communication Management, 11(4), 300–312. https://doi.org/10.1108/13632540710843913

    • Search Google Scholar
    • Export Citation

  • Coste, J., Guillemin, F., Pouchot, J., & Fermanian, J. (1997). Methodological approaches to shortening composite measurement scales. Journal of Clinical Epidemiology, 50(3), 247–252. https://doi.org/10.1016/S0895-4356(96)00363-0

    • Search Google Scholar
    • Export Citation

  • Croucher, S.M., Zeng, C., & Kassing, J. (2019). Learning to contradict and standing up for the company: An exploration of the relationship between organizational dissent, organizational assimilation, and organizational reputation. International Journal of Business Communication, 56(3), 349–367. https://doi.org/10.1177/2329488416633852

    • Search Google Scholar
    • Export Citation

  • DiMaggio, P.J., & Powell, W.W. (1991). The iron cage revisited: Institutional isomorphism and collective rationality in organizational fields. In W.W. Powell& P.J. DiMaggio (Eds.), The new institutionalism in organizational analysis (pp. 1–40). University of Chicago Press.

    • Search Google Scholar
    • Export Citation

  • Eaddy, L.L., & Jin, Y. (2018). Crisis history tellers matter: The effects of crisis history and crisis information source on publics’ cognitive and affective responses to organizational crisis. Corporate Communications: An International Journal, 23(2), 226–241. https://doi.org/10.1108/CCIJ-04-2017-0039

    • Search Google Scholar
    • Export Citation

  • Edelen, M.O., & Reeve, B.B. (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(Suppl. 1), 5–18. https://doi.org/10.1007/s11136-007-9198-0

    • Search Google Scholar
    • Export Citation

  • Fischer, E., & Reuber, R. (2007). The good, the bad, and the unfamiliar: The challenges of reputation formation facing new firms. Entrepreneurship Theory and Practice, 31(1), 53–75. https://doi.org/10.1111/j.1540-6520.2007.00163.x

    • Search Google Scholar
    • Export Citation

  • Fishbein, M., & Raven, B.H. (1962). The AB scales: An operational definition of belief and attitude. Human Relations, 15(1), 35–44. https://doi.org/10.1177/001872676201500104

    • Search Google Scholar
    • Export Citation

  • Fraley, R.C., Waller, N.G., & Brennan, K.A. (2000). An item response theory analysis of self-report measures of adult attachment. Journal of Personality and Social Psychology, 78(2), 350–365. https://doi.org/10.1037/0022-3514.78.2.350

    • Search Google Scholar
    • Export Citation

  • Ghaemi, H. (2011). Is Rasch model without drawback? A reanalysis of Rasch model limitations. Modern Journal of Language Teaching Methods, 1(2), 31–38.

    • Search Google Scholar
    • Export Citation

  • Grappi, S., & Romani, S. (2015). Company post-crisis communication strategies and the psychological mechanism underlying consumer reactions. Journal of Public Relations Research, 27(1), 22–45. https://doi.org/10.1080/1062726X.2014.924839

    • Search Google Scholar
    • Export Citation

  • Herzberger, J.D. (2014). “Can you hear me now?” Experimental research on the efficacy of pre-crisis messages in a severe weather context [Unpublished doctoral dissertation]. Cleveland State University.

    • Search Google Scholar
    • Export Citation

  • Highhouse, S., Brooks, M.E., & Gregarus, G. (2009). An organizational impression management perspective on the formation of corporate reputations. Journal of Management, 35(6), 1481–1493. https://doi.org/10.1177/0149206309348788

    • Search Google Scholar
    • Export Citation

  • Hinkin, T.R. (1995). A review of scale development practices in the study of organizations. Journal of Management, 21(5), 967–988. https://doi.org/10.1177/014920639502100509

    • Search Google Scholar
    • Export Citation

  • Hughes, S., & Shank, M. (2005). Defining scandal in sports: Media and corporate sponsor perspectives. Sport Marketing Quarterly, 14(4), 207–216.

    • Search Google Scholar
    • Export Citation

  • Isa, M., Bakar, M.A., Hasim, M.S., Anuar, M.K., Sipan, I., & Nor, M.Z.M. (2017). Data quality control for survey instrument of office investors in rationalising green office building investment in Kuala Lumpur by the application of Rasch analysis. Facilities, 35(11–12), 638–657. https://doi.org/10.1108/F-06-2016-0067

    • Search Google Scholar
    • Export Citation

  • Jennings, N.B., Slack, M.K., Mollon, L.E., & Warholak, T.L. (2016). Measurement characteristics of a concept classification exam using multiple case examples: A Rasch analysis. Currents in Pharmacy Teaching and Learning, 8(1), 31–38. https://doi.org/10.1016/j.cptl.2015.09.010

    • Search Google Scholar
    • Export Citation

  • Kang, M., Kim, H., & Kim, M. (2021). Applying the Rasch model to sport management research: The case of the psychological capital questionnaire for sport employees. International Journal of Sport Management and Marketing, 21(3–4), 172–189. https://doi.org/10.1504/IJSMM.2021.118815

    • Search Google Scholar
    • Export Citation

  • Kang, M., Zhu, W., Ragan, B.G., & Frogley, M. (2007). Exercise barrier severity and perseverance of active youth with physical disabilities. Rehabilitation Psychology, 52(2), 170. https://doi.org/10.1037/0090-5550.52.2.170

    • Search Google Scholar
    • Export Citation

  • Kiambi, D.M., & Shafer, A. (2016). Corporate crisis communication: Examining the interplay of reputation and crisis response strategies. Mass Communication and Society, 19(2), 127–148. https://doi.org/10.1080/15205436.2015.1066013

    • Search Google Scholar
    • Export Citation

  • Kim, H.S., Kang, M., & Kim, M. (2021). Rasch calibration and optimal categorization of the sport fandom questionnaire. International Journal of Sports Marketing and Sponsorship, 23(1), 75–92. https://doi.org/10.1108/IJSMS-11-2020-0208

    • Search Google Scholar
    • Export Citation

  • Kim, K.R., Sparvero, E.S., & Olmeda, N. (2016). Benefits of campus recreational sports: A Rasch calibration. Recreational Sports Journal, 40(2), 165–178. https://doi.org/10.1123/rsj.2015-0047

    • Search Google Scholar
    • Export Citation

  • Lange, D., Lee, P.M., & Dai, Y. (2011). Organizational reputation: A review. Journal of Management, 37(1), 153–184. https://doi.org/10.1177/0149206310390963

    • Search Google Scholar
    • Export Citation

  • Lee, S., & Oh, T. (2022). The role of trust in sports organization crisis communication: The case of the Houston Astros’ sign-stealing scandal. International Journal of Sports Marketing and Sponsorship. Advance online publication. https://doi.org/10.1108/IJSMS-12-2021-0231

    • Search Google Scholar
    • Export Citation

  • Lim, H.S., & Brown-Devlin, N. (2021). The value of brand fans during a crisis: Exploring the roles of response strategy, source, and brand identification. International Journal of Business Communication. Advance online publication. https://doi.org/10.1177/2329488421999699

    • Search Google Scholar
    • Export Citation

  • Linacre, J.M. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85–106.

  • Linacre, J.M. (2021). WINSTEPS Rasch measurement computer program user’s guide. Winsteps.com.

  • Linsner, A., Hill, B., Hallmann, K., & Sotiriadou, P. (2020). Developing an athlete brand identity scale using Rasch analysis. Sport, Business and Management, 10(4), 431–449. https://doi.org/10.1108/SBM-09-2019-0075

    • Search Google Scholar
    • Export Citation

  • Ma, L., & Zhan, M. (2016). Effects of attributed responsibility and response strategies on organizational reputation: A meta-analysis of situational crisis communication theory research. Journal of Public Relations Research, 28(2), 102–119. https://doi.org/10.1080/1062726X.2016.1166367

    • Search Google Scholar
    • Export Citation

  • Mason, A.M. (2014). The impact of media frames and treatment responsibility within the situational crisis communication theory framework. Corporate Reputation Review, 17(1), 78–90. https://doi.org/10.1057/crr.2013.26

    • Search Google Scholar
    • Export Citation

  • McCracken, L.M., & Dhingra, L. (2002). A short version of the pain anxiety symptoms scale (PASS-20): Preliminary development and validity. Pain Research and Management, 7(1), 45–50. https://doi.org/10.1155/2002/517163

    • Search Google Scholar
    • Export Citation

  • McCroskey, J.C. (1966). An introduction to rhetorical communication. Prentice Hall.

  • McDermott, K.C., & Lachlan, K.A. (2020). Polarizing organizations and image repair: The effects of extreme disposition and ego-involvement on ELM processing routes for organizational responses. Communication Studies, 71(2), 332–350. https://doi.org/10.1080/10510974.2020.1733039

    • Search Google Scholar
    • Export Citation

  • Myers, N.D., Wolfe, E.W., Feltz, D.L., & Penfield, R.D. (2006). Identifying differential item functioning of rating scale items with the Rasch model: An introduction and an application. Measurement in Physical Education and Exercise Science, 10(4), 215–240. https://doi.org/10.1207/s15327841mpee1004_1

    • Search Google Scholar
    • Export Citation

  • Ng, J.Y., Lonsdale, C., & Hodge, K. (2011). The Basic Needs Satisfaction in Sport Scale (BNSSS): Instrument development and initial validity evidence. Psychology of Sport and Exercise, 12(3), 257–264. https://doi.org/10.1016/j.psychsport.2010.10.006

    • Search Google Scholar
    • Export Citation

  • Palan, S., & Schitter, C. (2018). Prolific.ac—A subject pool for online experiments. Journal of Behavioral and Experimental Finance, 17, 22–27. https://doi.org/10.1016/j.jbef.2017.12.004

    • Search Google Scholar
    • Export Citation

  • Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017). Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. Journal of Experimental Social Psychology, 70, 153–163. https://doi.org/10.1016/j.jesp.2017.01.006

    • Search Google Scholar
    • Export Citation

  • Podsakoff, P.M., MacKenzie, S.B., Lee, J.Y., & Podsakoff, N.P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879

    • Search Google Scholar
    • Export Citation

  • Prieto, L., Alonso, J., & Lamarca, R. (2003). Classical test theory versus Rasch analysis for quality of life questionnaire reduction. Health and Quality of Life Outcomes, 1, 27. https://doi.org/10.1186/1477-7525-1-27

    • Search Google Scholar
    • Export Citation

  • Rasch, G. (1960). Probabilistic model for some intelligence and achievement tests. Danish Institute for Educational Research.

  • Rasch, G. (1980). Probabilistic models for some intelligence and attainment tests. University of Chicago Press.

  • Rhee, M. (2009). Does reputation contribute to reducing organizational errors? A learning approach. Journal of Management Studies, 46(4), 676–703. https://doi.org/10.1111/j.1467-6486.2009.00830.x

    • Search Google Scholar
    • Export Citation

  • Salzberger, T., & Koller, M. (2013). Towards a new paradigm of measurement in marketing. Journal of Business Research, 66(9), 1307–1317. https://doi.org/10.1016/j.jbusres.2012.02.030

    • Search Google Scholar
    • Export Citation

  • Seibold, D. (2010). Organizational Reputation Scale. In R.B. Rubin, A.M. Rubin, E. Graham, E.M. Perse, & D. Seibold (Eds.), Communication research measures II (pp. 253–256). Routledge.

    • Search Google Scholar
    • Export Citation

  • Shea, T., Cooper, B.K., De Cieri, H., & Sheehan, C. (2012). Evaluation of a perceived organisational performance scale using Rasch model analysis. Australian Journal of Management, 37(3), 507–522. https://doi.org/10.1177/0312896212443921

    • Search Google Scholar
    • Export Citation

  • Sisco, H.F. (2012). Nonprofit in crisis: An examination of the applicability of situational crisis communication theory. Journal of Public Relations Research, 24(1), 1–17. https://doi.org/10.1080/1062726X.2011.582207

    • Search Google Scholar
    • Export Citation

  • Spence, P.R., Lachlan, K.A., Omilion-Hodges, L.M., & Goddard, A.K. (2014). Being first means being credible? Examining the impact of message source on organizational reputation. Communication Research Reports, 31(1), 124–130. https://doi.org/10.1080/08824096.2013.846259

    • Search Google Scholar
    • Export Citation

  • Tennant, A., McKenna, S.P., & Hagell, P. (2004). Application of Rasch analysis in the development and application of quality of life instruments. Value in Health, 7(Suppl. 1), S22–S26. https://doi.org/10.1111/j.1524-4733.2004.7s106.x

    • Search Google Scholar
    • Export Citation

  • Van den Bogaerd, M., & Aerts, W. (2015). Does media reputation affect properties of accounts payable? European Management Journal, 33(1), 19–29. https://doi.org/10.1016/j.emj.2014.05.002

    • Search Google Scholar
    • Export Citation

  • Ye, L., & Ki, E.J. (2018). Impact of message convergence on organizational reputation: An examination of organizational crisis communication on Facebook. Corporate Reputation Review, 21(1), 1–8. https://doi.org/10.1057/s41299-017-0040-5

    • Search Google Scholar
    • Export Citation

  • Zhou, Z., & Ki, E.J. (2018). Does severity matter? An investigation of crisis severity from defensive attribution theory perspective. Public Relations Review, 44(4), 610–618. https://doi.org/10.1016/j.pubrev.2018.08.008

    • Search Google Scholar
    • Export Citation

  • Zhu, W. (2002). A confirmatory study of Rasch-based optimal categorization of a rating scale. Journal of Applied Measurement, 3(1), 1–15.

    • Search Google Scholar
    • Export Citation

  • Zwick, R., Thayer, D.T., & Wingersky, M. (1995). Effect of Rasch calibration on ability and DIF estimation in computer‐adaptive tests. Journal of Educational Measurement, 32(4), 341–363. https://doi.org/10.1111/j.1745-3984.1995.tb00471.x

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 684 684 74
Full Text Views 29 29 12
PDF Downloads 40 40 14