Perceived Course Rigor in Sport Management: Class Level, Course Grades, and Student Ratings

in Sport Management Education Journal
Restricted access

Purchase article

USD  $24.95

Student 1 year online subscription

USD  $53.00

1 year online subscription

USD  $70.00

Student 2 year online subscription

USD  $100.00

2 year online subscription

USD  $134.00

Higher education in the United States, and sport management in particular, has faced contemporary attacks for its perceived lack of academic rigor. To investigate these criticisms, this study examined 830 students enrolled in 69 semester-long courses across four consecutive years in a single sport management program to measure perceived course rigor and its relationship to overall course ratings, course grades, and course level. Seven rigor questions were added to existing student ratings and distributed at the end of each semester. A factor analysis strongly supported the conceptualization of rigor utilized in the study. Pearson correlations indicated that student ratings and rigor were positively related. An ordinary least squares multiple regression also revealed that overall student ratings and course grades significantly aid in predicting course rigor. Pragmatically, the results suggest that sport management students appreciate rigorous courses and that faculty should strive to include elements of rigor into their courses without fear of retributional bias on student ratings.

The authors are with Ball State University, Muncie, IN.

Johnson (jejohnson1@bsu.edu) is corresponding author.
  • Abrami, P.C. (2001). Improving judgments about teaching effectiveness using teacher rating forms. In M. Theall, P.C. Abrami, & L.A. Mets (Eds.), The student ratings debate: Are they valid? How can we best use them? [Special issue] (Vol. 109, pp. 5987). New Directions for Institutional Research. San Francisco, CA: Jossey-Bass.

    • Search Google Scholar
    • Export Citation
  • Abrami, P.C., Perry, R.P., & Leventhal, L. (1982). The relationship between student personality characteristics, teacher ratings, and student achievement. Journal of Educational Psychology, 74(1), 111125. doi:10.1037/0022-0663.74.1.111

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Achen, A.C., & Courant, P.N. (2009). What are grades made of? The Journal of Economic Perspectives, 23(3), 7792. PubMed ID: 20052301 doi:10.1257/jep.23.3.77

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Aleamoni, L.M. (1981). Student ratings of instruction. In J. Millman (Ed.), Handbook of teacher evaluation (pp. 110145). Beverly Hills, CA: Sage.

    • Search Google Scholar
    • Export Citation
  • Arum, R., & Roksa, J. (2011). Academically adrift: Limited learning on college campusesChicago, IL: University of Chicago Press.

  • Asher, L. (2013, October 27). When students rate teachers, standards drop. The Wall Street Journal. Retrieved from http://www.wsj.com/news/articles/SB100014240527023041 76904579115971990673400

    • Search Google Scholar
    • Export Citation
  • Babcock, P.S., & Marks, M. (2011). The falling time cost of college: Evidence from half a century of time use data. The Review of Economics and Statistics, 93(2), 468478. doi:10.1162/REST_a_00093

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Benton, S.L., & Cashin, W.E. (2012). IDEA Technical Report No. 50: Student ratings of teaching: A summary of research and literature. Manhattan, KS: The IDEA Center. Retrieved from https://www.ideaedu.org/Portals/0/Uploads/Documents/IDEA%20Papers/IDEA%20Papers/PaperIDEA_50.pdf

    • Search Google Scholar
    • Export Citation
  • Benton, S.L., & Ryalls, K.R. (2016). IDEA Technical Report No. 58: Challenging misconceptions about student ratings of instructionManhattan, KS: The IDEA Center. Retrieved from http://www.ideaedu.org/Portals/0/Uploads/Documents/IDEA%20Papers/IDEA%20Papers/PaperIDEA_58.pdf

    • Search Google Scholar
    • Export Citation
  • Boring, A., Ottoboni, K., & Stark, P.B. (2016). Student evaluations of teaching (mostly) do not measure teaching effectiveness. ScienceOpen Research. 111. doi:10.14293/S2199-1006.1.SOR-EDU.AETBZC.v1

    • Search Google Scholar
    • Export Citation
  • Boucher, R.L. (1998). Toward achieving a focal point for sport management: A binocular perspective. Journal of Sport Management, 12, 7685. doi:10.1123/jsm.12.1.76

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Brandon, C. (2010). The five-year party: How colleges have given up on educating your child and what you can do about itDallas, TX: BenBella Books.

    • Search Google Scholar
    • Export Citation
  • Braskamp, L.A., & Ory, J.C. (1994). Assessing faculty work: Enhancing individual and institutional performanceSan Francisco, CA: Jossey-Bass.

    • Search Google Scholar
    • Export Citation
  • Braxton, J.M. (1993). Selectivity and rigor in research universities. Journal of Higher Education, 64(6), 657675. doi:10.2307/2960017

  • Brooks, J.G., & Brooks, M.G. (2001). In search of understanding: The case for constructivist classroomsAlexandria, VA: Association for Supervision and Curriculum Development.

    • Search Google Scholar
    • Export Citation
  • Bruner, J. (1996). The culture of educationCambridge, MA: Harvard University Press.

  • Bursuck, W.D. (1994). Introduction to the special series on homework. Journal of Learning Disabilities, 27(8), 466469. doi:10.1177/002221949402700801

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cashin, W.E. (1990). Students do rate different academic fields differently. In M. Theall & J. Franklin (Eds.), Student ratings of instruction: Issues for improving practice: New Directions for teaching and learning, No. 43 (pp. 113121). San Francisco, CA: Jossey-Bass.

    • Search Google Scholar
    • Export Citation
  • Centra, J.A. (1993). Reflective faculty evaluation: Enhancing teaching and determining faculty effectivenessSan Francisco, CA: Jossey-Bass.

    • Search Google Scholar
    • Export Citation
  • Centra, J.A. (2003). Will teachers receive higher student evaluations by giving higher grades and less course work? Research in Higher Education, 44(5), 495518. doi:10.1023/A:1025492407752

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Centra, J.A. (2009). Differences in responses to the student instructional report: Is it bias? Princeton, NJ: Educational Testing Service.

    • Search Google Scholar
    • Export Citation
  • Centra, J.A., & Gaubatz, N.B. (2000). Is there a gender bias in student evaluations of teaching? Journal of Higher Education, 71(1), 1733. doi:10.2307/2649280

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chelladurai, P. (1992). Sport management: Opportunities and obstacles. Journal of Sport Management, 6, 215219. doi:10.1123/jsm.6.3.215

  • Cohen, P.A. (1980). Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings. Research in Higher Education, 13(4), 321341. doi:10.1007/BF00976252

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Collier, G.L. (2013, December 26). We pretend to teach, they pretend to learn. Wall Street Journal. https://www.wsj.com/articles/we-pretend-to-teach-they-pretend-to-learn-1388103868

    • Search Google Scholar
    • Export Citation
  • Commission on Sport Management Accreditation. (2019). COSMA statement of academic quality. Commission on Sport Management Accreditation. Retrieved from https://www.cosmaweb.org/academic-quality.html

  • Cope, C., & Staehr, L. (2005). Improving students’ learning approaches through intervention in an information systems learning environment. Studies in Higher Education, 30, 181197. doi:10.1080/03075070500043275

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cuneen, J. (2004). Managing program excellence during our transition from potential to merit. Journal of Sport Management, 18, 112. doi:10.1123/jsm.18.1.1

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Desilver, D. (2017, February). U.S. students’ academic achievement still lags that of their peers in many other countriesWashington, DC: PEW Research Center. Retrieved from http://www.pewresearch.org/fact-tank/2017/02/15/u-s-students-internationally-math-science/

    • Search Google Scholar
    • Export Citation
  • Draeger, J., Prado Hill, P., Hunter, L.R., & Mahler, R. (2013). The anatomy of academic rigor: The story of one institutional journey. Innovative Higher Education, 38, 267279. doi:10.1007/s10755-012-9246-8

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Draeger, J., Prado Hill, P., & Mahler, R. (2015). Developing a student conception of academic rigor. Innovative Higher Education, 40, 215228. doi:10.1007/s10755-014-9308-1

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1976). Grades and college students’ evaluation of their courses and teachers. Research in Higher Education, 4(1), 69111. doi:10.1007/BF00991462

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1977). Consistency and variability among college students in rating their teachers and courses: A review and analysis. Research in Higher Education, 6(3), 223274. doi:10.1007/BF00991288

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1978). Course characteristics and college students’ ratings of their teachers: What we know and what we don’t. Research in Higher Education, 9(3), 199242. doi:10.1007/BF00976997

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1983). Seniority and experience of college teachers as related to evaluations they receive from students. Research in Higher Education, 18(1), 3124. doi:10.1007/BF00992080

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1984). Class size and college students’ evaluations of teachers and courses: A closer look. Research in Higher Education, 21(1), 45116. doi:10.1007/BF00975035

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1986). The perceived instructional effectiveness of college teachers as related to their personality and attitudinal characteristics: A review and synthesis. Research in Higher Education, 24, 139213. doi:10.1007/BF00991885

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1987). Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration. Research in Higher Education, 26(3), 227298. doi:10.1007/BF00992241

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1989). The association between student ratings of specific instructional dimensions and student achievement: Refining and extending the synthesis of data from multisection validity studies. Research in Higher Education, 30(6), 583645. doi:10.1007/BF00992392

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1992). College students’ views of male and female college teachers: Part I—Evidence from the social laboratory and experiments. Research in Higher Education, 33(3), 317375. doi:10.1007/BF00992265

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (1993). College students’ views of male and female college teachers: Part II—Evidence from students’ evaluations of their classroom teachers. Research in Higher Education, 34(2), 151211. doi:10.1007/BF00992161

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Feldman, K.A. (2007). Identifying exemplary teachers and teaching: Evidence from student ratings. In R.P. Perry & J.C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 93129). Dordrecht, The Netherlands: Springer.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gigliotti, R.J., & Buchtel, F.S. (1990). Attributional bias and course evaluations. Journal of Educational Psychology, 82(2), 341351. doi:10.1037/0022-0663.82.2.341

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Graham, C., & Essex, C. (2001). Defining and ensuring academic rigor in online and on-campus courses: Instructor perspectives. Annual Proceedings of Selected Research and Development, 1, 330337.

    • Search Google Scholar
    • Export Citation
  • Hobson, S.M., & Talbot, D.M. (2001). Understanding student evaluations: What all faculty should know. College Teaching, 49(1), 2631. doi:10.1080/87567550109595842

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Howard, G.S., & Maxwell, S.E. (1980). The correlation between student satisfaction and grades: A case of mistaken causation? Journal of Educational Psychology, 72(6), 810820. doi:10.1037/0022-0663.72.6.810

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Howard, G.S., & Maxwell, S.E. (1982). Do grades contaminate student evaluations of instruction? Research in Higher Education, 16(2), 175188. doi:10.1007/BF00973508

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hoyt, D.P., & Lee, E. (2002a). Technical Report No. 12: Basic data for the revised IDEA systemManhattan, KS: The IDEA Center. Retrieved from https://www.ideaedu.org/Portals/0/Uploads/Documents/Technical-Reports/Basic-Data-Revised-IDEA-System_techreport-12.pdf

    • Search Google Scholar
    • Export Citation
  • Hoyt, D.P., & Lee, E. (2002b). Technical Report No. 13: Disciplinary differences in student ratingsManhattan, KS: The IDEA Center. Retrieved from https://ideacontent.blob.core.windows.net/content/sites/2/2020/01/Disciplinary-Differences-in-Student-Ratings_techreport-13.pdf

    • Search Google Scholar
    • Export Citation
  • Jacobs, J., & Colvin, R.L. (2009). Rigor: It’s all the rage, but what does it mean? In Hechinger Institute (Ed.), Understanding and reporting on academic rigor (pp. 15). New York, NY: The Hechinger Institute. Retrieved from http://hechinger.tc.columbia.edu/primers/Hechinger_Institute_Rigor_Primer.pdf

    • Search Google Scholar
    • Export Citation
  • James, J.D. (2018). Not all doctoral programs are created equally. Journal of Sport Management, 32(1), 110. doi:10.1123/jsm.2017-0257

  • Jensen, E. (2005). Teaching with the brain in mind (2nd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.

  • Johnson, J.E., Weidner, T.G., Jones, J.A., & Manwell, A.K. (2019). Evaluating academic course rigor, part 1: Defining a nebulous construct. Journal of Assessment and Institutional Effectiveness, 8(1–2), 86121. doi:10.5325/jasseinsteffe.8.12.0086

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kaplan, S.N. (2017). Advocacy: Defining academic rigor. Gifted Child Today, 40(4), 218219. doi:10.1177/1076217517723950

  • Kirst, M.W. (2009). Progress and gaps in college preparation policy. Education Commission of the States. Retrieved from https://www.ecs.org/clearinghouse/82/15/8215.pdf

    • Export Citation
  • Li, Y. (1993). A comparative study of Asian and American students’ perceptions of faculty teaching effectiveness at Ohio University (Unpublished doctoral dissertation). Ohio University, Athens.

    • Search Google Scholar
    • Export Citation
  • Mahony, D.F. (2008). No one can whistle a symphony: Working together for sport management’s future. Journal of Sport Management, 22, 110. doi:10.1123/jsm.22.1.1

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Marsh, H.W. (1987). Students’ evaluations of university teaching: Research findings, methodological issues, and directions for further research. International Journal of Education Research, 11(3), 253388. doi:10.1016/0883-0355(87)90001-2

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Marsh, H.W. (1989). Confirmatory factor analysis of multitrait-multimethod data: Many problems and a few solutions. Applied Psychology Measurement, 13(3), 335361. doi:10.1177/014662168901300402

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Marsh, H.W. (2001). Distinguishing between good (useful) and bad workloads on students’ evaluations of teaching. American Educational Research Journal, 38(1), 183212. doi:10.3102/00028312038001183

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Marsh, H.W. (2007). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. In R.P. Perry & J.C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 319383). Dordrecht, The Netherlands: Springer.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Marsh, H.W., & Dunkin, M.J. (1992). Students’ evaluations of university teaching: A multidimensional perspective. In J.C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 8, pp. 143234). New York, NY: Agathon Press.

    • Search Google Scholar
    • Export Citation
  • Marsh, H.W., & Dunkin, M.J. (1997). Students’ evaluations of university teaching: A multidimensional perspective. In R.P. Perry & J.C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 241320). New York, NY: Agathon Press.

    • Search Google Scholar
    • Export Citation
  • Marsh, H.W., & Hattie, J. (2002). The relation between research productivity and teaching effectiveness. Journal of Higher Education, 73(5), 603641.

    • Search Google Scholar
    • Export Citation
  • Marsh, H.W., & Hocevar, D. (1991). Students’ evaluations of teaching effectiveness: The stability of mean ratings of the same teachers over a 13-year period. Teaching & Teacher Education, 7(4), 303314. doi:10.1016/0742-051X(91)90001-6

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Marsh, H.W., & Roche, L.A. (2000). Effects of grading leniency and low workload on students’ evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology, 92(1), 202228. doi:10.1037/0022-0663.92.1.202

    • Crossref
    • Search Google Scholar
    • Export Citation
  • McKeachie, W.J. (1979). Student ratings of faculty: A reprise. Academe, 65(6), 384397. doi:10.2307/40248725

  • Naftulin, D.H., Ware, J.E., & Donnelly, F.A. (1973). The Doctor Fox lecture: A paradigm of educational seduction. Journal of Medical Education, 48(7), 630635. PubMed ID: 4708420

    • Search Google Scholar
    • Export Citation
  • Nelson, V. (2010). Is your college student investing enough time studying? College Parent Central. Retrieved from https://www.collegeparentcentral.com/2010/02/is-your-college-student-investing-enough-time-studying/

    • Export Citation
  • Olafson, G.A. (1995). Sport management research: Ordered change. Journal of Sport Management, 9, 338345. doi:10.1123/jsm.9.3.338

  • Park, G., Lubinski, D., & Benbow, C.P. (2008). Ability differences among people who have commensurate matter for scientific creativity. Psychological Science, 19(1), 957961. doi:10.1111/j.1467-9280.2008.02182.x

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Parkhouse, B.L. (1996). Definition, evolution, and curriculum. In Parkhouse, B.L. (Ed.), The management of sport: Its foundation and application (pp. 312). St. Louis, MO: Mosby Year Book.

    • Search Google Scholar
    • Export Citation
  • Payton, F.C., White, A., & Mullins, T. (2017). STEM majors, art thinkers (STEM + Arts)—Issues of duality, rigor and inclusion. Journal of STEM Education, 18(3), 3947.

    • Search Google Scholar
    • Export Citation
  • Renaud, R.D., & Murray, H.G. (1996). Aging, personality, and teaching effectiveness in academic psychologists. Research in Higher Education, 37(3), 223240. doi:10.1007/BF01730120

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rossman, G.B., & Wilson, B.L. (1996). Context, courses, and the curriculum: Local responses to state policy reform. Educational Policy, 10(3), 399422. doi:10.1177/0895904896010003005

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sixbury, G.R., & Cashin, W.E. (1995). IDEA Technical Report No. 10: Comparative data by academic fieldManhattan, KS: Kansas State University, Center for Faculty Evaluation and Development.

    • Search Google Scholar
    • Export Citation
  • Smith, B.P., & Hawkins, B. (2011). Examining student evaluations of black college faculty: Does race matter? The Journal of Negro Education, 80(2), 149162.

    • Search Google Scholar
    • Export Citation
  • Snider, J. (2009a). AP and IB courses: Are they truly rigorous? In Hechinger Institute (Ed.), Understanding and reporting on academic rigor (pp. 2125). New York, NY: The Hechinger Institute. Retrieved from http://hechinger.tc.columbia.edu/primers/Hechinger_Institute_Rigor_Primer.pdf

    • Search Google Scholar
    • Export Citation
  • Snider, J. (2009b). Two governors explain what they mean by ‘rigor.’ In Hechinger Institute (Ed.), Understanding and reporting on academic rigor (pp. 67). New York, NY: The Hechinger Institute. Retrieved from http://hechinger.tc.columbia.edu/primers/Hechinger_Institute_Rigor_Primer.pdf

    • Search Google Scholar
    • Export Citation
  • Stark, P.B., & Freishtat, R. (2014). An evaluation of course evaluations. ScienceOpen, 1, 126. doi:10.14293/S2199-1006.1.SOR-EDU.AOFRQA.v1

    • Search Google Scholar
    • Export Citation
  • Taylor, M.T., & Rendon, L.I. (1991). The American history curriculum in North Carolina’s public community colleges and universities: A comparative study. Community College Review, 19(1), 3641. doi:10.1177/009155219101900107

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Theall, M., Franklin, J., & Ludlow, L.H. (1990a). Attributions and retributions: Student ratings and the perceived causes of performance. Instructional Evaluation, 11, 1217.

    • Search Google Scholar
    • Export Citation
  • Theall, M., Franklin, J., & Ludlow, L.H. (1990b). Attributions and retributions: Student ratings and the perceived causes of performance. Paper presented at the American Educational Research Association, Boston, MA.

    • Search Google Scholar
    • Export Citation
  • Thomas, B., & Bolen, Y. (1998). Student perception of the academic rigor of the college physical education curriculum. Physical Educator, 55(1), 28.

    • Search Google Scholar
    • Export Citation
  • Trigwell, K., & Prosser, M. (1991). Improving the quality of student learning: The influence of learning context and student approaches to learning on learning outcomes. Higher Education, 22, 251266. doi:10.1007/BF00132290

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weese, W.J. (2002). Opportunities and headaches: Dichotomous perspectives on the current and future hiring realities in the sport management academy. Journal of Sport Management, 16, 117. doi:10.1123/jsm.16.1.1

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Weissberg, R. (2010). Bad students, not bad schoolsNew Brunswick, NJ: Transaction Publishers. Retrieved from http://www.heritageanddestiny.com/publications/reviews/bad-students-not-bad-schools-by-robert-weissberg-book-review/

    • Search Google Scholar
    • Export Citation
  • Winston, R.B., Vahala, M.E., Nichols, E.C., Gillis, M.E., Wintrow, M., & Rome, K.D. (1994). A measure of college classroom climate: The college classroom environment scales. Journal of College Student Development, 35(1), 1118.

    • Search Google Scholar
    • Export Citation
  • Wyatt, J.N., Wiley, A., Camara, W.J., & Proestler, N. (2011). The development of an index of academic rigor for college readiness. (Research Report 2010–2011). New York, NY: The College Board. Retrieved from https://files.eric.ed.gov/fulltext/ED561023.pdf

    • Search Google Scholar
    • Export Citation
  • Zakus, D., Malloy, D.C., & Edwards, A. (2007). Critical and ethical thinking in sport management: Philosophical rationales and examples of methods. Sport Management Review, 10(2), 133158. doi:10.1016/S1441-3523(07)70008-6

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 405 405 16
Full Text Views 9 9 0
PDF Downloads 7 7 0