Analyzing the Relationship Between Grade Inflation and Students’ Evaluation of University Professors’ Teaching

Subject Areas : Learning

Seyed Ahmad  Madani ¹ (Assistant Professor, Department of Educational Sciences, Faculty of Humanities, University of Kashan, Kashan, Iran.)
Ali  Ghasempour ² (Assistant Professor, Department of Educational Sciences, Faculty of Humanities, University of Payam Noor Tehran,, Iran)

Received: 2022-12-17 Accepted : 2023-05-08 Published : 2023-02-20

Keywords: Evaluation, Academic Achievement, Students, teaching, University teachers, teaching evaluation,

Abstract :

The purpose of this research was to investigate the relationship between students' academic progress scores and their evaluation of the university professors' teaching. The longitudinal design of this research is a panel study in which the necessary measurements are made over time and at specific intervals. The students studying in the three semesters were the statistical population of this research. The sample size was determined by GPower software and based on the type of statistical tests required. After screening more than one hundred thousand pairs of "student grade-teacher evaluation", the final analysis was performed on the data of 1970 students who had studied with a certain professor in three consecutive semesters. The tool for collecting the evaluation data of the professors was the official survey form of the institution in the intended semesters. The analysis showed that with the increase of the student’s final grade, his/her evaluation grade from the professor in the next semester increases significantly. Supplementary analysis showed that the effect of this initial score remains stable until two semesters late. It can be said that with a one-unit increase in students’ final grade, after two semesters, a significant increase between 1 and 4% in their evaluation grade from professors can be seen. The regression coefficients of the relationship between the grade point average of the whole class and the teaching evaluation of professors were also significant in the case of two consecutive semesters. Finally, the analyzes on the grades of the specialized and main courses of the students showed that compared to the past semesters, there is a grade inflation in the groups of humanities, literature, architecture and art. Based on this evidence, it is suggested that the phenomenon of grade inflation be considered from the point of view of its possible connection and interrelation with the way student evaluations are used in the employment and academic decisions of faculty members.

References:

شیخ الاسلامی، ندا.، یونسی، جلیل.، و دلاور، علی. (1400). پیامدهای تورم نمره در آموزش عالی و راهکارهای مقابله با آن. اندیشه های نوین تربیتی، 17(1 )، 7-38.

ضیایی، مسعود.، میری، محمدرضا.، حاجی آبادی، محمدرضا.، آذرکار، سیده قدسیه.، و پویا اشیک(1386). دیدگاه اساتید و دانشجویان دانشگاه علوم پزشکی بیرجند نسبت به ارزشیابی اساتید توسط دانشجو. مجله علمی دانشگاه علوم پزشکی بیرجند، 13(4)، 9-15.

کریمی، منوچهر.، و احمدی، سیدعلی اکبر. (1400). ارایه مدل شایستگی اختصاصی استادان دانشگاه. آموزش و ارزشیابی، 14 (53)، 159-180. 

محمدی خوانقاهی، محمد.، و حسین‌زاده، امیدعلی. (1394). تدوین و اعتباریابی مدل تدریس اثربخش برای اساتید دانشگاه تبریز. آموزش و ارزشیابی، 8 (31)، 71-91. 

کمالی، یحیی.، و پورچناری، عبدالله. (1394). بررسی ویژگی‌های استاد خوب از دیدگاه دانشجویان علوم سیاسی دانشگاه شهید باهنر کرمان. آموزش و ارزشیابی، 8 (30)، 117-140. 

محسن‌زاده کریمی، ساناز.، ادیب، یوسف.، و حسینی، محمدحسین. (1391). مقایسه عوامل آموزشی موثر بر کیفیت آموزشی دانشکده علوم انسانی دانشگاه آزاد اسلامی واحد تبریز از دیدگاه استادان و دانشجویان. فصلنامه علوم تربیتی، 5 (18)، 121-136.

هادی، رضا.، رضاپور، یوسف.، و سلمان‌پور، صدیقه. (1395). شاخص‌های سنجش کیفیت آموزش عالی بر اساس مدل کانو در دانشگاه ارومیه. آموزش و ارزشیابی، 9 (34)، 35-50.

یارمحمدزاده، پیمان.، فیضی، ایوب.، محمدیان، کویستان.، آق‌آتابای، آمنه. (1396). رابطه ویژگی‌های شخصیت و سبک رهبری کلاس درس با کیفیت تدریس اساتید دانشگاه به روش خودارزیابی، ارائة یک مدل ساختاری. آموزش و ارزشیابی، 10 (39)، 29-51.

Adams, Gary. L., & Engelmann, Siegfried. (1996). Research on Direct Instruction: 25 Years Beyond DISTAR. Seattle: Educational Achievement Systems.

Addison, W. E., Best, J., & Warrington, J. D. (2006). Students’ perceptions of course difficulty and their ratings of the instructor. College Student Journal, 40 (-): 409-416.

Alauddin, M., & T. Kifle. (2014). Does the Student Evaluation of Teaching Instrument Really Measure Instructors’ Teaching Effectiveness? An Econometric Analysis of Students’ Perceptions in Economics Courses. Economic Analysis and Policy, 44(2): 156-168. doi:10.1016/j.eap.2014.05.009.

Atanasio, M., & Capursi, V. (Editors), (2011) Statistical Methods for the Evaluation of University Systems. Berlin, Heidelberg: Springer. 

Bachen, Christine. M., McLoughlin, Moira. M., & Garcia, Sara. S. (1999). Assessing the role of gender in college students’ evaluations of faculty. Communication Education, 48(3): 193-210.

Bar, T., Kadiyali, V., & Zussman, A. (2009). Grade Information and Grade Inflation: The Cornell Experiment. The Journal of Economic Perspectives, 23(3): 93-108.

Beenstock, M., & Feldman, D. (2016). Decomposing university grades: a longitudinal study of students and their instructors. Studies in Higher Education, DOI: 10.1080/03075079.2016.1157858

Beran, T., & Violato, C. (2009). Student ratings of teaching effectiveness: Student engagement and course characteristics. Canadian Journal of Higher Education, 39(1): 1-13.

Berezvai, Z., Lukats, Gergely. D., & Molontay, R. (2020). Can professors buy better evaluation with lenient grading? The effect of grade inflation on student evaluation of teaching. Assessment & Evaluation in Higher Education, DOI:10.1080/02602938.2020.1821866

Boysen, Guy. A., Kelly, Timothy. J., Raesly, Holly. N., & Casner, Robert. W. (2014). The (mis)interpretation of teaching evaluations by college faculty and administrators, Assessment & Evaluation in Higher Education, 39(6): 641-656.

Buller, Jeffrey. L. (2012). Best practices in faculty evaluation: A Practical guide for academic leaders. San Francisco. Jossey-Bass.

Brookhart, Susan. M. (2016). A Century of Grading Research: Meaning and Value in the Most Common Educational Measure. Review of Educational Research, Vol. XX, No. X, pp. 1–46. 

Carey, Th., & Carifio, J. (2012). The Minimum Grading Controversy: Results of a Quantitative Study of Seven Years of Grading Data from an Urban High School. Educational Researcher, 41(6): 201-208.

Chowdhury, F. (2018). Grade Inflation: Causes, Consequences and Cure. Journal of Education and Learning, 7(6): 86-92.

Chang, K., & Coutinho, Lucas de Lemos. (2021). Administering Homework Self-Grading for an Engineering Course. College Teaching, DOI: 10.1080/87567555.2021.1957666

Clayson, D. E. (2009). Student evaluations of teaching: Are they related to what students learn? A meta-analysis and review of the literature. Journal of Marketing Education, 31(1): 16-30.

Coffey, M., & Gibbs, G. (2001). The Evaluation of the Student Evaluation of Educational Quality Questionnaire (SEEQ) in UK Higher Education. Assessment & Evaluation in Higher Education, 26(1): 89-93.

Cunningham, Samuel., Laundon, Melinda., Cathcart, Abby., Bashar, Md Abul., & Nayak, Richi. (2022). First, do no harm: automated detection of abusive comments in student evaluation of teaching surveys. Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2022.2081668

Danielson, Charlotte., & McGreal, Thomas. L. (2000). Teacher evaluation to enhance professional practice. Princeton, NJ: Association for Supervision and Curriculum Development.

Felix, E. D., Binmoeller, C., Sharkey, J. D., Dowdy, E., Furlong, M. J., & Latham, N. (2018). The influence of different longitudinal patterns of peer victimization on psychosocial adjustment. Journal of School Violence, 1-15.

Gerzeli, Simone. (2011). The Impact of Teaching Evaluation: Factors that Favour Positive Views from Student Representatives. In: Massimo Attanasio & Vincenza Capursi (Editors), Statistical Methods for the Evaluation of University Systems. Berlin, Heidelberg: Springer. 

Golzio, Luigi. Enrico. (2011). The Assessment of University Teaching by Students: The

Hadi, R., Rezapoor, Y., & salmanpoor, S. (2016). Evaluation Indexes in Higher Education Based on Kano`s Model at Urmia University. Journal of Instruction and Evaluation, 9(34): 35-50 [In Persian].

Hailperirn, Mlax. (1982). SCC worth jumps despite cash logs. The Tech, 102(1): 1-24.

Harris, Gregory. A. (2011). The Impact of Hidden Grades on Student Decision-Making and Academic Performance: An Examination of a Policy Change at MIT. Toronto, Ontario: AIR Forum. 

Hattie, John. (2009). Visible learning: A synthesis of over 800 meta-analysis relating to achievement. New York: Routledge.

Herman, Joan., & Cook, Linda. (2019). Fairness in Classroom Assessment. In: Susan Brookhart & James McMillan (Editors): Classroom Assessment and Educational Measurement. New York: Routledge.

Jephcote, C., Medland, E., & Lygo-Baker, S. (2020). Grade inflation versus grade improvement: Are our students getting more intelligent? Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2020.1795617

Johnson, R. Burke., & Christensen, Larry. (2016). Educational research: Quantitative, qualitative, and mixed approaches. Los Angleles: Sage.  

Kaplan, D. S., Liu, X., & Kaplan, H. B. (1995). Explaining Dropout Behavior: A Longitudinal Study of Direct and Indirect Psychosocial Effects of Seventh and Eighth Grade Experiences. Educational Research and Evaluation, 1(3): 205-225.

Karimi, M., and Ahmadi S. (2021) Providing Exclusive Competency Model for University Faculty Members. Journal of Instruction and Evaluation, 14(53): 159-180. [In Persian].

Kamali, Y., Pourchenary, A. (2015). The Characteristics of a Good Teacher from the Political Sciences Students’ Point of view at Shahid Bahonar University of Kerman. Journal of Instruction and Evaluation, 8(30): 21179-140. [In Persian].

Lakeman, Richard., Coutts, Rosanne., Hutchinson, Marie., Lee, Megan., Massey, Debbie., Nasrawi, Dima., & Fielden, Jann. (2021). Appearance, insults, allegations, blame and threats: an analysis of anonymous non-constructive student evaluation of teaching in Australia, Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2021.2012643

Landrum, R. Eric., & Braitman, Keli. A. (2008). The effect of decreasing response options on students' evaluation of instruction. College Teaching, 56(4): 215-217.

Lastusaari, Mika., Laakkonen, Eero., & Murtonen, Mari. (2019). Persistence in studies in relation to learning approaches and first-year grades: a study of university chemistry students in Finland. Chem Educ. Res. Pract, 20(3): 452-467.

Linse, Angela. R. (2016). Interpreting and using student ratings data: Guidance for faculty serving as administrators and on evaluation committees. Studies in Educational Evaluation, 54: 94-106. 

Maamari, B. E., & Naccache, H. S. (2022). The impact of grade inflation on teachers’ evaluation: A quantitative study conducted in the context of five Lebanese universities. Journal of Global Education and Research, 6(2): 192-205.

Mackinnon, Sean. P., & Kashif, Shazia. (2022). A Short History of Grading Practices at Dalhousie University (1901-2021). PeerRef, 10.35542/osf.io/fmgv8

Marsh, Herbert. W. (1977). The Validity of Students’ Evaluations: Classroom Evaluations of Instructors Independently Nominated as Best and Worst Teachers by Graduating Seniors. American Educational Research Journal, 14(4): 441.

Marsh, Herbert. W., & Overall, Jesse. U., & Kesler, Steven. P. (1979). Long-Term Stability of Students’ Evaluations: A Note on Feldman’s “Consistency and Variability among College Students in Rating Their Teachers and Courses. Research in Higher Education, 10(2): 139–147.

Marsh, Herbert. W. (1982). Factors Affecting Students' Evaluations of the Same Course Taught by the Same Instructor on Different Occasions. American Educational Research Journal, 19(4): 485-497.

Marsh, Herbert. W. (2001). Distinguishing between Good (Useful) and Bad Workloads on Students’ Evaluations of Teaching. American Educational Research Journal, 38(1): 183-212.

Marsh, Herbert. W. (1977). The Validity of Students’ Evaluations: Classroom Evaluations of Instructors Independently Nominated as Best and Worst Teachers by Graduating Seniors. American Educational Research Journal, 14(4): 441-447.

Marsh, Herbert. W., & Roche, Lawrence. (1993). The Use of Students' Evaluations and an Individually Structured Intervention to Enhance University Teaching Effectiveness. American Educational Research Journal, 30(1): 217-251.

McEwan, Patrick. j., & et al. (2006). Roommate effects on grades: evidence from first-year housing assignments. Research in higher education, 47(3): 347-370.

McMillan, Amy., Solanelles, Pol., & Rogers, Bryan. (2021). Bias in student evaluations: Are my peers out to get me? Studies in Educational Evaluation, 70 (101032): 1-11. 

Marshall, Kim. (2009). Rethinking teacher supervision and evaluation: How to work smart, build collaboration, and close the achievement gap. San Francisco: Jossey-Bass.

Marshall, Pablo. (2022). Contribution of open-ended questions in student evaluation of teaching. Higher Education Research & Development, 4(6): 1992-2005.

Martínez, José. Felipe., Schweig, Jonathan., & Goldschmidt, Pete. (2016). Approaches for Combining Multiple Measures of Teacher Performance: Reliability, Validity, and Implications for Evaluation Policy. Educational Evaluation and Policy Analysis, 38(4): 738-756.

Mengel, Friederike., Sauermann, Jan., & Zolitz, Uif. (2019). Gender Bias in Teaching Evaluations. Germany: IZA Institute of Labor Economics.

MIT. (2000). Freshman pass/no record grading and advanced placement policy: Report of a special subcommittee on the Committee on the Undergraduate Program. Cambridge, Massachusetts: The Massachusetts Institute of Technology.

Mohammadi khanghahi, M., & Hosinzadeh, O. (2015) Presenting and Verifying an Effective Teaching Model for Teachers at Tabriz University. Journal of Instruction and Evaluation, 8(31): 71-91 [In Persian].

Mohsenzade karimi, S., Adib, y., & Hoseini, M. (2012). The comparison study of educational factors affecting the educational quality of human science faculty from professors and student’s points of view, Tabriz Islamic Azad University, Journal of Instruction and Evaluation, 5(18): 121-136. [In Persian].

Morin, A. J. S., & Marsh, H. W. (2014). Disentangling Shape from Level Effects in Person-Centered Analyses: An Illustration Based on University Teachers’ Multidimensional Profiles of Effectiveness. Structural Equation Modeling: A Multidisciplinary Journal, 22(1): 39-59.

Muller-Benedict, Volker., & Gaens, Thomas. (2020). A new explanation for grade inflation the long-term development of German university grades, European Journal of Higher Education, DOI: 10.1080/21568235.2020.1718516

Nevid, Jeffrey. S. (2018). Essentials of Psychology: Concepts and Applications. Australia: CENGAGE Learning.

Nolan, James. H., & Hoover, Linda. A. (2008). Teacher supervision & Evaluation: Theory into Practice. Wiley.

Park, Byungjin., & Cho, Joonmo. (2022). How does grade inflation affect student evaluation of teaching? Assessment & Evaluation in Higher Education, DOI: 10.1080/02602938.2022.2126429

Radmacher, Sally. A., & Martin, David. J. (2001). Identifying Significant Predictors of Student Evaluations of Faculty Through Hierarchical Regression Analysis. The Journal of Psychology: Interdisciplinary and Applied, 135(3): 259-268.

Reed, W. R., & Ye, H. (2011). Which panel data estimator should I use? Applied Economics, 43(8): 985-1000.

Schmelkin, Liora. Pedhazur., Spencer, Karin. J., & Gellman, Estelle. S. (1997). Faculty Perspectives on Course and Teacher Evaluations. Research in Higher Education, 38(5): 575-592.

Sheikholeslami, N., Younesi, J., & Delavar. Ali (2021). The consequences of grade inflation in higher education and the strategies to deal with it. Quarterly Journal of New Thoughts on Education. Journal of Instruction and Evaluation, 14(1): 7-38. [In Persian].

Spooren, P., & Christiaens, W. (2017). I liked your course because I believe in (the power of) student evaluations of teaching (SET). Students’ perceptions of a teaching evaluation process and their relationships with SET scores. Studies in Educational Evaluation, 54: 43-49.

Uttl, B., White, C. A., & Gonzalez, D. W. (2017). Meta-analysis of faculty’s teaching effectiveness: Student evaluation of teaching ratings and student learning are not related. Studies in Educational Evaluation, 54: 22-42.

Wilson, Mark. (2019). Emerging Issues in Classroom Assessment. In: Susan Brookhart & James McMillan (Editors): Classroom Assessment and Educational Measurement. New York: Routledge.

Yarmohammadzadeh, P., Feyzi, A., Mohamadian, K., & Aghatabay, A. (2017). Investigating the Relationship among University Teachersʼ personality Traits, Classroom Leadership Style, and Efficacy through Self-Evaluation: Providing a Structural Model. Journal of Instruction and Evaluation, 10(39): 29-51 [In Persian].

Yorke, Mantz. (2008). Grading Student Achievement in Higher Education: Signals and Shortcomings. London: Routledge.

Ziaee, M., Miri, M., Shima. Hajiabadi, M., Azarkar, S., & Ashik, p. (2008). ZiaSurveying Birjand faculty members’, paramedical and nursing students' viewpoints on educational evaluation plan. Journal of Instruction and Evaluation, 13(4): 9-15 [In Persian].