The Validity and Reliability of Teaching Evaluation Questionnaire among High School Students
Subject Areas : Research in Curriculum Planning
reza jafariharandi
1
,
Susan Bahrami
2
1 - Associate Professor in Educational Sciences Department, Literature & Human Sciences Faculty, University of Qom, Qom, Iran.
2 - Assistant Professor in Educational Sciences Department, Literature & Human Sciences Faculty, University of Qom, Qom, Iran.
Keywords: reliability, Teaching Evaluation Questionnaire, validity, high school students,
Abstract :
The purpose of this study was to evaluate the validity and reliability of a teaching evaluation questionnaire among high school students. The research method is descriptive-analytical and its approach is applied. The study population was all first grade students in Isfahan in the academic year of 2018- 2019. The sample consisted of 380 first grade high school students (198 girls, 182 boys) who were selected by multistage stratified random sampling. The research tool was Camber & Long (2008) Teaching Evaluation Questionnaire. Data were analyzed using mean, standard deviation, face validity, content validity, factor analysis, correlation of items with total score, correlation of components with each other and with total, internal consistency with Cronbach's alpha coefficient, and test-retest. Based on the results, the Teaching Evaluation Questionnaire has 9 components and 49 items and has good validity, reliability and fitness in psychometric evaluation. The confirmatory factor structure confirmed the proposed nine-factor model. In other words, face validity, content, factor, item correlation and component correlation, effective teaching questionnaire were confirmed. The overall reliability and reliability of the nine components of the questionnaire were also confirmed. Therefore, the effective teaching questionnaire, due to the robustness of the factor structure and the appropriate psychometric properties, is usable by other researchers and is recommended for use in teaching evaluation.
Adolmaleki, S, Maleki, H, Asadi, F, (2018), Identifying the Components of Effective Teaching of Curriculum Teachers from the Students' Viewpoints, Research in Curriculum, 15(59): 95-114 [Persian].
Alavi, M, Abedi H A, (2008), Nursing Students' Experiences and Perceptions of the Concept of Effective Instructor in Clinical Education, Iranian Journal of Medical Education, 7(7): 325-224[Persian].
Asadi, M, Gholami, KH, (2016), Research synthesis on the model of effective teaching in higher education, Educational Planning Studies Bi-annual, spring and summer, 5(9) [Persian].
Asadi, M, Gholami, KH, Boland Hematian, K, (2015), Fundamental Factors and Components of Effective Teaching from the Perspective of Students and Faculty Members of Kurdistan University, New Educational Thoughts, 11(1): 123-149[Persian].
Asgari, F, Magob Moaadab, H, (2011), Comparing the Effective Teaching Characteristics from the Viewpoints of Guilan University of Medical Sciences Teachers and Students, Developmental Steps in Medical Education, 1(5): 26-33Persian].
Berami Pour, A, Liaghat Dar, M J, (2010), Evaluation of the quality of teaching fourth grade elementary school mathematics in Isfahan city in order to provide solutions for improving students' performance in Thames
International Examination, New Age Education Quarterly, 100: 49-68 [Persian].
Bloom, B, (2004), Human Characteristics and School Learning, Translation, Ali Akbar Seif, Tehran: University Publishing Center [Persian].
Brown, G., & Atkins, M. (2002). Effective teaching in higher education. Routledge, Taylor & Francis Group: London.
Chappell, M.F. (2003). “Keeping Mathematics front and Center: Reaction to Middle-Grades Curriculum Projects Research”. In S.L. Senk & D.R. Thompson (Eds.), Standards-Based School Mathematics Curricula. What are They? What Do Students Learn? (pp. 285-298). Lawrence Erlbaum Associates: NJ.
David Kember & Doris Y.P. Leung (2008) Establishing the validity and reliability of course evaluation questionnaires, Assessment & Evaluation in Higher Education, 33:4, 341-353.
David Kember, Amaly Ho, Doris Y.P. Leung. (2016) Evaluating taught postgraduate awards from the student’s perspective. Journal of Further and Higher Education 40:2, pages 147-169.
Dennis C.S. Law. (2013) Shortening the Inventory of Learning Styles for quality assurance in a Hong Kong post-secondary education context. Quality in Higher Education 19:3, pages 300-325.
Dev, P.C. (1998). “Intrinsic Motivation and the Student with Learning Disability”. Journal of Research and Development in Education, 31(2): 98-108.
Driscoll, M.P. (1994). “Psychology of Learning for Instruction”. Boston, MA: Allyn & Bacon Publishers.
Eisner, E. (1979). The educational imagination, MacMillan Publishing Company, New York.
Fenstermacher, G. D & Soltis, J. F; (2009). Approches to teaching. New York: Teacher college press.
Eslamian, H, (2015), Developing components and indicators of effective teaching for use by law professors, Management Studies on Law enforcement Knowledge, 8(3): 93-114[Persian].
Fathi Azar, A, (2004), Teaching methods and techniques, Tabriz: Tabriz University Press, [Persian].
Gage, Nathaniel Liz (1995). The Scientific Basis of the Art of Teaching, translated by Mahmoud Mehr Mohammadi, Tehran: School Publications. [Persian].
Gashtmard, R, Motamedi, N, Vahedparast, h, (2012), Viewpoints of Professors and Students of Bushehr University of Medical Sciences about the Characteristics of a Good Professor, Iranian Journal of Medical Education, 1(11): 48-57 [Persian].
Ghorbani, R, Hagi Aghaei, S, Hydari Far, M, Andadeh, F, Shams Abadi, M, (2009), Investigating the Viewpoints of Students of Nursing and Paramedical Faculty of Semnan University of Medical Sciences about the Characteristics of a Good Academic Professor, Journal of Semnan University of Medical Sciences, 1(2): 77-84[Persian].
Gottfried, A.E., Fleming, J.S., & Gottfried, A. W. (2001). “Continuity of Academic Intrinsic Motivation from Childhood Through Late Adolescence: A Longitudinal Study”. Journal of Educational Psychology, 93(1): 3-13.
Gurney, P. (2007). Five Factors for Effective Teaching. New Zealand Journal of Teachers’ Work. 4 (2), 89-98.
Haghi Aghakhani, S, (2002), Comparison and Evaluation of Faculty and Student Views on the Criteria of a Good Academic Professor, Journal of Medicine and Cultivation, 1(41), 47 [Persian].
Halat, E. (2006). “Sex-Related Differences In The Acquisition Of The Van Hiele Levels And Motivation In Learning Geometry”. Asia Pacific Education Review, 7 (2): 173-183.
Harandizadeh, A, Naeimi, A, Rad, GH R, Namdar, R, (2010). Investigating the Characteristics of a Good Teacher from the Viewpoints of College Students, Journal of Research and Planning in Higher Education, 1 (2), 41-55 [Persian].
Heshmati Nabavi, F, Vanaki, Z, (2010), Effective clinical instructor: A qualitative study, nursing research, 12, 13, 39-53 [Persian].
Hirst, P. (1974). Knowledge and the curriculum: A collection of philosophical papers. London: Routledge and Kegan Paul.
Hu, L. & Bentler, P.(1999). Cut off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
Joseph F. Callahan; Leonard H. Clark, (2014), Secondary education. Translator, Javad Tahourian, Mashhad: Astan Quds Razavi, Good publishing [Persian].
Justin D. Cochran, Hope M. Baker, Debbie Benson, Wes Rhea. (2016) Business Student Perceptions of Online Learning: Using Focus Groups for Richer Understanding of Student Perspectives. Organization Management Journal 13:3, pages 149-166.
Keller, J.M. (1999). “The ARCS Mode”l. Designing Motivating Instruction. Tallahassee, FL: John Keller Associates.
Kheir, M, (2002), Evaluating effective teaching in higher education with emphasis on student evaluation. Education and psychology, 1(3): 93-114 [Persian].
Khodaei, S, (2012), Evaluation of the Effectiveness of the Effective Teaching Indicators by the Mathematics Teachers of Isfahan Middle School Students in the Academic Year (2011-2012), MA thesis Islamic Azad University of Meyme [Persian].
Lauren McClain, Angelika Gulbis, Donald Hays. (2017) Honesty on student evaluations of teaching: effectiveness, purpose, and timing matter!. Assessment & Evaluation in Higher Education 0:0, pages 1-17.
Lawrence Ang, Yvonne Alexandra Breyer, Joseph Pitt. (2016) Course recommendation as a construct in student evaluations: will students recommend your course?. Studies in Higher Education 0:0, pages 1-20.
Liaghtdar, MJ, Mehdian, M, Amini, (2017), Application of Markers for Effective Teaching of Mathematics in Isfahan High Schools, Research in Curriculum, 14 (55), 24-38 [Persian].
Lyn Alderman, Stephen Towers, Sylvia Bannah. (2012) Student feedback systems in higher education: a focused literature review and environmental scan. Quality in Higher Education 18:3, pages 261-280.
Mahdian, M, (2010). Investigating the Application of Markers for Effective Teaching in Mathematics of Talented, Nonprofit, Governmental Schools of Isfahan from the Students' Viewpoint, Isfahan: Islamic Azad University of Khorasgan [Persian].
Mansouri, M, (1992), Comparison of the opinions of postgraduate and undergraduate students of public universities in Tehran about a good university professor, Tehran: Iran University of Medical Sciences. [Persian].
Middleton, J.A., & Spanias, P. (1999). “Motivation for Achievement in Mathematics: Findings, Generalizations, and Criticisms of the Recent Research”. Journal for Research in Mathematics Education, 30(1): 65-88.
Mirza Beigi, A, (2001), Curriculum Planning and Curriculum in Formal Training and Human Resource Training in Tehran: Citron Publishing. [Persian].
Mohaddessi, H, Feizi, A, Salem Safi, R, (2011), Comparative Study of Effective Teaching Indicators from the Viewpoints of Faculty Members and Students of Urmia University of Medical Sciences, Urmia School of Nursing and Midwifery 2 (6): 471-464 [Persian].
Mohamadi Khaneghah, M, Hossen Zadeh, A A, (2015), Developing and validating an effective teaching model for Tabriz University professors. Journal of Education and Evaluation, 8(31), 77-91 [Persian].
Moussipour, N, (2004), The concept of teaching and its fundamental questions. Developmental steps in medical education, 1 (1), 56-48 [Persian].
Mozafari, N, Mohammadi, M, Dadkhah, B, (2010), Characteristics of Effective Teaching from the Viewpoints of Students of Ardabil University of Medical Sciences, Journal of Faculty of Nursing and Midwifery, 1 (11): 61-69 [Persian].
Nasri, S, (2002), Investigating the Relationship between Mathematical Performance and Some Psychological Variables in Students, Proceedings of the 6th Conference of Mathematical Education, Shiraz: Fars Province Education Organization. [Persian].
Nasiriani, KH, Vanaki Z, Ahmadi, F, (2011), Explaining the Characteristics of an Effective Clinical Supervisor: A Qualitative Study, Urmia School of Nursing and Midwifery, 1 (2), 285-274 [Persian].
National Center for International Studies of Thames and Pearls, (2008), An Analysis of the Results and Findings of National and International Thames Studies. Research Institute of Education [Persian].
Pey-Tee Oon, Benson Spencer, Dr. Chester Chun Seng Kam. (2017) Psychometric quality of a student evaluation of teaching survey in higher education. Assessment & Evaluation in Higher Education 42:5, pages 788-800.
Ramezani, T, Dartag Ravi, A, (2010), Characteristics of an Effective Teacher and Educational Factors Influencing His Effectiveness from the Viewpoints of Teachers and Students of Kerman University of Medical Sciences. Strides in Development of Medical Education, 1(2), 139-148 [Persian].
Reeve, J. (1986). “Motivating Others: Nurturing Inner Motivational Resources”. Needham Heights, MA: Allyn & Bacon.
Sakarneh, M. AbuNair, N. (2014). Effective Teaching in Inclusive Classroom: Literature Review. Journal of Education and Practice. 5 (24). 28-34.
Salehi, Sh, (2002), Effective teaching. Shahrekord University of Medical Sciences Journal,1(2): 12-21 [Persian].
Schumacker, R. E., & Lomax, R.G. (1996). A beginner’s guide to structural equation modeling. New Jersey: Lawrance Erlbaum Association.
Shabani, H, (2010), Education skills (teaching methods and techniques), Tehran: Post Publications. [Persian].
Shahraki, M R, (2011), The criteria of a good professor from the perspective of medical professors and students. Zahedan Journal of Medical Sciences Research, 1(48): 1-11 [Persian].
Shariatmadari, A, (2000), Principles and Philosophy of Education. Tehran: Amir Kabir Publications. [Persian].
Sharifian, F, (2008), Investigating and Explaining the Indicators of Effective Teaching in Higher Education Institutions and its Research at Isfahan University. Isfahan: Faculty of Education, University of Isfahan [Persian].
Shayesteh Fard, S, Hoshyari, M, Khezny, H, (2004), Investigating Effective Teaching Indicators from the Perspective of Students and Students of Ahvaz University of Medical Sciences, Iranian Journal of Medical Education, 1(2): 34-43 [Persian].
Shultz, K. S., & Whitney, D. J. (2005). Measurement theory in action: case studies and exercises. Sage Publications. p. 68–70.
Shykhzadeh, Mm (2010), Effective Teaching Indicators from the Viewpoint of Students of Islamic Azad University of Urmia Branch, Higher Education Letter, 1(10: 141-157 [Persian].Shoari Nezhad, A, (1997), Philosophy of Education. Tehran: Amirkabir Publications. [Persian].
Silver, J, Gallen, Alexander, William, M, Lewis, Arthur, J, (2008), Curriculum for Teaching and Learning Better Translator, Gholam Reza Khoynejad, Mashhad: Astan Qods Publications, Good Publishing. [Persian].
Soltani Aranshahi, S K, Ghaderi, A, (2001), Developing an Effective Teaching Index: Characteristics of Effective Teaching from the Perspectives of Students and Students of Basic Sciences Center of Iran University of Medical Sciences and Health Services, Razi Medical Sciences (Iran University of Medical Sciences Journal), 7(22): 279-287 [Persian].
Stipek, D. (1998). “Motivation to Learn from Theory to Practice”. (3rded.). Needham Heights, MA: Allyn & Bacon A Viacom Company.
Syef, A, (2004), Educational Psychology, Tehran: Agah Publications. [Persian].
Tofighian, T, Monadi,H, Nasrolahi, S, Rakhshani, M H, (2015), Prioritizing Effective Teaching Indicators; Comparison of Students and Professors Viewpoints of Sabzevar University of Medical Sciences, Education Strategies in Medical Sciences, 8(10): 1-6[Persian].
Thomas S. Ting C. Q. Abraham M. Jalarajan R. S. Beh L. S. (2014). A Qualitative Review of Literature on Peer Review of Teaching in Higher Education: An Application of the SWOT Framework Review of Educational Research, 84 (1). 112–159.
Twan Huybers. (2014) Student evaluation of teaching: the use of best–worst scaling. Assessment & Evaluation in Higher Education 39:4, pages 496-513.
Twan Huybers. (2017) Exploring the use of best-worst scaling to elicit course experience questionnaire responses. Assessment & Evaluation in Higher Education 42:8, pages 1306-1318.
Waltz CF, Strickland OL, Lenz ER. Measurement in nursing and health research: Springer Publishing Company; 2010.
Wentzel, K.R. (1997). “Students Motivation in Middle School: The Role of Perceived Pedagogical Caring”. Journal of Educational Psychology, 89(3): 411-419.
Yaghoubi, E, Pour Moghaddam, FH, (2012), Investigating Characteristics of Effective Teaching from the Perspective of Students at Langrood Nursing and Midwifery Faculty, Research in Medical Education, 1 (2), 40-34 [Persian].
Young, S., & Shaw, D. G. (1999). Profiles of effective college and university teachers. Journal of Higher Education, 1 (1). 670-686.
Young-Loveridge, J. (2005). “The Impact of Mathematics Education Reform in New Zealand: Taking Children’s Views into Account”. In P. Clarkson, A. Downton, D. Gronn, M. Horne, A. McDonough, R. Pierce, A. Roche (Eds), Proceedings of MERGA28. (Vol.1, pp. 18-33). Sydney, Australia.
Zohor, A R, Eslami Nezhad, T, (2003), Effective Teaching Indicators from the Viewpoints of Students of Kerman University of Medical Sciences, 1(2): 5-13[Persian].
Zhou, H., Liu, M., Zeng, J., & Zhu, J. (2016). Selection of nursing teaching strategies in mainland China: A questionnaire survey. Nurse education today. 1(39), 147-151.
_||_