The Effect of Learning-Oriented Assessment on EFL Learners’ Peer and Self-Rating Accuracy of Reading Comprehension Tasks: A Mixed-Methods Study

محورهای موضوعی : نشریه تخصصی زبان، فرهنگ، و ترجمه (دوفصلنامه)

Pegah Doroudi ¹ , Mohammad Taghi Farvardin ² , Ghafour Rezaie Golandouz ³

1 - Ph.D. Candidate, Department of Foreign Languages Teaching, SR. C., Islamic Azad University, Tehran, Iran
2 - Assistant Professor, Department of Foreign Languages Teaching, Ahv. C., Islamic Azad University, Ahvaz, Iran
3 - Assistant Professor, Department of Foreign Languages Teaching, SR. C., Islamic Azad University, Tehran, Iran

تاریخ دریافت : 1404/03/12 تاریخ پذیرش : 1404/06/15 تاریخ انتشار : 1404/06/16

کلید واژه: Learning-oriented assessment, Peer rating accuracy, Perceptions of assessment, Reading comprehension, Self-rating accuracy,

چکیده مقاله :

Learning-oriented assessment (LOA) is a method that integrates assessment into the educational process, with a focus on formative feedback and collaborative engagement. However, the practical efficacy of LOA in improving the accuracy of self- and peer ratings in an English as a foreign language (EFL) context has not yet been examined. Therefore, this study, following an explanatory sequential mixed-methods design, explored the role of LOA in the self- and peer rating accuracy of intermediate EFL learners. To this end, 57 intermediate EFL learners were non-randomly divided into an experimental and a control group. Over a 10-week intervention, participants in the experimental group (n = 28) completed LOA tasks, including rubric-guided self-/peer-rating of reading comprehension and strategy-oriented feedback; the control group (n = 29) followed conventional summative assessments for the same period. Pre/posttests self- and peer rating accuracy measures (Δ scores = |learner rating – teacher rating|) were calculated using independent and paired samples t-tests. Ten semi-structured interviews were also thematically analyzed. The interviews were coded by two coders, and then the inter-coder agreement was calculated. The Cohen’s kappa coefficient of .89 indicated acceptable reliability. The quantitative analysis showed that the experimental group’s self-rating and peer rating accuracy significantly improved. The control group, however, showed no significant change. Additionally, the thematic analysis revealed five emergent themes: self-rating as a tool for metacognitive growth, peer rating as a collaborative learning opportunity, ambiguity in rubric application, emotional barriers to honest self-assessment, and desire for structured guidance. The findings indicate that LOA can significantly enhance rating accuracy.

چکیده انگلیسی:

Learning-oriented assessment (LOA) is a method that integrates assessment into the educational process, with a focus on formative feedback and collaborative engagement. However, the practical efficacy of LOA in improving the accuracy of self- and peer ratings in an English as a foreign language (EFL) context has not yet been examined. Therefore, this study, following an explanatory sequential mixed-methods design, explored the role of LOA in the self- and peer rating accuracy of intermediate EFL learners. To this end, 57 intermediate EFL learners were non-randomly divided into an experimental and a control group. Over a 10-week intervention, participants in the experimental group (n = 28) completed LOA tasks, including rubric-guided self-/peer-rating of reading comprehension and strategy-oriented feedback; the control group (n = 29) followed conventional summative assessments for the same period. Pre/posttests self- and peer rating accuracy measures (Δ scores = |learner rating – teacher rating|) were calculated using independent and paired samples t-tests. Ten semi-structured interviews were also thematically analyzed. The interviews were coded by two coders, and then the inter-coder agreement was calculated. The Cohen’s kappa coefficient of .89 indicated acceptable reliability. The quantitative analysis showed that the experimental group’s self-rating and peer rating accuracy significantly improved. The control group, however, showed no significant change. Additionally, the thematic analysis revealed five emergent themes: self-rating as a tool for metacognitive growth, peer rating as a collaborative learning opportunity, ambiguity in rubric application, emotional barriers to honest self-assessment, and desire for structured guidance. The findings indicate that LOA can significantly enhance rating accuracy.

منابع و مأخذ:

Al-Abri, A., Ranjbaran Madiseh, F., & Morady Moghaddam, M. (2025). Exploring learning-oriented assessment in enhancing students’ lexical fluency through MALL. The Asia-Pacific Education Researcher, 34(1), 1–13.https://doi.org/10.1007/s40299-024-00832-7
Allan, D. (1992). Oxford placement test. Oxford University Press.
Al-Rashidi, A. H., Asif, M., Vanani, M. G., & Aberash, A. (2022). Learner-oriented assessment (LOA) practice: the comparative study of self-assessment, peer-assessment, and teacher assessment on EFL learners’ writing complicity, accuracy, and fluency (CAF), speaking CAF, and attitude. Language Testing in Asia, 12(1), 1–22.https://doi.org/10.1186/s40468-022-00209-x
Beikmohammadi, M., Alavi, S. M., & Kaivanpanah, S. (2020). Learning-oriented assessment of reading: A mixed methods study of Iranian EFL university instructors’ perceptions and practices. Journal of Foreign Language Research, 10(2), 316–329.https://doi.org/10.22059/jflr.2019.264150.541
Carless, D. (2007). Learning-oriented assessment: Conceptual bases and practical implications. Innovations in Education and Teaching International, 44(1), 57–66.https://doi.org/10.1080/14703290601081332
Carless, D. (2012). From testing to productive student learning: Implementing formative assessment in Confucian-heritage settings. Routledge. https://doi.org/10.4324/9780203128213
Carless, D. (2015). Exploring learning-oriented assessment processes. Higher Education, 69(6), 963–976.https://doi.org/10.1007/s10734-014-9816-z
Dehghanpour, B., Beheshti, Z., & Dehestani, M. (2022). The role of corrective feedback via offline and online applications on Iranian EFL learners’ grammatical accuracy. Journal of Language, Culture, and Translation, 4(2), 169–183. https://doi.org/10.30495/lct.2022.1972989.1074
Educational Testing Service. (2012). The official guide to the TOEFL iBT test (6th ed.). McGraw-Hill Education.
Ghaneiarani, S., Alavi, S. M., & Kaivanpanah, S. (2024). Enhancing writing ability of Iranian EFL learners through learning-oriented assessment: Peer and teacher feedback implementation. Language Testing in Asia, 14(1), 39.https://doi.org/10.1186/s40468-024-00298-w
Hume, A., & Coll, R. (2009). Assessment of learning, for learning, and as learning: New Zealand case studies. Assessment in Education, 16(3), 269–290.https://doi.org/10.1080/09695940903319661
Jones, N., & Saville, N. (2016). Learning oriented assessment: A systemic approach. Studies in Language Testing, 45(4), 23–47.
Khalili, A., Zafarani, P., & Gholami, J. (2024). Learning-oriented assessment in the context of Iran: Teachers’ perspectives. International Journal of Language Testing, 14(2), 82–96. https://doi.org/10.22034/ijlt.2024.433024.1317
Khodami, M. (2023). Association between emotional intelligence and meta-cognitive reading strategies among Iranian intermediate EFL learners. Journal of Language, Culture, and Translation, 5(2), 250–266. https://doi.org/10.71864/lct-2024-1130184
Liu, N. F., & Carless, D. (2006). Peer feedback: The learning element of peer-assessment. Teaching in Higher Education, 11(3), 279–290.https://doi.org/10.1080/13562510600680582
Nazari, A. (2023). Impact of using the STAD model of cooperative learning on autonomy and attitude of Iranian secondary school EFL learners. Journal of Language, Culture, and Translation, 5(2), 48–76. https://doi.org/10.30495/lct.2023.1982919.1085
Panadero, E., Brown, G., & Strijbos, J.W. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803–830.https://doi.org/10.1007/s10648-015-9350-2
Purpura, J. E. (2004). Assessing grammar. Cambridge University Press.
Salajegheh, S., Khomeijani Farahani, A., & Shahabi. H. (2022). The role of explicit corrective feedback timing in second language structure accuracy. Journal of Language, Culture, and Translation, 4(2), 1–21. https://doi.org/10.30495/lct.2022.1947452.1050
Topping, K. (2017). Peer-assessment: Learning by judging and discussing the work of other learners. Interdisciplinary Education and Psychology, 1(1), 1–17.https://doi.org/10.31532/InterdiscipEducPsychol.1.1.007
Tsagari, D., & Banerjee, J. (Eds.). (2016). Handbook of second language assessment (Vol. 12). Walter de Gruyter GmbH & Co KG.
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Massachusetts: Harvard University Press.
Yan, Y., & Carless, D. (2022). Self-assessment is about more than self: The enabling role of feedback literacy. Assessment & Evaluation in Higher Education, 47(7), 1116–1128.https://doi.org/10.1080/02602938.2021.2001431
Zeinali, E, Afraz, S., & Samimi, F. (2025). Construction and development of a questionnaire of grammar learning strategies with a focus on the most and least utilized strategies: Insights from Iranian EFL learners. Journal of Language, Culture, and Translation, 8(1), 1–26.https://doi.org/10.71864/lct-2025-1208144