Charting Uncharted Waters: AI-Driven Feedback and Writing Accuracy of Intermediate Iranian EFL Learners
Subject Areas : Research in English Language Pedagogy
Mohsen Banisharif Dehkordi
1
,
Parisa Riahipour
2
,
Fariba Rahimi Esfahani
3
1 - Department of English, ShK.c., Islamic Azad university, Shahrekord, Iran
2 - Department of English, ShK.c., Islamic Azad
3 - Department of English, ShK.c., Islamic Azad univerity, Shahrekord, Iran
Keywords: AI- driven feedback, Direct feedback, Error reduction, Indirect feedback, Writing accuracy,
Abstract :
|
This study explored the impact of AI-driven feedback on the writing accuracy of Iranian intermediate EFL learners using a quasi-experimental design. Through convenience sampling, 100 participants (male and female, aged 18-25) from two language institutes in Tehran were divided into four groups: two experimental groups receiving direct and indirect feedback from AI ChatGPT, and two control groups receiving the same feedback types from their teacher. Participants completed a pre-test, ten writing tasks over 14 weeks, and a post-test. Results, analyzed via descriptive statistics and one-way ANOVA, showed significant improvements in writing accuracy across all groups. The AI direct feedback group achieved the highest improvement, with a mean difference of 7.34 (p < 0.05). Post hoc comparisons revealed that AI direct feedback significantly outperformed both AI indirect feedback and traditional teacher feedback, while teacher indirect feedback resulted in the least progress. Error-type analysis highlighted the superior effectiveness of AI feedback, particularly direct feedback, in reducing spelling and verb form errors. These findings highlight the potential of AI-driven feedback-both direct and indirect-to exceed traditional teacher feedback methods in improving EFL learners’ writing accuracy, with direct feedback emerging as the most effective approach. |
Aliakbari, M., Aryan, M., & Sourani, M. (2023). The efficacy of focused and unfocused written corrective feedback on EFL learners’ grammatical accuracy. Al-Adab Journal, (144), 61-84. https://doi.org/10.31973/aj.v1i144.3955
Athanassopoulos, S., Manoli, P., Gouvi, M., Lavidas, K., & Komis, V. (2023). The use of ChatGPT as a learning tool to improve foreign language writing in a multilingual and multicultural classroom. Advances in Mobile Learning Educational Research, 3(2), 818-824. https://doi.org/10.25082/AMLER.2023.02.009
Ausubel, D.P. (1968). Educational psychology: a cognitive view. Holt, Rinehart and Winston: New York.
Bai, L., & Hu, G. (2016). In the face of fallible AWE feedback: How do students respond? Educational Psychology, 37(1), 67–81. https://doi.org/10.1080/01443410.2016.1223275
Baskara, F. R. (2023). Integrating ChatGPT into EFL writing instruction: Benefits and challenges. International Journal of Education and Learning, 5(1), 44-55. http://pubs2.ascee.org/index.php/ijele
Benson, S., & DeKeyser, R. (2018). Effects of written corrective feedback and language aptitude on verb tense accuracy. Language Teaching Research, 23(6), 702–726. https://doi.org/10.1177/1362168818770921
Chandler, J. (2003). The efficacy of various kinds of error feedback for improvement in the accuracy and fluency of L2 student writing. Journal of Second Language Writing, 12(3), 267–296. https://doi.org/10.1016/S1060-3743(03)00038-9
Chomsky, N. (1959). A review of B.F. Skinner's Verbal Behavior. Language, 35(1), 26–58. https://doi.org/10.2307/411334
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587
Ellis, R. (2009). Corrective feedback and teacher development. L2 Journal, 1(1), 3-18. https://doi.org/10.5070/l2.v1i1.9054
Fan, N. (2023). Exploring the effects of automated written corrective feedback on EFL students’ writing quality: A mixed-methods study. SAGE Open, 13(2), 21582440231181296. https://doi.org/10.1177/21582440231181296
Ferris, D. R. (2006). Does error feedback help student writers? New evidence on the short- and long-term effects of written error correction. In K. Hyland & F. Hyland (Eds.), Feedback in second language writing: Contexts and issues (pp. 81–104). Cambridge University Press. http://dx.doi.org/10.1017/CBO9781139524742.007
Ferris, D. (2011). Treatment of error in second language student writing. University of Michigan Press. https://doi.org/10.3998/mpub.2173290
Ferris, D., & Roberts, B. (2001). Error feedback in L2 writing classes: How explicit does it need to be?. Journal of second language writing, 10(3), 161-184. https://doi.org/10.1016/S1060-3743(01)00039-X
Ghoorchaei, B., Mamashloo, F., Ayatollahi, M. A., & Mohammadzadeh, A. (2022). Effect of direct and indirect corrective feedback on Iranian EFL writers’ short and long term retention of subject-verb agreement. Cogent Education, 9(1), 2014022. https://doi.org/10.1080/2331186X.2021.2014022
Huang, S., & Renandya, W. A. (2020). Exploring the integration of automated feedback among lower-proficiency EFL learners. Innovation in language learning and teaching, 14(1), 15-26. https://doi.org/10.1080/17501229.2018.1471083
Kang, E., & Han, Z. (2015). The efficacy of written corrective feedback in improving L2 written accuracy: A meta‐analysis. The modern language journal, 99(1), 1-18. https://doi.org/10.1111/modl.12189
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., ... & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and individual differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
Kim, S.-Y. (2012). Measuring linguistic accuracy in an EFL writing class: an electronic communication channel. Linguistic Research, 29(3), 665–688. https://doi.org/10.17250/khisli.29.3.201212.010
Lee, G. (2024). AI-based writing feedback in ESP: Leveraging ChatGPT for writing business cover letters among Korean university students. Proceedings of the International CALL Research Conference, 2024, 131–136. https://doi.org/10.29140/9780648184485-20
Lee, I. (2004). Error correction in L2 secondary writing classrooms: The case of Hong Kong. Journal of second language writing, 13(4), 285-312. https://doi.org/10.1016/j.jslw.2004.08.001
Mallahi, O., & Saadat, M. (2020). Effects of feedback on Iranian EFL learners' writing development: group dynamic assessment vs. formative assessment. Iranian Evolutionary Educational Psychology Journal, 2(4), 258-277. https://doi.org/10.52547/ieepj.2.4.258
Mirshekaran, R., & Namaziandost, E. (2018). The Effects of Topic Interest and L2 Proficiency on Writing Skill among Iranian EFL Learners. Journal of Language Teaching and Research, 9(6), 1302-1313. https://doi.org/10.17507/jltr.0906.16
Ngo, T. T. A. (2023). The perception by university students of the use of ChatGPT in education. International Journal of Emerging Technologies in Learning (iJET), 18(17), pp. 4–19. https://doi.org/10.3991/ijet.v18i17.39019
Niu, R., Shan, P., & You, X. (2021). Complementation of multiple sources of feedback in EFL learners’ writing. Assessing Writing, 49, 100549. https://doi.org/10.1016/j.asw.2021.100549
Polio, C., & Shea, M. C. (2014). An investigation into current measures of linguistic accuracy in second language writing research. Journal of Second Language Writing, 26, 10–27. https://doi.org/10.1016/j.jslw.2014.09.003
Polio, C., Fleck, C., & Leder, N. (1998). “If I only had more time:” ESL learners’ changes in linguistic accuracy on essay revisions. Journal of Second Language Writing, 7(1), 43–68. https://doi.org/10.1016/S1060- 3743(98)90005-4
Rahimi, M. (2010). Iranian EFL students’ perceptions and preferences for teachers’ written feedback: Do students’ ideas reflect teachers’ practice? The Journal of Teaching Language Skills, 2(2), 75-98. https://doi.org/10.22099/jtls.2012.409
Ranalli, J. (2018). Automated written corrective feedback: How well can students make use of it?. Computer Assisted Language Learning, 31(7), 653-674. https://doi.org/10.1080/09588221.2018.1428994
Richards, J. C. (1971). A non-contrastive approach to error analysis. English Language Teaching, 2(5), 204-219. https://doi.org/10.1093/elt/XXV.3.204
Schmidt, R. W. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 129-158. https://doi.org/10.1093/applin/11.2.129
Shintani, N., & Ellis, R. (2015). Does language analytical ability mediate the effect of written feedback on grammatical accuracy in second language writing? System, 49, 110-119. https://doi.org/10.1016/j.system.2015.01.006
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12 (2), 257-285. https://doi.org/10.1016/0364-0213(88)90023-7
Thi, N. K., & Nikolov, M. (2021). How teacher and Grammarly feedback complement one another in Myanmar EFL students’ writing. Asia-Pacific Education Researcher, 31 (6), 767–779. https://doi.org/10.1007/s40299-021-00625-2
Truscott, J. (1996). The case against grammar correction in L2 writing classes. Language Learning, 46 (2), 327–369. https://doi.org/10.1111/j.1467-1770.1996.tb01238.x
Wang, D. (2024). Teacher- versus AI-generated (Poe application) corrective feedback and language learners’ writing anxiety, complexity, fluency, and accuracy. The International Review of Research in Open and Distributed Learning, 25(3). https://doi.org/10.19173/irrodl.v25i3.7646
Yoon, S. Y., Miszoglad, E., & Pierce, L. R. (2023). Evaluation of ChatGPT feedback on ELL writers' coherence and cohesion. arXiv preprint arXiv:2310.06505. https://doi.org/10.48550/arXiv.2310.06505
Zhang, T. (2021). The effect of highly focused versus mid-focused written corrective feedback on EFL learners’ explicit and implicit knowledge development. System, 99, 102493. https://doi.org/10.1016/j.system.2021.102493
