The Effect of an Artificial Intelligence Chatbot on Vocabulary Retention by Iranian Intermediate EFL Learners: A Mixed Methods Approach
Subject Areas : Tech-Assisted Language Teaching
Mahmoud Pournabi
1
,
Saeed Ahmadi
2
1 -
2 -
Keywords: AI chatbot, Artificial Intelligence, EFL learners, mixed methods approach, vocabulary retention,
Abstract :
With the advent of advanced technological tools, there has been a surge of attention to the implementation of AI chatbots in the scope of language learning. However, there has not been adequate attention to exploring the influence of AI chatbots on vocabulary retention using mixed methods approaches. Accordingly, this study, using a mixed methods experimental design, examined the effect of an Artificial Intelligence (AI) chatbot (i.e., Anima) on vocabulary learning and retention among Iranian intermediate EFL learners. The participants consisted of 60 EFL students studying in private language institutes in Bushehr who had been selected on the basis of their performance on a QOPT test. They were divided into two groups (an experimental group and a control group). The experimental group underwent an eight-week program in which they used Anima to enhance their vocabulary learning and retention, while the control group received their regular English course. Moreover, 10 participants from the experimental group took part in semi-structured interviews to collect qualitative data on learners’ attitudes toward Anima for vocabulary retention. The results of repeated measures ANOVA indicated that the use of Anima significantly contributed to the enhancement of EFL learners’ vocabulary learning and retention. Also, the results of ANCOVA showed that the experimental group outperformed the control group in both vocabulary learning and retention. The results of thematic analysis revealed five themes regarding learners’ attitudes toward Anima for vocabulary retention, including personalized lexical exercises, instant corrective feedback, permanent access advantage, integrated language skill reinforcement, and autonomous learning engagement. The findings suggest EFL teachers employ Anima Chatbot to improve EFL learners’ vocabulary retention.
Adamopoulou, E., & Moussiades, L. (2020). Chatbots: History, technology, and applications. Machine Learning with Applications, 2, 100006. https://doi.org/10.1016/j.mlwa.2020.100006
Al Algaithi, A., Behforouz, B., & Isyaku, H. (2024). The effect of using a WhatsApp bot on English vocabulary learning. Turkish Online Journal of Distance Education, 25(2), 208–227.
Alsadoon, R. (2021). Chatting with AI Bot: Vocabulary learning assistant for Saudi EFL learners. English Language Teaching, 14(6), 135–157. https://eric.ed.gov/?id=EJ1302600
Bao, M. (2019). Can home use of speech-enabled artificial intelligence mitigate foreign language anxiety: investigation of a concept. Arab World English. J. 5, 28–40. https://doi.org/10.24093/awej/call5.3
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Calvo-Ferrer, J. R. (2018). Exploring digital nativeness as a predictor of digital game-based L2 vocabulary acquisition. Interactive Learning Environments, 28 (7), 902–914. https://doi.org/10.1080/10494820.2018.1548489
Chen, M. R. A. (2025). Improving English semantic learning outcomes through AI chatbot-based ARCS approach. Interactive Learning Environments, 1–16. https://doi.org/10.1080/10494820.2025.2454443
Ciechanowski, L., Przegalinska, A., Magnuski, M., & Gloor, P. (2019). In the shades of the uncanny valley: An experimental study of human–chatbot interaction. Future Generation Computer Systems, 92, 539-548. https://doi.org/10.1016/j.future.2018.01.055
Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). Sage.
Dörnyei, Z. (2007). Research methods in applied linguistics: Quantitative, qualitative, and mixed methodologies. Oxford University Press.
Fetters, M. D. (2020). The mixed methods research workbook: Activities for designing, implementing, and publishing projects. Sage.
Field, A. (2018). Discovering statistics using IBM SPSS Statistics (5th ed.). Sage.
Guetterman, T. C., Fetters, M. D., & Creswell, J. W. (2015). Integrating quantitative and qualitative results in health science mixed methods research through joint displays. Annals of Family Medicine, 13(6), 554–561. https://doi.org/10.1370/afm.1865
Henriksen, B. (1999). Three dimensions of vocabulary development. Studies in Second Language Acquisition, 21(2), 303-317.
Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Addison-Wesley.
Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot‐supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257. https://doi.org/10.1111/jcal.12610
Hutauruk, B. S., Purba, R., Sihombing, S., & Nainggolan, M. (2024). The effectiveness of artificial intelligence by Chatbot in enhancing the students’ vocabulary. JETAL: Journal of English Teaching & Applied Linguistics, 6(1), 13-19. https://jurnal.uhn.ac.id/index.php/jetal/article/view/1610
Ivankova, N. V., Creswell, J. W., & Stick, S. L. (2006). Using mixed-methods sequential explanatory design: From theory to practice. Field Methods, 18(1), 3–20. https://doi.org/10.1177/1525822X05282260
Kheder, K. (2025). Using artificial intelligence in learning vocabulary by EFL undergraduate Syrian students. In S. Bouabdallah, M. A. Qasem, & M. Denden (Eds.), Using AI tools in text analysis, simplification, classification, and synthesis (pp. 131–160). IGI Global.
Laufer, B. (2007). CATSS: The computer adaptive test of size and strength [Computer software]. https://lexisite.com/catss/catss-info
Lee, L., & Gunderson, L. (2011). Select readings: Intermediate (2nd ed.). Oxford University Press.
Liu, Q., Huang, J., Wu, L., Zhu, K., & Ba, S. (2019). CBET: Design and evaluation of a domain-specific chatbot for mobile learning. Universal Access in the Information Society, 19(3), 655–673. https://doi.org/10.1007/s10209-019-00666-x
Nassaji, H. (2020). Good qualitative research. Language Teaching Research, 24(4), 427–431. https://doi.org/10.1177/1362168820941288
Nation, I. S. P. (2001). Learning vocabulary in another language. Cambridge University Press.
Nation, I. S. P. (2022). Learning vocabulary in another language (3rd ed.). Cambridge University Press.
Oktadela, R., Elida, Y., & Ismail, S. (2023). Improving English vocabulary through an artificial intelligence (AI) chatbot application. Journal of English Language and Education, 8(2), 63-67. https://www.jele.or.id/index.php/jele/article/download/308/191
Oxford University Press & University of Cambridge Local Examinations Syndicate. (2002). Quick placement test. Oxford University Press.
Qasem, F., Ghaleb, M., Mahdi, H. S., Al-Khateeb, A., & Al Fadda, H. (2023). Dialog chatbot as an interactive online tool for enhancing ESP vocabulary learning. Saudi Journal of Language Studies, 3(2), 76–86. https://doi.org/10.1108/SJLS-10-2022-0072
Romadhon, R. (2025). Replika AI chatbot as a tool for enhancing ESP business vocabulary acquisition: A study on polytechnic students. SALEE: Study of Applied Linguistics and English Education, 6(1), 183–201. https://ejournal.stainkepri.ac.id/index.php/salee/article/view/1671
Schmitt, N. (2000). Vocabulary in language teaching. Cambridge University Press.
Schmitt, N., Wun-Ching, J., & Garras, J. (2011). The word associates format: Validation evidence. Language Testing, 28(1), 105–126. https://doi.org/10.1177/0265532210384230
Tangpijaikul, M. (2025). Exploring the lexical approach for vocabulary learning through AI-driven feedback. LEARN Journal: Language Education and Acquisition Research Network, 18(1), 1015-1038. https://doi.org/10.70730/SFNP1171
Urbaite, G. (2025). Adaptive learning with AI: How bots personalize foreign language education. Luminis Applied Science and Engineering, 2(1), 13–18. https://doi.org/10.69760/lumin.20250001002
Webb, S.A., & Chang, A.C.S. (2012). Second language vocabulary growth. RELC Journal. 43(1), 113–126. https://doi.org/10.1177/0033688212439321
Wei, M. (2007). An examination of vocabulary learning of college-level learners of English in China. Asian EFL Journal, 9(2), 88-96
Zoghi, M., & Mirzaei, M. (2014). A comparative study of textual and visual contextualization on Iranian EFL learners' vocabulary learning. International Journal of Basic and Applied Science, 2, 31–40.
