A Qualitative Study of Washback Effects of MSRT Test on Iranian PhD Candidates’ Attitudes toward English Language Learning Skills
محورهای موضوعی : Journal of Studies in Learning and Teaching English
Nafiseh Lashgari
1
(English Language Department, Shiraz Branch, Islamic Azad University, Shiraz, Iran)
Samad Mirza Suzani
2
(Department of Foreign Languages, Marvdasht branch, Islamic Azad University, Fars, Iran.)
کلید واژه: High-stakes tests, Language testing, MSRT, Washback effect,
چکیده مقاله :
In Iran, the Ministry of Science, Research and Technology (MSRT) examination is a high-stakes test that has the potential to cause varying levels of washback at both individual and societal levels. Despite its significance for candidates, there appears to be insufficient emphasis on investigating the washback, particularly the impact of MSRT on the English language learning skills of Iranian candidates. Thus, the current research aimed to investigate the modifications that Iranian doctoral students regarded as more advantageous in utilizing the MSRT module for the purpose of English education. With this objective in mind, a survey based on the MSRT washback was administered to a group of 150 PhD students selected from Islamic Azad universities located in Shiraz and Marvdasht, who varied in terms of their gender, age, and field of study. A mixture of stratified and convenience sampling methods was employed to choose the study participants. In the second stage of the research, a purposive sampling approach was used to select 30 PhD candidates from the same population to participate in the semi-structured interviews. The findings from the data analysis revealed both favorable and unfavorable consequences of MSRT washback. In addition, it was observed that MSRT preparation did not adequately equip the students with English listening and speaking skills, which are crucial for their academic English needs, in contrast to their reading and writing capabilities.
In Iran, the Ministry of Science, Research and Technology (MSRT) examination is a high-stakes test that has the potential to cause varying levels of washback at both individual and societal levels. Despite its significance for candidates, there appears to be insufficient emphasis on investigating the washback, particularly the impact of MSRT on the English language learning skills of Iranian candidates. Thus, the current research aimed to investigate the modifications that Iranian doctoral students regarded as more advantageous in utilizing the MSRT module for the purpose of English education. With this objective in mind, a survey based on the MSRT washback was administered to a group of 150 PhD students selected from Islamic Azad universities located in Shiraz and Marvdasht, who varied in terms of their gender, age, and field of study. A mixture of stratified and convenience sampling methods was employed to choose the study participants. In the second stage of the research, a purposive sampling approach was used to select 30 PhD candidates from the same population to participate in the semi-structured interviews. The findings from the data analysis revealed both favorable and unfavorable consequences of MSRT washback. In addition, it was observed that MSRT preparation did not adequately equip the students with English listening and speaking skills, which are crucial for their academic English needs, in contrast to their reading and writing capabilities.
Ahmadi Safa, M., & Goodarzi, S. (2014). The washback effects of task-based assessment on
the Iranian Ph.D. candidates EFL learners' grammar development. Procedia-Social and
Behavioral Sciences, 98, 90-99.
Alderson, J. C., & Hamp-Lyons, L. (1996). TOEFL preparation courses: A study of washback.
Language Testing, 13(3), 280-297.
Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115-129.
Ali, M. M., & Hamid, M. O. (2020). Teaching English to the test: Why does negative washback exist within secondary education in Bangladesh? Language Assessment Quarterly, 17(2), 129-146.
Ali, M. M., Hamid, M. O., & Hardy, I. (2020). Ritualisation of testing: Problematising high-stakes English-language testing in Bangladesh. Compare: A Journal of Comparative and International Education, 50(4), 533-553.
Binnahedh, I. A. (2022). E-assessment: Washback effects and challenges (Examining students’ and teachers’ attitudes towards e-tests). Theory and Practice in Language Studies, 12(1), 203-211.
Borghouts, L. B., Slingerland, M., & Haerens, L. (2017). Assessment quality and practices in secondary PE in the Netherlands. Physical Education and Sport Pedagogy, 22(5), 473–489.
Brown, D. (2001). Teaching by principles. Oxford: Oxford University Press.
Butler, Y. G., Lee, J., & Peng, X. (2022). Failed policy attempts for measuring English speaking abilities in college entrance exams: Cases from China, Japan, and South Korea. English Today, 38(4), 271-277.
Cheng, L. (1998). Impact of a public examination change on students’ perceptions and attitudes
towards their English learning. Studies in Educational Evaluation, 24(3), 279–301.
Damankesh, M., & Babaii, E. (2015). The washback effect of Iranian high school final examinations on LEARNERS’ test taking and test-preparation strategies. Studies in Educational Evaluation, 45, 62-69. doi: https://doi.org/10.1016/j.stueduc.2015.03.009
Dammak, H., Khatibi, A., & Azam, S. F. (2022). Washback of the high-stakes English Baccalaureate exam: Empirical investigation of 4th English language teachers' attitudes and practices in Tunisia. Journal of Positive School Psychology, 5106-5126.
De la Fuente Fernández, A., & Calvo Pascual, M. A. (2022). Washback of Spanish university entrance examination on chemistry teaching in upper secondary education. Assessment in Education: Principles, Policy & Practice, 29(4), 422-440.
Gates, S. (1995). Exploiting washback from standardized tests. Language Testing in Japan, 1,
101- 106
Gennaro, J. A. D. (2017). The washback effects of an English exit exam on teachers and learners in a Korean university English program (Doctoral dissertation). University of Exeter, England.
Ghorbani, M. R., Abbassi, H., & Razali, A. B. M. (2021). Exploring the shortcomings of the Iranian MSRT English proficiency test. Pertanika Journal of Social Sciences & Humanities, 29.
Gordon, A. (2020). Tests as drivers of change in education: Contextualising washback, and the possibility of wash-forward. VNU Journal of Foreign Studies, 36(4).
Green, A. (2013). Washback in language assessment. International Journal of English Studies,
13(2), 39–51.
Herman, J. L., & Golan, S. (1991). Effects of standardized testing on teachers and learning Another look. (CSE Technical Report No. 334). Los Angeles: University of California. Center for Research on Evaluation, Standards and Student Testing.
Heshmatifar, Z., Zareian, G. R., & Davoudi, M. (2018). A qualitative investigation of factors affecting a preparation course for MSRT: A Grounded-Theory. Foreign Language Research Journal, 8(1), 27-56.
Hou, Q., Chen, Z., & Teng, M. (2022). Today’s baton and tomorrow’s vision: The effect of strengthening patent examination system on corporate innovation strategies. Journal of Business Research, 144, 614-626.
Hughes, A. (1988). Introducing a needs-based test of English language proficiency into an
English-medium university in Turkey. In A. Hughes (Ed.). Testing English for
university study (pp. 134–153). London: Modern English publications.
Hughes, A. (1993). Backwash and TOEFL 2000. England: University of Reading
Imlig, F., & Ender, S. (2018). Towards a national assessment policy in Switzerland: Areas of conflict in the use of assessment instruments. Assessment in Education: Principles, Policy & Practice, 25(3), 272–290.
Jamalifar, G., Salehi, H., Tabatabaei, O., & Jafarigohar, M. (2021). Washback effect of EPT on
Iranian PhD candidates' attitudes toward learning materials. International Journal of
Foreign Language Teaching and Research, 9(39), 11-26.
Khanshan, S. K. (2018). An examination of the washback effect on Iranian Ph.D. candidates EFL learners’ reading comprehension: Any implications for text difficulty in the classroom? International Journal of Language Testing and Assessment, 1(2), 9-16.
Kong, X., Zhang, X., Yan, C., & Ho, K. C. (2022). China's historical imperial examination system and corporate social responsibility. Pacific-Basin Finance Journal, 72, 101734.
Koretz, D., Linn, R. L., Dunbar, S. B., & Shepard, L. A. (1991). The effects of high-stakes
testing: Preliminary evidence about generalization across tests. Symposium presented
at the Annual Meetings of the American Educational Research Association and the
National Council on Measurement in Education, Miami, USA.
Messick, S. (1996). Validity and washback in language testing. Language Testing, 13, 241–
256.
Mickan, P., & Motteram, J. (2009). The preparation practices of IELTS candidates: Case
studies. In J. Osborne (Ed.), IELTS research reports (pp. 223-262). Manchester: British
Council.
Mizutan, S. (2009). The Mechanism of washback on teaching and learning (Doctoral
dissertation). University of Auckland, Auckland.
Pan, Y. C. (2009). A review of washback and its pedagogical implications. VNU Journal of
Foreign Studies, 25(4), 257-263.
Papakammenou, I. R. (2018). Washback on language skills: A study of EFL multi-exam preparation classes. In Revisiting the assessment of second language abilities: From theory to practice (pp. 437-454). Springer, Cham.
Qi, L. (2004). The intended washback effect of the national matriculation English test in China: Intentions and reality. Hamburg: Foreign Language Teaching and Research Press
Rind, I. A., & Mari, M. A. (2019). Analyzing the impact of external examination on teaching and learning of English at the secondary level education. Cogent Education, 6(1), 1574947.
Sadeghi, K., Ballıdağ, A., & Mede, E. (2021). The washback effect of TOEFL iBT and a local English Proficiency Exam on students' motivation, autonomy and language learning strategies. Heliyon, 7(10), 1-35.
Saville, N. D. (2009). Developing a model for investigating the impact of language assessment
within educational contexts by a public examination provider (Doctoral dissertation).
University of Bedfordshire, UK.
Schmidt, C. (2004). The analysis of semi-structured interviews. In U. Flick, E. von Kardorff, & I. Steinke (Eds.), A companion to qualitative research (pp. 253–258). London: Sage.
Shepard, L. (1991). The effects of high-stakes testing on instruction. Presented at the Annual
Meeting of the American Educational Research Association and the National Council
on Measurement Education, Miami, USA.
Shih, C. (2006). Perceptions of the general English proficiency test and its washback: A case study at two Taiwan technological institutes (Doctoral dissertation). Toronto: University of Toronto
Shih, C. M. (2007). A new washback model of students’ learning. Canadian Modern Language Review, 64(1), 135–162.
Shirzadi, D., & Amerian, M. (2020). Washback effects of multiple-choice, cloze and metalinguistic tests on EFL students writing. Indonesian Journal of Applied Linguistics, 9(3), 536-544.
Shohamy, E., Donitsa-Schmidt, S., & Ferman, I. (1996). Test impact revisited Washback effect over time. Language Testing, 13(3), 298–317.
Soomro, A. H., & Shah, S. Z. A. (2016). Effects of washback on high school teachers of English. International Journal of English and Education, 6(2), 201-210.
Spratt, M. (2005). Washback and the classroom: the implications for teaching and learning of studies of washback from exams. Language Teaching Research, 9, 5-29.
Tsang, C. L., & Isaacs, T. (2022). Hong Kong secondary students’ perspectives on selecting test difficulty level and learner washback: Effects of a graded approach to assessment. Language Testing, 39(2), 212-238.
Wall, D. (2000). The Impact of High-stakes testing on teaching and learning: Can this be predicted or controlled? System, 28, 499–509.
Watanabe, Y. (2004). Methodology in washback studies. In: Cheng, L., Watanabe & Y., Curtis,
A. (Eds.), Washback in language testing: Research contexts and methods (pp. 19–37).
Germany: Lawrence Erlbaum Associates.
Wesdorp, H. (1983). Backwash effects of multiple-choice language tests: Myth or reality? In J.
van Weeren (Ed.). Practice and problems in language testing 5 (pp. 85–104). Arnhem:
CITO.
Zhan, Y., & Wan, Z. (2014). Dynamic nature of washback on individual learners: The role of
possible selves. Assessment and Evaluation in Higher Education, 39(7), 821–839.
Zhang, H. (2019). A washback study of the National Matriculation English Test in China: Test takers’ perspective (Doctoral dissertation). Tsinghua: Tsinghua University
