Investigating ESP Instructors’ Knowledge of Assessment Literacy Components and Instructional Practices in the Iranian Academic Context
Subject Areas :
Fatemeh Sobouti
1
,
Neda Gharagozloo
2
*
,
Amirhossein Rahimi
3
1 - Department of English Translation, Varamin- Pishva Branch, Islamic Azad University, Varamin, Iran
2 - Department of English Translation, Varamin- Pishva Branch, Islamic Azad University, Varamin, Iran
3 - Department of English Language, Yadegareh Imam Branch, Islamic Azad University, Shahre- Rey, Iran
Keywords: Assessment literacy, Components of assessment literacy, Novice and experienced teachers, TEFL/non-TEFL background,
Abstract :
In the Iranian academic setting, the current investigation aimed to identify the assessment literacy (AL) components that experienced and novice English for Specific Purposes (ESP) teachers with and without TEFL (teaching English as a foreign language) backgrounds comprehended. We designed an explanatory sequential mixed-methods study, and selected 100 PhD male and female ESP educators from various branches of Islamic Azad University via criterion sampling in order to complete the teacher assessment literacy scale (TALS). The standard deviation as well as mean of the TALS were computed. The mean scores of the TEFL/non-TEFL and novice/experienced teachers on the seven TALS components were then independently compared using two multivariate analyses of variances (MANOVA). After administering the scale to 100 ESP teachers and analyzing the results, 20 of the instructors were chosen via convenience sampling for observation during the study's qualitative phase. Afterwards, the qualitative information was collected through the use of the observation notes. Employing axial/open coding and content analysis of themes, all of the notes were classified and examined. The results showed that in terms of knowledge of assessment literacy components, instructors with TEFL backgrounds understand much better than teachers without TEFL backgrounds. Similarly, the means of all TALS components were greater for inexperienced teachers than for experienced ones. Furthermore, the results of the qualitative phase demonstrated that the novice TEFL teachers performed AL components more effectively than their non-TEFL counterparts as well as the experienced TEFL/non-TEFL instructors.
Ajzen, I. (2020). The theory of planned behavior: Frequently asked questions. Human Behavior and Emerging Technologies, 2(4), 314-324.
Arani, A. M., Kakia, M. L., & Karimi, M. V. (2012). Assessment in education in Iran. Assessment, 9(2), 101-110
Ashraf, H., & Zolfaghari, S. (2018). EFL teachers' assessment literacy and their reflective teaching. International Journal of Instruction, 11(1), 425-436.
Atay, D. (2008). Teacher research for professional development. ELT journal, 62(2), 139-147.
Azadi, A. (2018). A study on the conceptual factors of teacher assessment literacy among ESP instructors. Unpublished master’s thesis, Islamic Azad University, Electronic Branch, Tehran, Iran.
Babai Shishavan, H., & Sadeghi, K. (2009). Characteristics of effective English language teacher as perceived by Iranian teachers and learners of English, Iranian Journal of Language Teaching Research, 1(2), 130-132.
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice. Oxford: OUP.
Bandura, A. (2005). The evolution of social cognitive theory. Great minds in management, 6(2), 9-35.
Baniali, S. (2018). A study on Iranian experienced and novice EFL teachers’ belief and practice in teaching vocabulary. North Tehran Branch, Islamic Azad University. Tehran, Iran.
Barnes, N., Fives, H., & Dacey, C. M. (2015). Teachers’ beliefs about assessment. International handbook of research on teachers’ beliefs, 284-300.
Bayat, K., & Rezaei, A. (2015). Importance of teachers’ assessment literacy. International Journal of English Language Education, 3(1), 139-146.
Campbell, C., Murphy, J. A., & Holt, J. K. (2002, October). Psychometric analysis of an assessment literacy instrument: Applicability to pre-service teachers. In Annual meeting of the mid-western educational research association, Columbus, OH.
Chan, C. K., & Luo, J. (2020). An exploratory study on teacher assessment literacy: Do novice university teachers know how to assess students’ written reflection?. Teachers and Teaching, 26(2), 214-228.
Creswell, J. W. (2009). Research design qualitative and quantitative and mixed methods approaches (3rd Ed.). California: Sage.
Creswell, J. W., & Clark, V. L. P. (2017). Designing and conducting mixed methods research. Sage publications.
Dasgupta, N. (2013). Implicit attitudes and beliefs adapt to situations: A decade of research on the malleability of implicit prejudice, stereotypes, and the self-concept. Advances in experimental social psychology, 47(4), 233-279.
DeLuca, C., & Klinger, D. A. (2010). Assessment literacy development: Identifying gaps in teacher candidates’ learning. Assessment in Education: Principles, Policy & Practice, 17(4), 419-438.
Dörnyei, Z. (2007). Creating a motivating classroom environment. In International handbook of English language teaching (pp. 719-731). Springer, Boston, MA.
Eezami, R. (2016). A study on work engagement and fulfillment of basic psychological needs among novice and experienced EFL teachers in the Iranian institutes. Kharazmi University, Tehran, Iran.
Ellis, R. (2008). The study of second language acquisition (2nd ed.). Oxford: OUP.
Falsgraf, C. (2005). Why a national assessment summit? New visions in action. National Assessment Summit, 3, 6-9.
Farhady, H., & Tavassoli, K. (2018). Developing a language assessment knowledge test for EFL teachers: A data-driven approach. Iranian Journal of Language Teaching Research, 6(3), 79-94.
Fathi, J., & Derakhshan, A. (2019). Teacher self-efficacy and emotional regulation as predictors of teaching stress: An investigation of Iranian English language teachers. Teaching English Language, 13(2), 117-143.
Fathi, J., & Saeedian, A. (2020). A structural model of teacher self-efficacy, resilience, and burnout among Iranian EFL teachers. Iranian Journal of English for Academic Purposes, 9(2), 14-28.
Firoozi, T., Razavipour, K., & Ahmadi, A. (2019). The language assessment literacy needs of Iranian EFL teachers with a focus on reformed assessment policies. Language Testing in Asia, 9(1), 2-14.
Field, A. (2018). Discovering statistics using IBM SPSS, statistics for statistics. (5th ed.). London: SAGE Publications.
Gareis, C. R., & Grant, L. W. (2015). Assessment literacy for teacher candidates: A focused approach. Teacher Educators’ Journal, 20(3),4-21
Gotch, C. M., and French, B. F. (2013). Elementary teachers' knowledge and self-efficacy for measurement concepts. The Teacher Educator, 48(1), 46-57.
Hajizadeh, N., & Salahshour, N. (2014). Characteristics of effective EFL instructors: Language teachers’ perceptions versus learners’ perceptions. International Journal of Applied Linguistics and English Literature, 3(1), 202-214.
Inbar-Lourie, O. (2013). Language assessment literacy: What are the ingredients?. Language Testing, 30(3), 301-307.
Jafarpour, A. (2003). Is the test constructor a facet? Language Testing, 20(1), 57-87.
Jalilzadeh, K., Alavi, M., & Siyyari, M. (2022). Comparing language assessment literacy and the challenges of Iranian EFL teachers: TEFL vs non-TEFL background. Language and Translation,12(4), 177-196.
Jeong, H. (2013). Defining assessment literacy: Is it different for language testers and non-language testers?. Language Testing, 30(3), 345-362.
Kögler, H. H. (2012). Agency and the other: On the intersubjective roots of self-identity. New Ideas in Psychology, 30(1), 47-64.
Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research activities. Educational and psychological measurement, 30(3), 607-610.
Lam, R. (2019). Teacher assessment literacy: Surveying knowledge, conceptions and practices of classroom-based writing assessment in Hong Kong. System, 81(2), 78-89.
Looney, A., Cumming, J., van Der Kleij, F., & Harris, K. (2018). Re-conceptualizing the role of teachers as assessors: Teacher assessment identity. Assessment in Education: Principles, Policy & Practice, 25(5), 442-467.
Mackey, A., & Gass, S. M. (2016). Second language research: Methodology and design (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
Malone, M. E. (2013). The essentials of assessment literacy: Contrasts between testers and users. Language Testing, 30(3), 329-344.
Marzano, R. J. (2000). Transforming classroom grading. Alexandria, VA: Association for Supervision and Curriculum Development.
Mellati, M., & Khademi, M. (2018). Exploring teachers’ assessment literacy: Impact on learners’ writing achievements and implications for teacher development. Australian Journal of Teacher Education, 43(6), 1-18.
Mertler, C. A. (1999). Assessing student performance: A descriptive study of the classroom assessment practices of Ohio teachers. Education, 120, 285-296.
Mertler, C. A. (2003). Classroom assessment literacy inventory. (Adapted from the Teacher Assessment Literacy Questionnaire (1993), by Barbara S. Plake & James C. Impara, University of Nebraska-Lincoln, in cooperation with The National Council on Measurement in Education & the W.K. Kellogg Foundation.
Mertler, C. A. (2005). Secondary teachers’ assessment literacy: Does classroom experience make a difference? American Secondary Education, 33(2), 76-92.
Mertler, C. A. (2009). Teachers’ assessment knowledge and their perceptions of the impact of classroom assessment professional development. Improving Schools, 12(1), 101-113.
Mohammadi, A. (2020). A mixed-methods study on the teacher assessment literacy of ELT instructors versus content instructors Islamic Azad University. Unpublished master’s thesis, University of Qom, Iran.
Plake, B. S., & Impara, J. C. (1993). Teacher assessment literacy questionnaire. Nebraska-Lincoln: The National Council on Measurement in Education & the W.K. Kellogg Foundation.
Popham, W. J. (2014). Classroom assessment: What teachers need to know (7th ed.). Boston: Pearson Education.
Ramnarain, U., and Hlatswayo, M. (2018). Teacher beliefs and attitudes about inquiry-based learning in a rural school district in South Africa. South African Journal of Education, 38(1), 1-10.
Razavipour, K., Riazi, A., & Rashidi, N. (2011). On the interaction of test washback and teacher assessment literacy: The case of Iranian EFL secondary school teachers. English Language Teaching, 4(1), 156-161.
Remesal, A. (2007). Educational reform and primary and secondary teachers' conceptions of assessment: The Spanish instance, building upon Black and Wiliam (2005). Curriculum Journal, 18, 27-38.
Rodríguez, A. G., & McKay, S. (2010). Professional development for experienced teachers working with adult English language learners. CAELA Network Brief. Center for Adult English Language Acquisition. Retrieved from www.cal.org/caelanetwork
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Australia Language Testing, 30(3) 309-327.
Siegel, M. A., & Wissehr, C. (2011). Preparing for the plunge: Pre-service teachers’ assessment literacy. Journal of Science Teacher Education, 22(4), 371-391 Retrieved from: http://dx.doi.org/10.1007/s10972-011-9231-6.
Skaalvik, M., & Skaalvik, S., (2017). Motivated for teaching? Associations with school goal, teacher self-efficacy, job satisfaction and emotional exhaustion. Teaching and Teacher Education, 67(2), 152-160.
Stiggins, R. (1991). Assessment literacy. Phi Delta Kappan, 72, 534-539.
Stobart, G. (2008). Testing times: The uses and abuses of assessment. Oxon: Routledge.
Sussman, R., & Gifford, R. (2019). Causality in the theory of planned behavior. Personality and Social Psychology Bulletin, 45(6), 920-933.
Tabachnick, B.G., & Fidell, L.S. (2014). Using multivariate statistics (6th ed.). Pearson Inc.
Tajeddin, Z., Alemi, M., & Yasaei, H. (2018). Classroom assessment literacy for speaking: Exploring novice and experienced English language teachers' knowledge and practice. Iranian Journal of Language Teaching Research, 6(3), 57-77.
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403-412.
Xu, Y., & Brown, G. T. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149-162.
Yzer, M. C. (2013). Reasoned action theory. The SAGE handbook of persuasion. Developments in Theory and Practice, 2(2), 120-136.
Zamani, R., & Ahangari, S. (2016). Characteristics of an effective English language teacher (EELT) as perceived by learners of English. International Journal of Foreign Language Teaching and Research, 4(14), 69-88.
Zwozdiak-Myers, P. (2012). The teacher's reflective practice handbook: How to engage effectively in
professional development and build a portfolio of practice. Routledge.