Incorporating Purposeful Assessment Scenarios in L2 Listening Class: A Learner-Oriented Approach

Subject Areas : All areas of language and translation

Elham Ghorbanpour ¹ , Gholam-Reza Abbasian ² , Ahmad Mohseni ³

1 - Department of English Language, Kish International Branch, Islamic Azad University, Kish Island, Iran
2 - Department of English Language, Kish International Branch, Islamic Azad University, Kish Island, Kish, Iran; Imam Ali University, Tehran, Iran
3 - Department of English Language Teaching, Kish International Branch, Islamic Azad University, Kish Island, Iran; South Tehran Branch, Islamic Azad University Tehran, Iran

Received: 2021-06-29 Accepted : 2021-06-29 Published : 2021-04-01

Keywords: Listening comprehension, AAL Assessment, AFL Assessment, AOL Assessments, Integrated Assessment,

Abstract :

This study investigated the effect of purposeful assessment scenarios, Assessment for Learning (AFL), Assessment as Learning (AAL), and integrated purposeful assessment scenarios on Iranian EFL learners’ development of listening comprehension. To this end, 100 learners organized in three experimental and one control group participated in this quasi-experimental study. They received listening instructions of the mentioned purposeful assessment forms. Parametric statistical analysis in the form of some one-way ANOVAs revealed thatEFL learners exposed to integrated assessment could significantly develop their listening comprehension better than the AFL- and AAL-oriented instruction groups. However, no significant difference between AAL- and AFL-oriented groups’ listening comprehension was obtained. Though the findings are not in favor of any of the individual scenarios, they lend support to their feasibility in classroom performance assessment and assert the usefulness and viability of the synthetic approach to assessment through which measurement and instruction are bifurcated.

References:

Alderson, C., & Bachman, L. F. (2005). Series editors preface. In G. Buck. In Assessing Listening Cambridge: Cambridge University Press.

Almalki, M. (2019, No. 1 2019). Learning-oriented assessment, critical thinking and English language speaking skills: An exploratory study of Saudi EFL learners. International Journal of English Language Education, 7(1), 37-50. Retrieved from http://www.macrothink.org/journal/index.php/ijele/article/view/14528

Archer, J. C. (2010). State of the science in health professional education: effective feedback. Medical Education, 44(1), 101-108. doi:10.1111/j.1365-2923.2009.03546.x

Bayat, A., Jamshidipour, A., & Hashemi, M. (2017). The Beneficial Impact/s of Applying Formative Assessment on Iranian University Students' Anxiety Reduction and Listening Efficacy. International Journal of Languages' Education, 1(Volume 5 Issue 2), 1-11. doi:10.18298/ijlet.1740

Bell, B., & Cowie, B. (2001). The Characteristics of Formative Assessment in Science Education. Science Education, 85(5), 536-553. Retrieved from https://eric.ed.gov/?id=EJ633665

Bennett, W. J. (1984). To reclaim a legacy: a report on the humanities in higher education. Washington, D.C.: National Endowment for the Humanities.

Black, P., & Wiliam, D. (2006). Assessment and Classroom Learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7-74. doi:10.1080/0969595980050102

Black, P., & Wiliam, D. (2009). Developing the Theory of Formative Assessment. Educational Assessment Evaluation and Accountability, 21(1), 5-31. doi:10.1007/s11092-008-9068-5

Blaich, C., & Wise, K. (Eds.). (2011). From gathering to using assessment results: Lessons from the Wabash national study. Urbana, IL: University of Illinois and Indiana Universityy, National Institute for Learning Outcomes Assessment (NILOA).

Boud, D., & Falchikov, N. (1989). Quantitative Studies of Student Self-Assessment in Higher Education: A Critical Analysis of Findings. Higher Education, 18(5), 529-549. doi:10.1007/BF00138746

Boud, D., Lawson, R., Thompson, D., & Simpson, L. (2011). The development of student judgement: The role of practice in grade prediction. Paper presented at the 14th Biennial EARLI Conference for Research on Learning and Instruction: Education for a Global Networked Society, Exeter, United Kingdom. Conference Paper retrieved from http://vhost0309.web04.level27.be/conferences/EARLI_Biennial_Conferences/previous_Biennial_conferences/earli_2011

Brookhart, S. M. (2001). Successful Students' Formative and Summative Uses of Assessment Information. Assessment in Education Principles Policy and Practice, 8(2), 153-169. doi:10.1080/09695940123775

Brookhart, S. M. (2007). Feedback that Fits. Educational leadership, 65(4), 54-59.

Brown, G. T. L. (2008). Conceptions of Assessment: Understanding what Assessment Means to Teachers and Students. New York: Nova Science Publishers.

Buck, G. (2001). Assessing listening. Cambridge; New York: Cambridge University Press.

Carless, D. (2007). Learning-Oriented Assessment: Conceptual Bases and Practical Implications. Innovations in Education & Teaching International, 44(1), 57-66. doi:10.1080/14703290601081332

Carless, D. (2011). From testing to productive student learning implementing formative assessment in Confucian-heritage settingsRoutledge research in education v 52 (pp. xiv, 263 p.). doi:10.4324/9780203128213

Carless, D., Joughin, G., & Mok, M. M. C. (2006). Learning-oriented assessment: Principles and practice. Assessment & Evaluation in Higher Education, 31(4), 395-398. doi:10.1080/02602930600679043

Chappuis, S., & Stiggins, R. J. (2002). Classroom Assessment for Learning. Educational leadership: journal of the Department of Supervision and Curriculum Development, N.E.A, 60(1), 40-43.

Choi, K., Nam, J.-H., & Lee, H. (2001). The Effects of Formative Assessment with Detailed Feedback on Students' Science Learning Achievement and Attitudes Regarding Formative Assessment. Journal of the Korean Association For Research in Science Education, 20(2), 28-34.

Cutting, L. E., & Scarborough, H. S. (2006). Prediction of reading comprehension. Relative contributions of word recognition, language proficiency, and other cognitive skills can depend on how comprehension is measured, 10(3), 277-299. doi:10.1207/s1532799xssr1003_5

Dann, R. (2002). Promoting assessment as learning: improving the learning process (Vol. 5). London: Routledge/Falmer.

Dann, R. (2014). Assessment as learning: blurring the boundaries of assessment and learning for theory, policy and practice. Assessment in Education: Principles, Policy & Practice, 21(2), 149-166. doi:10.1080/0969594x.2014.898128

Davis, D. S., & Neitzel, C. (2011). A Self-Regulated Learning Perspective on Middle Grades Classroom Assessment. The Journal of Educational Research, 104(3), 202-215. doi:10.1080/00220671003690148

Dobson, S. (2010). Book review: how assessment supports learning. Learning-oriented assessment in action. Assessment in Education: Principles, Policy and Practice, 17(2), 105–112.

Dörnyei, Z. (2007). Research methods in applied linguistics: quantitative, qualitative, and mixed methodologies. Oxford; New York, N.Y.: Oxford University Press.

Drummond, M. J. (2003). Assessing children's learning (2nd ed. ed.). London: David Fulton.

Dunn, K. E., & Mulvenon, S. W. (2009). A Critical Review of Research on Formative Assessment: The Limited Scientific Evidence of the Impact of Formative Assessment in Education. Practical Assessment, Research, and Evaluation, 14(7), 11. doi:10.4324/9780203462041_chapter_1

Earl, L. M. (2003). Assessment as learning: using classroom assessment to maximize student learning (Second edition. ed.). Thousand Oaks, CA: Corwin.

Earl, L. M. (2013). Assessment for learning; Assessment as learning: Changing practices means changing beliefs. assessment, 80, 63-71.

Earl, L. M., & Katz, M. S. (2006). Rethinking classroom assessment with purpose in mind: assessment for learning, assessment as learning, assessment of learning. Winnipeg, Canada: Manitoba Education, Citizenship & Youth.

Earl, L. M., & Timperley, H. (2014). Challenging conceptions of assessment. In C. Wyatt-Smith, V. Klenowski, & P. Colbert (Eds.). In Designing Assessment for Quality Learning (Vol. 1, pp. 325-336). Dordrecht: Springer.

Evans, C. (2013). Making Sense of Assessment Feedback in Higher Education. Review of educational research, 83(1), 70-120.

Falchikov, N. (2001). Learning Together: Peer Tutoring in Higher Education. London: RoutledgeFalmer.

Falchikov, N. (2005). Improving Assessment through Student Involvement: Practical Solutions for Aiding Learning in Higher and Further Education. London: RoutledgeFalmer.

Farhady, H., Jafarpour, A., & Birjandi, P. (1994). Testing language skills. Tehran: SAMT Publications.

Gibbs, G. (2006). How assessment frames student learning. In C. Bryan, & K. Clegg (Eds.). In Innovative assessment in higher education (pp. 23-36). London: Routledge.

Gibbs, G., & Simpson, C. (2005). Conditions Under Which Assessment Supports Students’ Learning. Learning and Teaching in Higher Education(1), 3-31. Retrieved from http://eprints.glos.ac.uk/3609/

Graziano-King, J. (2007). Assessing Student Writing: The Self-Revised Essay. Journal of Basic Writing, 26(2), 75-94.

Guskey, T. R., & Bailey, J. M. (2001). Developing Grading and Reporting Systems for Student Learning. Experts in Assessment. Thousand Oaks, Calif.: Corwin Press.

Harlen, W. (2012). On the relationship between assessment for formative and summative purposes. In J. Gardner (Ed.),. In Assessment and Learning (2 ed., pp. 87-102). doi:10.4135/9781446250808

Hatch, E. M., & Lazaraton, A. (1991). The Research Manual: Design and Statistics for Applied Linguistics. Boston, Mass.: Heinle & Heinle.

Kuh, G. D., Kinzie, J., Schuh, J. H., & Whitt, E. J. (2005). Student Success in College: Creating Conditions That Matter (s. ed. Ed.). San Francisco, Calif.: Jossey-Bass.

Lam, R. (2008). Adopting Effective Portfolio-based Assessment: An Integrative Approach. Modern English Teacher, 17(1), 36-41.

Lam, R. (2013). Formative Use of Summative Tests: Using Test Preparation to Promote Performance and Self-Regulation. The Asia-Pacific Education Researcher, 22(1), 69-78.

Lam, R. (2015). Assessment as learning: examining a cycle of teaching, learning, and assessment of writing in the portfolio-based classroom. Studies in Higher Education, 1-18. doi:10.1080/03075079.2014.999317

Lam, R., & Lee, I. (2010). Balancing the Dual Functions of Portfolio Assessment. ELT journal, 64(1), 54-64. doi:10.1093/elt/ccp024

Lee, I. (2016). Putting Students at the Centre of Classroom L2 Writing Assessment. Canadian Modern Language Review, 72(2), 258-280. doi:10.3138/cmlr.2802

Lee, I. (2017). Classroom writing assessment and feedback in L2 school contexts.

Lee, I., & Coniam, D. (2013). Introducing Assessment for Learning for EFL Writing in an Assessment of Learning Examination-Driven System in Hong Kong. Journal of Second Language Writing, 22(1), 34-50. doi:10.1016/j.jslw.2012.11.003

Lee, I., & Mak, P. (2014). Assessment as Learning in the Language Classroom. Assessment as learning. Hong Kong: Education Bureau, 2014(3), 66-78. Retrieved from https://wlts.edb.hkedcity.net/a&l3.html

Li, X. (2018). Self-Assessment as 'Assessment as Learning' in Translator and Interpreter Education: Validity and Washback. The Interpreter and Translator Trainer, 12(1), 1-20. doi:10.1080/1750399X.2017.1418581

Liu, N.-F., & Carless, D. (2006). Peer Feedback: The Learning Element of Peer Assessment. Teaching in Higher Education - TEACH HIGH EDUC, 11(3), 279-290. doi:10.1080/13562510600680582

Luongo-Orlando, K. (2003). Authentic assessment: designing performance-based tasks. Markham, Ontario: Pembroke Publishers Limited.

Maki, P. L. (2012). Assessing for learning: Building a sustainable commitment across the institution: Stylus Publishing, LLC.

McCarthy, M., McCarten, J., & Sandiford, H. (2004). Touchstone Level 1. Cambridge: Cambridge University Press.

Mok, M. M. C. (2012). Self-directed learning oriented assessments in the Asia-Pacific. Dordrecht; London: Springer.

O'Connor, K. (2002). How to grade for learning: linking grades to standards (2nd ed.). Arlington Heights, IL: SkyLight Professional Development.

Penn, J. D. (2011). The Case for Assessing Complex General Education Student Learning Outcomes. New Directions for Institutional Research, 14, 5-14. doi:10.1002/ir.376

Piaget, J. (1960). The child's conception of the world. London: Routledge & Kegan Paul.

Pinter, A. (2006). Teaching young language learners. Oxford: Oxford University Press.

Ramsden, P. (2003). Learning to teach in higher education (2nd ed.). London; New York: RoutledgeFalmer.

Richards, J. C., & Trew, G. (2010). Basic tactics for listening (3rd ed.). New York, NY; Oxford: Oxford University Press.

Sadeghi, K., & Rahmati, T. (2017). Integrating assessment as , for , and of learning in a large-scale exam preparation course. Assessing Writing, 34, 50-61. doi:10.1016/j.asw.2017.09.003

Sendziuk, P. (2010). Sink or Swim? Improving Student Learning through Feedback and Self-Assessment. International Journal of Teaching and Learning in Higher Education, 22(3), 320-330.

Shaaban, K. (2001). Assessment of Young Learners. Forum, 39(4), 16-23.

Steele, J. M., & Lutz, D. A. (1995). Report of ACT's research on postsecondary assessment needs: American College Testing Program.

Taras, M. (2005). Assessment: Summative and Formative: Some Theoretical Reflections. British Journal of Educational Studies, 53(4), 466-478. doi:10.1111/j.1467-8527.2005.00307.x

Wehlburg, C. M. (2007). Closing the Feedback Loop Is Not Enough: The Assessment Spiral. Assessment Update, 19(2), 1-2. doi:10.1002/au.192

Wiliam, D. (2009). Assessment for learning: why, what and how? London: University of London, Institute of Education.

Wiliam, D., & Thompson, M. (2008). Integrating assessment with instruction: What will it take to make it work? In (pp. 53-82): Lawrence Erlbaum Associates.

Xiao, Y., & Yang, M. (2019). Formative assessment and self-regulated learning: How formative assessment supports students' self-regulation in English language learning. System, 81, 39-49. doi:10.1016/j.system.2019.01.004

Yancey, K. B. (1998). Reflection in the writing classroom(1 ed., pp. 1 online resource (vii, 215 p. )). doi:10.2307/j.ctt46nsh0

Yorke, M. (2003). Formative Assessment in Higher Education: Moves towards Theory and the Enhancement of Pedagogic Practice. Higher Education, 45(4), 477-501. doi:10.1023/A:1023967026413

Zarei, N., & Yasami, N. (2016). The Impact of Formative Assessment and Remedial Teaching on EFL Learners’ Listening Comprehension. Paper presented at the Conference proceedings. ICT for language learning.

Zeng, W., Huang, F., Yu, L., & Chen, S. (2018). Towards a Learning-Oriented Assessment to Improve Students' Learning--A Critical Review of Literature. Educational Assessment, Evaluation and Accountability, 30(3), 211-250. doi:10.1007/s11092-018-9281-9