Evaluating the validity of socially-situated assessment: Group dynamic assessment of intermediate EFL listening comprehension

Subject Areas :

Sara  Hashemi Shahraki ¹ (گروه زبان انگلیسی، دانشکده ادبیات و علوم انسانی، دانشگاه آزاد اسلامی، واحد نجف آباد، اصفهان، ایران)

Received: 2024-01-27 Accepted : 2024-03-17 Published : 2024-04-03

Keywords: Group dynamic assessment, Micro-validity, Macro-validity, Learner L2 development, validity arguments, and Mediation,

Abstract :

This study evaluated the validity of group dynamic assessment (G-DA), grounded in Vygotsky’s (1987) Sociocultural Theory, implemented in a class of intermediate learners to assess and promote L2 listening comprehension. To navigate the dual goals of assessment and instruction, flexible mediation attuned to the zone of proximal development of the learners was provided within the G-DA interactions. This led to the detection of nine mediational strategies. The validity of these G-DA interactions was explored by extending Poehner’s (2011) validation model to classroom setting. Poehner’s (2011) model includes two interrelated foci for DA validation: micro and macro-validity. Following Kane's (2021) argument-based approach to validation, evidence-based arguments were developed to explore the appropriateness of each mediational strategy given to the learners (micro-validity) as well as the success of that mediational strategy and the entire G-DA procedure in promoting learners’ L2 listening comprehension (macro-validity). Class transcripts were analyzed to gain evidence for the micro- and macro-validity of the G-DA interactions. The findings supported the usefulness of Poehner’s validation model in developing validity arguments to determine the appropriateness of the interpretations made about learners’ abilities and the effects of the G-DA procedure on their development. Moreover, the study concluded that the analysis of learners’ independent performance needed to be added to Pohener’s macro-validation model so that it becomes applicable to G-DA