Developing and Validating a Questionnaire to Assess Strategic Competence in EFL Listening Performance: A Structural Equation Modeling Approach

Subject Areas : Research in English Language Pedagogy

Maryam Haghighi ¹ , Mojgan Rashtchi ² , Parviz Birjandi ³

1 - Department of Foreign Languages, Faculty of Literature, Humanities, and Social Sciences, Science and Research Branch, Islamic Azad University, Tehran, Iran
2 - TEFL Department, Islamic Azad University, North Tehran Branch.
3 - Department of Foreign Languages, Faculty of Literature, Humanities, and Social Sciences, Science and Research Branch, Islamic Azad University, Tehran, Iran

Received: 2018-09-10 Accepted : 2019-01-12 Published : 2019-07-01

Keywords: Cognitive strategies, Validation, Strategic Competence, Metacognitive strategies,

Abstract :

This study aimed to describe the development and validation process of a listening questionnaire designed to assess strategic competence in listening comprehension. The 34-item Cognitive and Metacognitive Listening Strategies Questionnaire (CMLSQ) was administered to a relatively large sample (N=397) of L2 learners. The results of the 370 completed questionnaires were subjected to exploratory factor analysis to identify the underlying structure of the questionnaire, and to a confirmatory factor analysis to examine the validity of the model as a good fit for the data. Based on the results of exploratory factor analysis, a three-factor model underlying metacognitive strategies and a five-factor model underlying cognitive strategies were hypothesized. These models were then evaluated through confirmatory factor analysis using AMOS 18. The results indicated that the current models and their parameters well fit the data gathered from the questionnaires.

References:

Bachman, L. F.(1990). Fundamental considerations in language testing. Oxford: Oxford University Press.

Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford: Oxford University Press.

Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice. Oxford: Oxford University Press.

Bacon, S. M. (1992). The relationship between gender, comprehension, processing strategies, and cognitive and affective response in foreign language listening. The Modern Language Journal, 76(2), 160-178. doi:10.1111/j.1540-4781.1992.tb01096.x

Bidabadi, F., & Yamat, H. (2011). The relationship between listening strategies used by Iranian EFL freshman university students and their listening proficiency levels. English Language Teaching, 4(1), 26-32. doi:10.5539/elt.v4n1p26

Brown, A. L. (1980). Metacognitive development and reading. In R. J. Spiro, B. C. Bruce, & W.F. Brewer (Eds.), Theoretical issues in reading comprehension: Perspectives from psychology, linguistics, artificial intelligence and education (pp. 453-482). Hillsdale: Erlbaum.

Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1(1), 1-47. doi:10.1093/applin/i.1.1

Carrell, P. L. (1989). Metacognitive awareness and second language reading. Modern Language Journal, 73(2), 121-131. doi:10.2307/326568

Chamot, A. U. (2005). Language learning strategy instruction: Current issues and research. Annual Review of Applied Linguistics, 25, 112-130. doi:10.1017/s0267190505000061

Chamot, A. U., & O’Malley, J. M. (1987). The cognitive academic language learning approach: A bridge to the mainstream. TESOL Quarterly, 21 (2), 227-249. .doi:10.2307/3586733

Chang, C. A. (2008). Sources of listening anxiety in learning English as a foreign language. Perceptual and Motor Skills, 106(1), 21-34. doi:10.2466/pms.106.1.21-34

Chen, L., Zhang, R., & Liu, C. (2014). Listening strategy use and influential factors in Web-based computer assisted language learning. Journal of Computer-Assisted Learning, 30, 207-219. doi: 10.1111/jcal.12041

Cliff, N. (1987). Analyzing multivariate data. New York: Harcourt College Pub.

Dornyei, Z. (2003). Questionnaires in second language research: Construction, administration and processing. Mahwah: Erlbaum.

Flowerdew, J. H., & Miller, L. (2005). Second language listening: Theory and practice. New York: Cambridge University Press.

Floyd, F. J. & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286-299. doi:10.1037//1040-3590.7.3.286      

Gillham, B. (2000). Developing a questionnaire. London: Continuum.

Goh, C. (2002). Exploring listening comprehension tactics and their interaction patterns.  System, 30(2), 185-206. doi:10.1016/s0346-251x(02)00004-0

Goh, C. (1998). How learners with different listening abilities use comprehension strategies and tactics. Language Teaching Research, 2(2), 124-147. doi:10.1177/136216889800200203

Kline, R. B. (2011). Principles and practices of structural equation modeling (2^nd ed.). New York: Guilford

Liu, H. (2008). A study of the interrelationship between listening strategy use, listening

proficiency, and learning style. ARECLS, 8, 84-104. Retrieved from    https://research.ncl.ac.uk/media/sites/researchwebsites/arecls/liu_vol5.pdf

O’Malley, M. J., & Chamot, A. U. (1990). Learning strategies in second language acquisition. Cambridge: Cambridge University Press.

Oller, J. W. (1979). Language tests at school. London: Longman.

Oxford, R. (1990). Language learning strategies: What every teacher should know. Boston:  Heinle & Heinle.

Pallant, J. (2013). SPSS survival manual: a step by step guide to data analysis using IBM SPSS (5^th ed). Maidenhead: Open University Press.

Paris, S. G., & Jacobs, J. (1984). The benefits of informed instruction for children’s reading awareness and comprehension skills. Child Development, 55(6), 2083-2093. doi:10.1111/j.1467-8624.1984.tb03904.x

Paris, S. G., Lipson, M. Y., & Wixson, K. K. (1983). Becoming a strategic reader. Contemporary Educational Psychology, 8(3), 293-316. doi:10.1016/0361476x(83)90018-8

Phakiti, A. (2003). A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading comprehension test performance. Language Testing, 20(1), 26-56. doi:10.1191/0265532203lt243oa

Phakiti, A. (2006). Modeling cognitive and metacognitive strategies and their relationships to EFL reading test performance. Melbourne Papers in Language Testing, 1, 53-95.

Phakiti, A. (2008). Construct validation of Bachman and Palmer’s (1996) strategic competence model over time in EFL reading tests. Language Testing, 25(2), 237-272. doi:10.1177/0265532207086783

Politzer, R. L., & McGroarty, M. (1985). An exploratory study of learning behaviors and their relationship to gains in linguistic and communicative competence. TESOL Quarterly, 19(1), 103-123. doi:10.2307/3586774

Purpura, J. E. (1997). An analysis of the relationships between test takers’ cognitive and metacognitive strategy use and second language test performance. Language Learning, 47(2), 289-294. doi:10.1111/0023-8333.91997009

Purpura, J. E.(1999). Learner strategy use and performance on language tests: A structural equation modeling approach. Cambridge: CambridgeUniversity Press.

Rashtchi, M., & Khani, P. (2010). Improving Iranian EFL learners’ oral proficiency through metacognitive strategies instruction. Journal of English Language Studies, 1(4), 137-156.

Richards, J. (1990). The language teaching matrix. Cambridge: Cambridge University Press.

Rubin, J. (1994). A review of second language listening comprehension research. The Modern Language Journal, 78(2), 199-217. doi:10.2307/329010

Sheoery, R., & Mokhtari, K. (2001). Differences in the metacognitive awareness of reading strategies among native and non-native readers. System, 29(4). 431-449. doi:10.1016/s0346-251x(01)00039-2

Teng, H. (1997). An investigation of EFL listening strategies by Taiwanese college students.

 Proceedings of the Sixth International Symposium on English Teaching. Taipei: The Crane Publishing Co., Ltd.

Vandergrift, L. (1997). The strategies of second language (French) listeners: A descriptive study. Foreign Language Annals, 30(3), 387-409. doi:10.1111/j.1944-9720.1997.tb02362.x

Vandergrift, L. (2003). Orchestrating strategy use: Toward a model of the skilled second language listener. Language Learning, 53(3), 463-496. doi:10.1111/1467-9922.00232

Vandergrift, L., & Goh, C. (2012). Teaching and learning second language listening: Metacognition in action. New York: Routledge.

Vandergrift, L., Goh, C., Mareschal, C. J., & Tafaghodtari, M. H. (2006). The metacognitive awareness listening questionnaire: Development and validation. Language Learning, 56(3), 431-462. doi:10.1111/j.1467-9922.2006.00373.x

Vogely, A. (1995). Perceived strategy use during performance on three authentic listening comprehension tasks. Modern Language Journal, 79(1), 41-56. doi:10.1111/j.15404781.1995.tb05414.x

Wenden, A.L. (1991). Learner strategies for learner autonomy. Englewood Cliffs: Prentice-Hall.

Wenden, A. L. (1998). Metacognitive knowledge and language learning. Applied Linguistics, 19(4), 515-537. doi:10.1093/applin/19.4.515

Zeng, Y. (2012). Metacognition and self-regulated learning (SRL) for Chinese EFL listening development. Unpublished doctoral dissertation, Nanyang Technological University, Singapore.

Zhang, L. J. (2010). A dynamic metacognitive systems account of Chinese university

students’ knowledge about EFL reading. TESOL Quarterly, 44, 320–353.

Zhang, L., Goh, C. M. C., & Kunnan, A. J. (2014). Analysis of test takers’ metacognitive and cognitive strategy use and EFL reading test performance: A multi-sample SEM approach. Language Assessment Quarterly, 11(1), 76-102. doi:10.1080/15434303.2013.853770

Zhang, L., & Zhang, L. J. (2013). Relationships between Chinese college test takers' strategy use and EFL reading test performance: A structural equation modeling approach. RELC Jornal, 44(1), 35-57. doi:10.1177/0033688212463272