Second Language Reading Comprehension: A Reading Issue or a Language Problem--A Partial Least Square Modeling Analysis

Subject Areas :

Roshanak Rezaei ¹ , ّّFaramarz Aziz Malayeri ² , Abbas Bayat ³ , Hossein Ahmadi ⁴

1 - Foreign Languages, Teaching English as a Foreign Language, Islamic Azad University, Malayer Branch
2 - دانشگاه آزاد اسلامی واحد ملایر
3 - Department of English Language, Malayer Branch, Islamic Azad University, Malayer, Iran
4 - Assistant Professor in TEFL, Department of English Language, Malayer Branch, Islamic Azad University, Malayer, Iran

Received: 2024-06-17 Accepted : 2024-07-25 Published : 2024-06-23

Keywords: General Cognitive Abilities, Linguistic competence, Reading Comprehension Sub-skills,

Abstract :

The application of comprehension skills as a general cognitive ability has long been discussed in the literature on second language reading comprehension. To trace second language reading comprehension difficulties back to the text or reader attributes, the present study investigates the optimum load of linguistic and non-linguistic components of second language reading ability. The study followed a quantitative method of research, and the data were collected on the performance of 164 Iranian foreign language learners with different educational backgrounds. A group of Teaching English as a Foreign Language (TEFL) experts provided feedback on the specifications of the sample test items based on the Comprehensive Taxonomy of Reading Sub-skills (CTRS) derived from major taxonomies in the literature. Applying exploratory factor analysis and correlational computations, the results revealed that although the items were all convergent to measure the same latent construct, items aimed at measuring general cognitive comprehension skills had more contribution to the overall test scores. Teachers at both language institutes and ministry of education, test developing organizations, and students who seek to gain more success in reading comprehension examinations can benefit from this study feedback.

References:

Afflerbach, P. (2017) Understanding and using reading assessment. Alexandria, Virginia, USA: ASCD

Ahmed, Y., Francis, D. J., York, M., Fletcher, J. M., Barnes, M., & Kulesz, P. (2016). Validation of the direct and inferential mediation (DIME) model of reading comprehension in grades 7 through 12. Contemporary Educational Psychology, 44, 68-82.

Alderson, J. C. (2000). Assessing reading. Cambridge: Cambridge University Press.

Anderson, P. C. & Pearson, P. D. (1984). A schematic-theoretic view of basic processes in reading. In P. D. Pearson (Ed.), Handbook of reading research (pp.255-292). White Plains, NY: Longman.

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford university press.

Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests (Vol. 1). Oxford University Press.

Bachman, L., & Palmer, A. S. (2010). Language testing in practice. Oxford: Oxford University Press.

Baker, L., & Brown, A. L. (1984). Metacognitive skills and reading. In P. D. Pearson, R. Barr, M. L. Kamil, & P. Mosenthal (Eds.) Handbook of research in reading (pp. 353-394). White Plains, NY: Longman.

Bernhardt, E. B. (1993). Reading development in a second language: Theoretical, empirical, & classroom perspectives. Norwood, NJ: Ablex Publishing Corporation.

Bernhardt, E. B. (1991). A psycholinguistic perspective on second language literacy. In J. H. Hulstijin & J. F. Matter (Eds.), Reading in two languages, AILA Review 8 (pp.31-44). Amesterdam.

Bernhardt, E., & Kamil, M. (1995). Interpreting relationships between L1 and L2 reading: Consolidating the linguistic threshold and the linguistic interdependence hypotheses. Applied Linguistics, 16, 15-34.

Birch, B. M. (2002). English L2 reading: Getting to the bottom. London: Routledge.

Brimo, D., Apel, K., & Fountain, T. (2017). Examining the contributions of syntactic awareness and syntactic knowledge to reading comprehension. Journal of Research in Reading, 40(1), 57-74.

Buck, G., Tatsuoka, K. K., & Kostin, I. (1997). The sub-skills of reading: Rule-space analysis of a multiple –choice test of second language reading comprehension. Language Learning, 47, 423-466.

Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied linguistics, 1(1), 1-47.

Carrell, P. L. (1983). Three components of background knowledge in reading comprehension 1. Language learning, 33(2), 183-203.

Carroll, J. B. (1993). Human cognitive abilities. Cambridge: Cambridge University Press.

Cheng, L. (2005). Changing language teaching through language testing: A wash back study (Vol. 21). Cambridge University Press.

Clarke, M. (1979). Reading in Spanish and English: Evidence from adult ESL students. Language Learning, 29, 121-150.

Clarke, M. (1980). The short circuit hypothesis of ESL reading: Or when language competence interferes with reading performance. Modern Language Journal, 64, 203-209.

Clymer, T. (1968). What is reading? Some current concepts. Innovation and Change in Reading Instruction. National Society for the Study of Education, Chicago.

Council of Europe. Council for Cultural Co-operation. Education Committee. Modern Languages Division. (2001).
Common European Framework of Reference for Languages: learning, teaching, assessment. Cambridge University Press.

Cummins, J. (1979). Linguistic interdependence and the development of bilingual children. Review of Educational Research, 49, 222-251.

Coady, J. (1979). A psycholinguistic model for the ESL reader. In R. MacKay, B. Barkman, & R. R. Jordan (Eds.), Reading in a second language: Hypothesis, organization and practice (pp. 5- 12). Rowley, MA: Newbury House.

Cervetti, G. N., Hiebert, E. H., Pearson, P. D., & McClung, N. A. (2015). Factors that influence the difficulty of science words. Journal of Literacy Research, 47(2), 153-185.

Danuwijaya, A. A. (2018). Item Analysis Of Reading Comprehension Test For Post-Graduate Students. English Review: Journal of English Education, 7(1), 29-40.

Davis, A. (1968). Language testing symposium: A psycholinguistic approach. London: Oxford University Press.

Davidson, F. (2008). The straightjacket and the blessing of the canon. Language Assessment Quarterly, 5(3), 267-274.

Davidson, F., & Lynch, B. K. (2002). Testcraft: A teacher’s guide to writing and using language test specifications. New Heaven. CT: Yale University Press.

Day, R. R., & Bamford, J. (1998). Reading in the second language classroom. Cambridge: Cambridge University Press.

Day, R. R., & Park, J. S. (2005). Developing Reading Comprehension Questions. Reading in a foreign language, 17(1), 60-73.

Earl, L. M. (2012). Assessment as learning: Using classroom assessment to maximize student learning. Corwin Press.

Ellis, R., Tanaka, Y., & Yamazaki, A. (1994). Classroom interaction, comprehension, and the acquisition of L2 word meanings. Language learning, 44(3), 449-491.

Estaji, M., & Zhaleh, K. (2020). Does Field of Study Matter in Academic Performance: Differential Item Functioning Analysis of a High-Stakes Test Using One-Parameter and Two-Parameter Item Response Theory Models. Iranian Journal of English for Academic Purposes, 9(3), 14-31.

Farhady. H., & Hessamy, G. R. (2005). Construct validity of L2 reading comprehension skills. Iranian Journal of Applied Linguistics, 8(2), 29-53.

Fletcher, J. M. (2006). Measuring reading comprehension. Scientific Studies of Reading, 10(3), 323–330.

Garson, G. D. (2016). Partial least squares: Regression and structural equation models. Asheboro, NC: Statistical Associates Publishers.

Gernsbacher, M.A. (1985) Surface information loss in comprehension. Cognitive Psychology, 17, 324–363.
Grabe, W. (2009). Reading in a second language: Moving from theory to practice. Cambridge: Cambridge University Press.

Grabe, W. (1991). Current development in second language reading research. TESOL Quarely, 25(3), 375-406.

Grabe, W. & Stoller, F. L. (2002). Teaching and researching reading. London: Longman.

Gray, W. S. (1960). The major aspects of reading. In H. Robinson (Ed.), sequential development of reading abilities (Vol. 90, pp.8-24). Chicago: Chicago University Press.

Gottardo, A., Mirza, A., Koh, P. W., Ferreira, A., & Javier, C. (2018). Unpacking listening comprehension: The role of vocabulary, morphological awareness, and syntactic knowledge in reading comprehension. Reading and Writing, 31(8), 1741-1764.

Hair Jr, J. F., Hult, G. T. M., Ringle, C., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM). Sage publications.

Hemmati, S. J., Baghaei, P., & Bemani, M. (2016). Cognitive diagnostic modeling of L2 reading comprehension ability: Providing feedback on the reading performance of Iranian candidates for the university entrance examination. International Journal of Language Testing, 6(2), 92-100.

Hoover, W. A., & Tunmer, W. E. (1993). The components of reading. In G. G., Thompson, W. E. Tunmer, & T. Nicholson (Eds.), Reading acquisition processes (pp. 1-19). Clevedon: Multilingual Matters Ltd.

Hu, M., & Nation, I. S. P. (2000). Vocabulary density and reading comprehension. Reading in a Foreign Language, 23, 403–430.

Jiang, X. (2011). The role of first language literacy and second language proficiency in second language reading comprehension. The Reading Matrix, 11(2), 177-190.

Jiang, X., & Grabe, W. (2011). Skills and strategies in foreign language reading. La lectura en lengua extranjera, 2-31.

Kintsch, W. (1974). The representation of meaning in memory. Hillsdale, NJ: Erlbaum.

Kent State University. (2020, August, 11). Three Level Comprehension Guide for Active Reading. https://www-s3-live.kent.edu/s3fs-root/s3fs public/file/Three%20Level%20Comprehension%20Guide%20for%20Active%20Reading.pdf
Koda, K. (2005). Insights into second language reading. New York: Cambridge University Press.

Koda, K. (2007). Reading and language learning: Crosslinguistic constraints on second language reading development. In K. Koda (Ed.), Reading and language learning (pp. 1-44). Special issue of Language Learning Supplement, 57, 1-44.

Laufer, B. (1989). What percentage of text-lexis is essential for comprehension? In C. Lauren & M. Nordman (Eds.),
Special language: From humans to thinking machines (pp. 316–323). Clevedon, England: Multilingual Matters.

Lumley, T. (1993). The notion of sub-skills in reading comprehension test: An EAP example. Language Testing, 10(3), 211–234.

Lunzer, E., Waite, M., & Doltan, T. (1979). Comprehension and comprehension test. In E. Lunzer & K. Gardner (Eds.), The effective use of reading (pp. 37-71). London: Heinemann Educational Books Ltd.

Moeini Asl, H. R. (2002). Construct validation of reading comprehension tests. Unpublished MA thesis, University for Teacher Education, Tehran.

Munby, J. (1978). Communicative syllabus design. Cambridge: Cambridge University Press.

OECD (2019), PISA 2018 results (Volume I): What students know and can do, PISA, OECD Publishing, Paris, https://doi.org/10.1787/5f07c754-en.

Paris, S. G., & Hamilton, E. E. (2009). The development of children’s reading comprehension. In S. E. Israel & G. G. Duffy (Eds.), Handbook of research on reading comprehension (pp. 32- 53). New York: Routledge.

Pearson, P. D., & Cervetti, G. N. (2015). Fifty years of reading comprehension theory and practice. Research-based practices for teaching Common Core literacy, 1-24.

Pearson, P. D., & Johnson, D. D. (1978). Teaching reading comprehension. New York: Rinehart and Winston.

Perfetti, C. (1985). Reading ability. New York:Oxford University Press.

Perfetti, C. (1992). The representation problem in reading acquisition. In P. Gough, L. Ehri, & R. Treiman (Eds).

Reading acquisition. Hillsdate, NJ: Lawrence Erlbaum.

Perfetti, C. (2007). Reading ability to comprehension. Scientific Studies of Reading, 8, 357-383.

Perfetti, C., & Hart, L. (2001). The lexical basis of comprehension skill. In D. Gorfien (Ed.), On the consequences of meaning selection (pp. 67-86). Washington, DC: American Psychological Association.

Praveen, S. D., & Rajan, P. (2013). Using Graphic Organizers to Improve Reading Comprehension Skills for the Middle School ESL Students. English Language Teaching, 6(2), 155-170.

Ramezaney, M. (2014). The wash back effects of university entrance exam on Iranian EFL teachers’ curricular planning and instruction techniques. Procedia-Social and Behavioral Sciences, 98, 1508-1517.

Ranjbaran, F., & Alavi, S. M. (2017). Developing a reading comprehension test for cognitive diagnostic assessment: A RUM analysis. Studies in Educational Evaluation, 55, 167-179.

Rosenblatt, L. M. (1938, 1968). Literature as exploration. New York: Noble and Noble, Publishers.

Rumelhart, D. E. (1985). Towards an interactive model of reading. In H. Singer & R.B. Ruddell (Eds.), Theoretical models and processes of reading. Newark, Delaware: International Reading Association.

Rumelhart, D. E. (1977). Understanding the summarizing stories. In D. LaBerge & S. J. Samuels (Eds.) Basic processes in reading perception and comprehension (pp. 265-303). Hillsdale, NJ: Lawrence Erlbaum.

Saville, N. (2012). Quality management in test production and administration. In G. Fulcher and F. Davidson: Routledge handbook of language testing (pp. 395-412). London: Routledge.

Schmitt, N., Jiang, X., & Grabe, W. (2011). The percentage of words known in a text and reading comprehension. The Modern Language Journal, 95(1), 26-43.

Shahmirzadi, N., Siyyari, M., Marashi, H., & Geramipour, M. (2020). Selecting the Best Fit Model in Cognitive Diagnostic Assessment: Differential Item Functioning Detection in the Reading Comprehension of the PhD Nationwide Admission Test. Journal of Language and Translation, 10(3), 1-15.

Stein, N. L., & Glenn, C. G. (1979). An analysis of story comprehension in elementary school children. New Directions in Discourse Pocessing, 2, 53-120.

Shiotsu, T., & Weir, C. J. (2007). The relative significance of syntactic knowledge and vocabulary breadth in the prediction of reading comprehension test performance. Language Testing, 24(1), 99-128.

Stanovich, K. E. (2000). Progress in understanding reading: Scientific foundations and new frontiers. New York: Guilford Press.

Tiwari, P. R. (2021). Reading Comprehension of Grade 8 Students: A Glimpse of Item Piloting. Educational Assessment, 81.80-96.

Urquhart, A. H., Weir, C. J. (1998). Reading in a second language: process, product, and practice. New York: Longman.

Vandergrift, L., & Goh, C. C. M. (2012). Teaching and learning second language listening: Metacognition in action. New York: Routledge.

Walter, C. (2007). First‐to second‐language reading comprehension: not transfer, but access. International Journal of Applied Linguistics, 17(1), 14-37.

Weir, C., Huizhong, Y., & Yan, J. (2000). An empirical investigation of the componentiality of L2 reading in English for academic purposes (Vol. 12). Cambridge University Press.

Weir, C. J. (2005). Language testing and validation. Hampshire: Palgrave McMillan.

Williams, E. & Moran, C. (1989). Reading in a foreign language at intermediate and advanced levels with particular reference to English.Language Teaching, 22 (4), 217-228.

Yamasaki, B. L., & Prat, C. S. (2021). Predictors and consequences of individual differences in cross-linguistic interactions: A model of second language reading skill. Bilingualism: Language and Cognition, 24(1), 154-166.

Zandi, H., Kaivanpanah, S., & Alavi, S. M. (2014). The Effect of Test Specifications Review on Improving the Quality of a Test. Iranian Journal of Language Teaching Research, 2(1), 1-14.

Zhang, L. (2018). Metacognitive and cognitive strategy use in reading comprehension: A structural equation modelling approach. Singapore: Springer.

Zwaan, R., & Rapp, D. (2006). Discourse comprehension. In M. A. Traxler & M. A. Gernsbacher (Eds.), Handbook of psycholinguistics (2nd ed. Pp. 725-764). Burlington, MA: Academic Press.