Large and Fine-Grained Complexity Measures and Writing Quality among Iranian EFL Learners
Subject Areas : All areas of language and translationRajab Esfandiari 1 , Mohammad Ahmadi 2
1 -
2 -
Keywords: Complexity Measures, Quality of Writing, Sophistication, Development,
Abstract :
In recent years, there has been extensive research on syntactic complexity in L2 writing. However, a significant research gap remains in understanding the specific association between syntactic complexity measures and the quality of writing among adolescent learners of English as a foreign language (EFL). This research study aimed to bridge this gap by examining the connection between syntactic complexity measures and writing quality in 146 argumentative essays by Iranian-speaking learners of English as a foreign language, as assessed by human raters. Syntactic complexity measures were analyzed through computer programs called L2SCA and TAASSC. Two regression analyses were run to assess the relationship between the predictor and outcome variables. The results revealed that syntactic complexity model explained 35.6% of the variance in the outcome variable (students’ writing scores) with “dependent clauses per T-unit”, “Mean length of T-unit”, “Mean length of clause”, and “complex nominals per T-unit” as the strongest predictors. Also, the combined model accounted for 44.1% of the variance in the outcome variable. The findings from this research offer valuable insights into writing assessment and pedagogy, enabling language educators to design more effective instructional strategies tailored to the specific needs of this learner group.
Ahmadi, M., Esfandiari, R., & Zarei, A. A.(2020). A corpus-based study of noun phrase complexity in applied linguistics research article abstracts in two contexts of publication. Iranian Journal of English for Academic Purposes, 9(1), 76-94.
Al-Hoorie, A. H., Hiver, P., Larsen-Freeman, D., & Lowie, W. (2023). From replication to substantiation: A complexity theory perspective. Language Teaching, 56(2), 276-291.
Bardovi-Harlig, K. (1992). The relationship of form and meaning: A cross-sectional study of tense and aspect in the interlanguage of learners of English as a second language. Applied Psycholinguistics, 13(3), 253-278.
Baba, K., & Nitta, R. (2014). Phase transitions in development of writing fluency from a complex dynamic systems perspective. Language Learning, 64(1), 1-35.
Beers, S. F., & Nagy, W. E. (2009). Syntactic complexity as a predictor of adolescent writing quality: Which measures? Which genre? Reading and Writing, 22(2), 185-200.
Beers, S. F., & Nagy, W. E. (2011). Writing development in four genres from grades three to seven: Syntactic complexity and genre differentiation. Reading and Writing, 24(2), 183-202.
Bi, P., & Jiang, J. (2020). Syntactic complexity in assessing young adolescent EFL learners’ writings: Syntactic elaboration and diversity. System, 91, 102248.
Biber, D., & Gray, B. (2016). Grammatical complexity in academic English: Linguistic change in writing. Cambridge University Press.
Biber, D., Gray, B., & Poonpon, K. (2011). Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly, 45(1), 5-35.
Bulté, B., & Housen, A. (2014). Conceptualizing and measuring short-term changes in L2 writing complexity. Journal of Second Language Writing, 26(1), 42-65.
Bulté, B., & Housen, A. (2012). Defining and operationalizing L2 complexity. In A. Housen, F. Kuiken, & I. Vedder (Eds.), Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA (pp. 21-46). John Benjamins Publishing Company.
Casal, J. E., & Lee, J. J. (2019). Syntactic complexity and writing quality in assessed first-year L2 writing. Journal of Second Language Writing, 44, 51-62.
Casanave, C. P. (1994). Language development in students' journals. Journal of Second Language Writing, 3(3), 179-201.
Connor-Linton, J., & Amoroso, L. (Eds.). (2014). Measured language: Quantitative studies of acquisition, assessment, and variation. Georgetown University Press.
Council of Europe. (2001). Common European Framework of Reference for languages: Learning, teaching, assessment. Cambridge University Press.
Covington, M. A., He, C., Brown, C., Naci, L., & Brown, J. (2006). How complex is that sentence? A proposed revision of the Rosenberg and Abbeduto D-Level Scale. In Caspr research report 2006-01. Athens, GA: The University of Georgia, Artificial Intelligence Center.
Crossley, S. A., & McNamara, D. S. (2014). Does writing development equal writing quality? A computational investigation of syntactic complexity in L2 learners. Journal of Second Language Writing, 26(1), 66-79.
De Bot, K. (2008). Introduction: Second language development as a dynamic process. The Modern Language Journal, 92(2), 166-178.
De Bot, K., Lowie, W., & Verspoor, M. (2005). Second language acquisition: An advanced resource book. Psychology Press.
Dong, J. (2016). A dynamic systems theory approach to development of listening strategy use and listening performance. System, 63, 149-165.
Ellis, N. C., & Larsen-Freeman, D. (2009). Language as a complex adaptive system (Vol. 11). John Wiley & Sons.
Esfandiari, R., & Ahmadi, M. (2021). Syntactic complexity measures and academic writing proficiency: A corpus-based study of professional and students’ prose. The Journal of AsiaTEFL, 18(3), 745-763.
Halliday, M. A. K. (Ed.). (2004). Lexicology and corpus linguistics. Continuum.
Herdina, P., & Jessner, U. (2002). A Dynamic Model of Multilingualism: Perspectives of Change in Psycholinguistics. Multilingual Matters.
Hoang, H., & Boers, F. (2018). Gauging the association of EFL learners’ writing proficiency and their use of metaphorical language. System, 74, 1-8.
Housen, A., & Kuiken, F. (2009). Complexity, accuracy, and fluency in second language acquisition. Applied Linguistics, 30(4), 461-473.
Housen, A., Pierrard, M., & Van Daele, S. (2005). Structure complexity and the efficacy of explicit grammar instruction. Investigations in instructed second language acquisition, 12(1), 235-269.
Ke Li, Y., Lin, S., Liu, Y., & Lu, X. (2023). The predictive powers of fine-grained syntactic complexity indices for letter writing proficiency and their relationship to pragmatic ppropriateness. Assessing Writing, 56, 100707.
Klein, D., & Manning, C. D. (2003, July). Accurate unlexicalized parsing. In Proceedings of the 41st annual meeting of the association for computational linguistics (pp. 423-430).
Kreyer, R., & Schaub, S. (2018). The development of phrasal complexity in German intermediate learners of English. International Journal of Learner Corpus Research, 4(1), 82-111.
Kuiken, F., & Vedder, I. (2012). Syntactic complexity, lexical variation and accuracy as a function of task complexity and proficiency level in L2 writing and speaking. In A. Housen, F. Kuiken, & I. Vedder (Eds.), Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA (pp. 143- 170). John Benjamins Publishing Company.
Kyle, K (2016). Measuring syntactic development in l2 writing: Fine grained indices of syntactic complexity and usage-based indices of syntactic complexity sophistication [Doctoral dissertation, Georgia State University].
Kyle, K., & Crossley, S. A. (2018). Measuring syntactic complexity in L2 writing using fine‐grained clausal and phrasal indices. The Modern Language Journal, 102(2), 333-349.
Larsen-Freeman, D. (1978). An ESL index of development. TESOL Quarterly, 12(4), 439-448.
Larsen-Freeman, D. (2006). The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English. Applied Linguistics, 27(4), 590-619.
Freeman, D. L., & Cameron, L. (2008). Research methodology on language development from a complex systems perspective. The modern language journal, 92(2), 200-213.
Lennon, P. (1990). Investigating fluency in EFL: A quantitative approach. Language Learning, 40(3), 387-417.
Levy, R. & Andrew, G. (2006). Tregex and Tsurgeon: Tools for querying and manipulating tree data structures. In Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06), Genoa, Italy. European Language Resources Association (ELRA).
Lei, L., Wen, J., & Yang, X. (2023). A largescale longitudinal study of syntactic complexity development in EFL writing: A mixed-effects model approach. Journal of Second Language Writing, 59, 100962.
Lu, X. (2009). Automatic measurement of syntactic complexity in child language acquisition. International Journal of Corpus Linguistics, 14(1), 3-28.
Lu, X. (2011). A corpus‐based evaluation of syntactic complexity measures as indices of college‐level ESL writers' language development. TESOL Quarterly, 45(1), 36-62.
Lu, X., & Wu, J. (2022). Noun‐phrase complexity measures in Chinese and their relationship to L2 Chinese writing quality: A comparison with topic–comment‐unit‐ based measures. The Modern Language Journal, 106(1), 267-283.
Martínez, A. C. L. (2018). Analysis of syntactic complexity in secondary education EFL writers at different proficiency levels. Assessing Writing, 35, 1-11.
Norris, J. M., & Ortega, L. (2009). Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics, 30(4), 555-578.
Ortega, L. (2003). Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college‐level L2 writing. Applied Linguistics, 24(4), 492-518.
Ortega, L. (2009). Studying writing across EFL contexts: Looking back and moving forward. In R. M. Mancho´n (Ed.), Writing in foreign language contexts. Learning, teaching, and research (pp. 232–255). Multilingual Matters.
Ortega, L. (2012). Interlanguage complexity. Linguistic complexity: Second language acquisition, indigenization, contact, 13, 127.
Plonsky, L., & Oswald, F. L. (2017). Multiple regression as a flexible alternative to ANOVA in L2 research. Studies in Second Language Acquisition, 39(3), 579-592.
Polat, B. (2013). Language experience interviews: What can they tell us about individual differences? System, 41(1), 70-83.
Polat, N., Mahalingappa, L., & Mancilla, R. L. (2020). Longitudinal growth trajectories of written syntactic complexity: The case of Turkish learners in an intensive English program. Applied Linguistics, 41(5), 688-711.
Ravid, D., & Tolchinsky, L. (2002). Developing linguistic literacy: A comprehensive model. Journal of Child Language, 29(2), 417-447.
Rimmer, W. (2006). Measuring grammatical complexity: The Gordian knot. Language Testing, 23(4), 497-519.
Römer, U. (2009). The inseparability of lexis and grammar: Corpus linguistic perspectives. Annual Review of Cognitive Linguistics, 7(1), 140-162.
Skehan, P. (1998). Task-based instruction. Annual Review of Applied Linguistics, 18, 268-286.
Staples, S., & Reppen, R. (2016). Understanding first-year L2 writing: A lexico-grammatical analysis across L1s, genres, and language ratings. Journal of Second Language Writing, 32, 17-35.
Susoy, Z. (2023). English L1 VS. L2 differences in dissertation abstracts: Lexical density, lexical diversity and academic vocabulary use acuity: Journal of English Language pedagogy, Literature and Culture, 8(2), 17-45.
Verspoor, M., Lowie, W., & Van Dijk, M. (2008). Variability in second language development from a dynamic systems perspective. The Modern Language Journal, 92(2), 214-231.
Wolfe-Quintero, K., Inagaki, S., & Kim, H. (1998). Second language development in writing: Measures of fluency, accuracy and complexity. University of Hawaii at Manoa.
Yang, W., Lu, X., & Weigle, S. C. (2015). Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgments of writing quality. Journal of Second Language Writing, 28, 53-67.
Youn, S. J. (2014). Measuring syntactic complexity in L2 pragmatic production: Investigating relationships among pragmatics, grammar, and proficiency. System, 42, 270-287.
Zhang, X., & Lu, X. (2022). Revisiting the predictive power of traditional vs. fine-grained syntactic complexity indices for L2 writing quality: The case of two genres. Assessing Writing, 51, 100597.
