TOEFL iBT Integrated and Independent Writing Tasks: Iranian Test Takers' Performance in Focus

Subject Areas : All areas of language and translation

Farah  Shooraki ¹ (Department of English, Maybod Branch, Islamic Azad University, Maybod, Iran)
Hossein  Barati ² (Department of English Language, University of Isfahan, Isfahan, Iran)
Ahmad  Moinzadeh ³ (Department of English Language, University of Isfahan, Isfahan, Iran)

Received: 2023-10-31 Accepted : 2023-12-08 Published : 2024-04-25

Keywords: Coh-Metrix, independent writing task, integrated writing task, TOEFL-iBT, writing assessment,

Abstract :

This study aimed to compare the performance of international and Iranian test takers on TOEFL iBT integrated and independent writing tasks. The international test takers' data were provided by TOEFL organizer: Educational Testing Service (ETS). This included a total of number of 4916 samples for both integrated and independent tasks. A paired sample t-test showed the international test takers significantly outperformed on the independent task. Further, a sample of 100 integrated and independent writing tasks produced by international test takers was randomly selected through systematic sampling, and compared with 96 counterparts written by Iranian TOEFL iBT test takers. Although the difference between Iranian and International test takers was not significant, the paired sample t-test on Iranian samples per se showed that they too outperformed on the independent writing tasks. Although the difference between Iranian and International test takers was not significant, the paired sample t-test on Iranian samples per se showed that they too outperformed on the independent writing tasks.

References:

Aminzadeh, R. and Booheh, Z. S. (2015). The
Comparative Effect of Reading-to-Write
and WritingOnly Tasks on the Improvement of EFL Learners’ Writing Ability.
The Journal of Applied Linguistics, 6
(12).
Amiryousefi, M., & Tavakoli, M. (2014). An
empirical study into the effects of Iranian
test takers' personal attributes on their
TOEFL scores: Reading, writing, and listening in focus. International Journal of
Research Studies in Language Learning,
3(6), 35-45.
Barkaoui, K. (2015). Test Takers’ Writing Activities During the TOEFL iBT® Writing
Tasks: A Stimulated Recall Study. ETS
Research Report No. RR–15-04.
154 TOEFL iBT Integrated and Independent Writing Tasks: Iranian …
Biber, D., & Gray, B. (2013). Discourse
characteristics of writing and speaking
task types on the TOEFL-iBT test: A lexico-grammatical analysis. TOEFL-iBT
research report. Retrieved from
http://www.ets.org/Media/Research/pdf/RR-13-04.pdf
Camp, R. (1993). Changing the model for the direct writing assessment. In M. M. Williamson & B. A. Huot (Eds.), Validating holistic scoring for writing assessment: theoretical and empirical foundations (pp. 45-78).
Cresskill, NJ: Hampton Press, Inc.
Campbell, C. (1998). Teaching second-language writing: Interacting with text.
Boston: Heinle & Heinle.
Cho, Y., Rijmen, F., & Novak, J. (2013). Investigating the effects of prompt characteristics on the comparability of TOEFL
iBT integrated writing tasks. Language
Testing, 30(4), 513-534.
Crossley, S. A., Kristopher, K., & Dascalu, M.
(2018). The Tool for the Automatic
Analysis of Cohesion 2.0: Integrating
semantic similarity and text overlap. Behavior Research Methods, 51(1), 14–27.
Cumming, A. (1998). Theoretical perspectives
on writing. Annual Review of Applied
Linguistics, 18, 61-78.
Cumming, A. (2013). Assessing integrated
writing tasks for academic purposes:
Promises and perils. Language Assessment Quarterly, 10, 1, 1-8.
Cumming, A., Kantor, R. Baba, K., Erdoosy,
U., Eouanzoui, K., & James, M. (2006).
Analysis of discourse features and verification of scoring levels for independent
and integrated tasks for the new TOEFL
(TOEFL Monograph No. MS-30).
Princeton, NJ: ETS.
Cumming, A., Kantor, R., Baba, K., Erdosy, U.,
Eouanzoui, K., & James, M. (2005). Difference in written discourse in independent and integrated prototype tasks for
next generation TOEFL. Assessing Writing, 10, 5‒43.
Cumming, A., Kantor, R., Powers, D., Santos,
T., & Taylor, C. (2000). TOEFL 2000
writing framework: A working paper
(TOEFL Monograph Series No. 18).
Princeton, NJ: Educational Testing Service.
Cumming, A., Grant, L., Mulcahy-Ernt, P., &
Powers, D. (2004). A teacher verification
study of speaking and writing prototype
tasks for a new TOEFL. Language Testing, 21(2), 159‒197.
Esmaeili, H. (2002). Integrated reading and
writing tasks and ESL students’ reading
and writing performance in an English
languagetest.The Canadian Modern
Language Review, 58, 599–620.
ETS. (2022). TOEFL iBT® Test Content.
Retrieved from
https://www.ets.org/toefl/ibt/about/co
ntent/.
Gebril, A. (2009). Score generalizability of
academic writing tasks: Does one test
method fit it all? Language Testing,
26(4), 507-531.
Gebril, A., & Plakans, L. (2009). Investigating source use, discourse features, and
process in integrated writing tests. In
Spaan fellow working papers in second/foreign language assessment (Vol.
7, pp. 47–84). Ann Arbor: The University of Michigan.Google Scholar
Gebril, A. (2021). Learning-oriented language
assessment: Putting theory into practice.
New York: Routledge.
Gebril, A., & Plakans, L. (2009). Investigating source use, discourse features, and
process in integrated writing tests. In
Spaan fellow working papers in second/foreign language assessment
(Vol. 7, pp. 47–84). Ann Arbor: The
University of Michigan.Google
Scholar.
Gholami, J. and Alinasab, M. (2017). SourceBased Tasks in Writing Independent and
Integrated Essays. International Journal
of Instruction, 10(3), 127-142.DOI:
10.12973/iji.2017.1039a.
Graesser, A. C., McNamara, D., Cai, Z., Conley, M., Li, H., & Pennebaker, J. (2014).
Coh-Metrix measures text characteristics
at multiple levels of language and discourse. Elementary School Journal,
115(2), 211-229.
Journal of language and translation, Volume 14, Number 2, 2024 155
Creative Commons License: This work is licensed under a Creative Commons Attribution-Non Commercial-ShareAlike
International License
Grant, L., & Ginther, A. (2000). Using computertagged linguistic features to describe L2
writing differences. Journal of Second
Language Writing, 9, 123–145.
Guo, L., Crossley, S., & McNamara, D. S.
(2013). Predicting human judgments of
essay quality in both integrated and independent second language writing samples: A comparison study. Assessing
Writing, 18, 218–238.
Kim, E. J. (2017). The TOEFL iBT writing: Korean
students’ perceptions of the TOEFL iBT
writing test. Assessing Writing, 33, 1-11.
Liao, L. (2020). A Comparability Study of Text
Difficulty and Task Characteristics of
Parallel Academic IELTS Reading Tests.
English Language Teaching, 13(1).
Oxford, R. (2006). “Task-based language teaching
and learning: An overview”, The Asian EFL
Journal Quarterly, 8 (3), 94-121.
Plakans, L., Gebril, A., & Bilki, Z. (2019). Shaping
a score: The impact of fluency, accuracy,
and complexity on integrated skills performances. Journal of Language testing.
https://doi.org/10.1177/0265532216669537.
Plakans, L., & Gebril, A. (2012). A Close Investigation into Source Use in Integrated
Second Language Writing Tasks. Assessing Writing, 17(1), 18-34.
Plakans, L., & Gebril, A. (2017). Exploring the
relationship of organization and connection with scores in integrated writing assessment. Assessing Writing, 31, 18-34.
http://dx.doi.org/10.1016/j.asw.2016.08.
005 1075-2935.
Plakans, L., & Gebril, A. (2013). Using multiple
texts in an integrated writing assessment:
Source text use as a predictor of score. Journal
of Second Language Writing, 22, 217–230.
Riazi, A.M. (2016). Comparing writing performance in TOEFL-iBT and academic assignments: An exploration of textual features. Assessing Writing, 28, 15-27. DOI:
10.1016/j.asw.2016.02.001.
Shi, L. (2004). Textual Borrowing in SecondLanguage Writing. Written Communication, 21, 171-200.
Soleimani,H., and Mahdavipour, M. (2014).
The effect of variations in integrated
writing tasks and proficiency level on
features of written discourse generated
by Iranian EFL learners. Journal of
Teaching Language Skills. (JTLS)6 (2),
Ser. 75/4.ISSN: 2008-8191. pp. 131-159.
Stricker, L., & Attali, Y. (2010). Test takers’ attitudes about the TOEFL iBT (TOEFL iBT™
Report No. iBT-13). Princeton, NJ: ETS.
Yu, G. (2008). Reading to summarize in English
and Chinese: A tale of two languages?
Language Testing, 25(4), 521–551.
Weir, C. J., Huizhong, Y., and Yan, J. (2000).
An Empirical Investigation of the Componentiality of L2 Reading in English for
Academic Purposes. UCLES Cambridge: Cambridge University Press.
Weir, C. J. (2005). Language testing and validation: An evidence-based approach.
Basingstoke: Palgrave Macmillan.
Weir, C., & Shaw, S. (2006). Defining the constructs underpinning main suite writing
tests: a socio-cognitive perspective. Research Notes, 26(3), 9-14.
Weir, C. J. (1993). Understanding and developing
language tests. New York: Prentice Hall.