Comparison of achievement, output-input (efficiency), and output-process ratios in some provinces based on TIMSS

Subject Areas : Research in Curriculum Planning

Masoud Kabiri ¹ (Assistant professor at national center of TIMSS and PIRLS, Research Institute for Education, Tehran, Iran.)

Received: 2021-10-02 Accepted : 2022-08-24 Published : 2022-08-23

Keywords: TIMSS, Output, achievement, Input, Process, Province comparison,

Abstract :

Estimating provinces' achievement based on TIMSS and PIRLS is one of the demands of educational policy-makers, which is not possible due to some technical issues such as non-representative samples and small size of samples in most provinces. However, this has become feasible by changing the sampling design from TIMSS 2015 and assigning separate stratum to each large province; i.e. Tehran city, Tehran province, Razavi Khorasan, Khuzestan, Isfahan, and Fars. In the present study, the mathematics and science achievements of students in these provinces were compared in fourth and eighth grades as well as trends of achievements from 2015 to 2019. Furthermore, the provinces were compared in two series of variables that related to input and process. On the basis of these variables, two ratios were calculated: output-input (efficiency) and output-process ratios. The results showed that Tehran city, Isfahan, and Fars, respectively, had the highest mathematics and science achievements in both grades, afterwards, Tehran province, Razavi Khorasan, and other provinces were located in the next ranks and after all, Khuzestan was in the last rank. Similar ranks were observed in output-input (efficiency) and output-process ratios, except Tehran province that revealed better ranks in these ratios. Furthermore, Fars showed lower ranks in output-process ratio. In general, results indicated that learning quality has varied among the provinces, in addition, although there are variations in resources and inputs, these conditions can not totally account for poor performance in some provinces.

References:

Ainley J. and Thomson S. (2007). Differences in science teaching and learning across Australian states, In The Second IEAInternational ResearchConference:Proceedings ofthe IRC-2006Volume 1: Trends in International Mathematics and Science Study (TIMSS), (PP. 89- 98). The Netherlands, Amsterdam:International Association for the Evaluation of Educational Achievement (IEA).

Daneshpazhoh, Z. (2000). National assessing of Farsi achievement, Unpublished research report: Institute for Educational Research.

Johnson, S. (2015). National assessment and intelligent accountability, In D., Wyse, L., Hayward, and J., Pandya (Eds.) The SAGE handbook of curriculum, pedagogy and assessment, London: Sage.

 

Kabiri, M. (2019). BARAKAAT: Program for monitoring educational quality in Tehran – Iran’s first provincial large-scale assessment, UNESCO-NEQMAP website. Retrived in https://neqmap.bangkok.unesco.org/barakaat-program-for-monitoring-educational-quality-in-tehran-irans-first-provincial-large-scale-assessment/

Kiamanesh, A. & Kheirieh, M. (2000). Assessing basic competencies: An evaluation of educational inputs and outouts in Iran (primary fifth grade). Unpublished research report: United Nation Children's Fund and Institite for Educational Research.

Mullis, I. V.S., Martin, M. O., Foy, P., Kelly, D. L. and Fishbein, B. (2020). TIMSS 2019 international results in mathematics and science, Boston: TIMSS & PIRLS International Study Center, Lynch School of Education and Human Development, Boston College and International Association for the Evaluation of Educational Achievement (IEA).

Mullis, I. V.S., Martin, M. O., Foy, P., and Hooper, M. (2016). TIMSS 2015 international results in mathematics, Boston: TIMSS & PIRLS International Study Center, Lynch School of Education and Human Development, Boston College and International Association for the Evaluation of Educational Achievement (IEA).

Kellaghan, T. (2006), What monitoring mechanisms can be used for cross-national (and national) studies? In K.Ross &I.Genevois (Eds.). Cross-national studies of the quality of education.(PP. 51-66),Planning their design and managing their impact. Paris: International Institute for Educational Planning.

LaRoche S., and Foy P. (2020). Sample implementation in TIMSS 2019. In M. Martin, M. von Davier, and I. Mullis (Eds.). Methods and procedures: TIMSS 2019 technical report, Boston: TIMSS & PIRLS International Study Center, Lynch School of Education and Human Development, Boston College and International Association for the Evaluation of Educational Achievement (IEA).

Lietz, P., Cresswell, J. C., Rust, K. F., & Adams, R. J. (2017). Implementation of Large‐Scale Education Assessments. Chichester, UK: John Wiley & Sons

OECD (2019), PISA 2018 Results (Volume I): What Students Know and Can Do, Paris:OECD Publishing.

O’Grady, K., Deussing, M., Scerbina, T., Tao, Y., Fung, K., et al. (2019). Measuring up: Canadian results of the OECD PISA 2018 study the performance of canadian 15-year-olds. Canada, Ontario: Council of Ministers of Education, Canada

Rutkowski, L., Davier, M. v., & Rutkowski, D. (2014). Handbook of International Large-Scale Assessment: Background, Technical Issues, and Methods of Data Analysis. FL: CRC Press.

World Bank, (2018). World Development Report: Learning to Realize Education's Promise. 2018, Washington, DC: The World Bank.