Validation of the Scale for Measuring Students' Attitudes Toward Artificial Intelligence

Validation of the Scale for Measuring Students' Attitudes Toward Artificial Intelligence

Subject Areas : Evaluation

Mohammad Akbaryborng ¹ , محمدعلی رستمی نژاد ² , Mohaddese Sarvary ^{3 *} , Razieh Rezaei ⁴

1 - Associate Professor, Educational Department, University of Birjand
2 - عضو هئیت علمی دانشگاه بیرجند. دانشکده علوم تربیتی و روانشناسی
3 -
4 - Ph.D. Student in Curriculum, Educational Department, University of Birjand.

Received: 2024-12-15 Accepted : 2025-06-15 Published : 2025-06-12

Keywords: Artificial Intelligence, Students, Attitude Measurement,

Abstract :

Artificial intelligence (AI) technology is rapidly growing and impacting various dimensions of people’s lives, and academic life is no exception. Having valid and reliable tools to measure students' attitudes toward AI is an important step for planning related research. Since there is no tool available for measuring students' attitudes toward AI in Iran, the present study aimed to validate the Persian version of the 26-item questionnaire on students' attitudes toward AI developed by Suh & Ahn (2022). To achieve this goal, an evaluation method was employed. The statistical population consisted of all high school students in Birjand, and 303 students were selected as a sample through multi-stage sampling. The results of confirmatory factor analysis showed that this questionnaire has three components — cognitive, emotional, and behavioral — and that the three-factor model has an acceptable fit with the data (X² = 642.02, CFI = 0.89, RMSEA = 0.06). Additionally, Cronbach's alpha coefficients for the components ranged between 0.79 and 0.93, indicating that the questionnaire has acceptable reliability and validity. Based on these results, it can be concluded that the students' attitudes toward AI questionnaire is a suitable tool for research in Iran.

References:

سیف، علی‌اکبر (1402). اندازه‌گیری، سنجش و ارزشیابی آموزشی (ویرایش هفتم). تهران: دوران.
شاکری نژاد، قدرت الله؛ زندیه، اعظم؛ شرهانی، اسعد؛ حاتم زاده، ناصر و مظاهری، مریم (1401). پیش‌بینی عوامل تعیین‌کننده مهارت‌های ارتباطی بین فردی در مراقبین سلامت شهر اهواز: کاربرد نظریه عمل منطقی توسعه‌یافته. طلوع بهداشت یزد،22(2)، 58-72.
ظفری، مصطفی؛ اسماعیلی، علی و صادقی نیارکی، ابوالقاسم. (1400). مروری بر کاربردهای هوش مصنوعی و واقعیت مجازی در آموزش. مطالعات اندازه‌گیری و ارزشیابی آموزشی، 11(36)،116-89.
محمدی، مهدی، ناصری جهرمی، رضا، اثنی عشری، انسیه، کوثری، مجید، خادمی، سولماز، شادی، صدیقه، نورانی زاده، حدیث. (1402). مروری ارزیابانه بر کاربرد هوش مصنوعی در آموزش عمومی. فناوری‌های آموزشی در یادگیری، 6(22)، 119-84.
Bochniarz, K. T., Czerwiński, S. K., Sawicki, A., & Atroszko, P. A. (2022). Attitudes to AI among high school students: Understanding distrust towards humans will not help us understand distrust towards AI. Personality and Individual Differences, 185, Article 111299. https://doi.org/10.1016/j.paid.2021.111299
Cukurova, M., Luckin, R., & Kent, C. (2020). Impact of an artificial intelligence research frame on the perceived credibility of educational research evidence. International Journal of Artificial Intelligence in Education, 30(2), 205–235. https:// doi.org/10.1007/s40593-019-00188-w
Foltynek, T., Bjelobaba, S., Glendinning, I., Khan, Z. R., Santos, R., Pavletic, P., & Kravjar, J. (2023). ENAI Recommendations on the ethical use of Artificial Intelligence in Education. International Journal for Educational Integrity, 19(1), 12.
Hadlington, L., Binder, J., Gardner, S., Karanika-Murray, M., & Knight, S. (2023). The use of artificial intelligence in a military context: development of the attitudes toward AI in defense (AAID) scale. Frontiers in Psychology, 14, 1164810.
Huang, X., & Qiao, C. (2024). Enhancing computational thinking skills through artificial intelligence education at a STEAM high school. Science & Education, 33(2), 383-403.
Karan-Romero, M., Salazar-Gamarra, R. E., & Leon-Rios, X. A. (2023). Evaluation of attitudes and perceptions in students about the use of artificial intelligence in dentistry. Dentistry Journal, 11(5), 125.
Kim, Y.E., & Kim, H.C. (2019). A study on middle school students’ perception on intelligent robots as companions. Journal of Korean Association of Computer Education, 22(4), 35–45.
Mohammadi, M., Naserijahromi, R., Esnaashari, E., Kowsari, M., Khademi, S., Shadi, S., & Noorani zadeh, H. (2023). An evaluative review of the use of artificial intelligence in public education. Educational Technologies in Learning, 6(22), 84-119. doi: 10.22054/jti.2024.75540.1394. [In Persian]
Ouyang, F., & Jiao, P. (2021). Artificial intelligence in education: The three paradigms. Computers and Education: Artificial Intelligence, 2, 100020. https://doi.org/10.1016/j.caeai.2021.100020
Park, J. H., & Shin, N. M. (2017). Students’ perceptions of artificial intelligence technology and artificial intelligence teachers. Journal of Korean Teacher Education, 34(2), 169–192.
Park, J., Woo, S. E., & Kim, J. (2024). Attitudes towards artificial intelligence at work: Scale development and validation. Journal of Occupational and Organizational Psychology. DOI: 10.1111/joop.12502
Qin, H., & Wang, G. (2022, January). Benefits, challenges and solutions of Artificial Intelligence applied in education. In 2022 11th International Conference on Educational and Information Technology (ICEIT) (pp. 62-66). IEEE.
Randhawa, G. K., & Jackson, M. (2020, January). The role of artificial intelligence in learning and professional development for healthcare professionals. In Healthcare management forum (Vol. 33, No. 1). Sage CA: Los Angeles, CA: SAGE Publications. https://doi.org/10.1177/0840470419869032
Schepman, A., & Rodway, P. (2020). Initial validation of the general attitudes towards Artificial Intelligence Scale. Computers in Human Behavior Reports, 1, 100014. https://doi.org/10.1016/j. chbr.2020.100014
Seif, Ali Akbar (2023). Educational Measurement, Assessment and Evaluation (7th edition). Tehran: Doran. [In Persian]
Shakerinejad, Gh., Zandieh, A., Sharhani, A., Hatemzadeh, N., & Mazaheri, M. (2012). Predicting the determinants of interpersonal communication skills in health care workers in Ahvaz city: Application of the theory of extended rational action. Tolooe behdasht Yazd, 22(2), 58-72. [In Persian]
Shin, N. M., & Kim, S. A. (2007). What do robots have to do with student learning? Journal of Korean Association for Educational Information and Media, 13(3), 79–99.
Shin, S., Ha, M., & Lee, J. K. (2018). Exploring elementary school students' image of artificial intelligence. Journal of Korean Elementary Science Education, 37(2), 126-146.
Shin, S., Ha, M., & Lee, J.K. (2017). High school students’ perception of artificial intelligence: Focusing on conceptual understanding, emotion and risk perception. Korean Association for Learner-Centered Curriculum and Instruction, 17(21), 289– 312. https://doi.org/10.22251/jlcci.2017.17.21.289
Sindermann, C., Sha, P., Zhou, M., Wernicke, J., Schmitt, H. S., Li, M., ... & Montag, C. (2021). Assessing the attitude towards artificial intelligence: Introduction of a short measure in German, Chinese, and English language. KI-Künstliche intelligenz, 35(1), 109-118.
Sohn, K., & Kwon, O. (2020). Technology acceptance theories and factors influencing artificial Intelligence-based intelligent products. Telematics and Informatics, 47, 101324.
Suh, W., & Ahn, S. (2022). Development and validation of a scale measuring student attitudes toward artificial intelligence. Sage Open, 12(2), 21582440221100463.
Wang, S., Sun, Z., & Chen, Y. (2023). Effects of higher education institutes’ artificial intelligence capability on students' self-efficacy, creativity and learning performance. Education and Information Technologies, 28(5), 4919-4939.
Xia, Q., Chiu, T. K., Lee, M., Sanusi, I. T., Dai, Y., & Chai, C. S. (2022). A self-determination theory (SDT) design approach for inclusive and diverse artificial intelligence (AI) education. Computers & Education, 189, 104582.
Xia, Q., Chiu, T. K., Zhou, X., Chai, C. S., & Cheng, M. (2022). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 100118.
Zafari, M., Esmaeily, A., & Sadeghi-Niaraki, Ab. (2021). An Overview of the Applications of Artificial Intelligence and Virtual Reality in Education. Educational Measurement and Evaluation Studies, 11(36), 89-116. doi: 10.22034/emes.2021.251559. [In Persian].