Testing Factorial Structure of UseLearn Questionnaire and its Implementing in E-Learning Universities of Tehran

Subject Areas : Infomartion Technology

Peyman Kamkar ¹ , Mohammad Reza Nili ² , Khadijeh Ali Abadi ³

1 - MA Graduate of Educational Technology, Allameh Tabatabaei University, Tehran, Iran
2 - Assistant Professor of Educational Technology, Allameh Tabatabaei University, Tehran, Iran
3 - Assistant Professor of Educational Technology, Allameh Tabatabaei University, Tehran, Iran

Received: 2013-10-27 Accepted : 2014-08-17 Published : 2013-11-01

Keywords: e-learning, Usability, UseLearn Questionnaire, Confirmatory Factor Analysis, universities of Tehran,

Abstract :

Usability evaluation can be the first step to improve e-learning systems. Since there is not an appropriate toll in Iran to completely evaluate it, the goal of this study was validating a foreign sample called UseLearn and its implementing in e-learning universities of Tehran. The research method was descriptive–correlational. A sample size of 288 was chosen through proportional allocation. The tool used in this study was UseLearn. The data were analyzed by confirmatory factor analysis, Cranach’s alpha coefficient, one-sample t test, ANOVA and MANOVA. Results showed that 12-factor model tested in this study was approved by AGFI. Also, factor loadings obtained for the questions (except question 29) indicated the validity of the questionnaire. Single-sample t test results indicated that the e-learning systems in e-learning universities of Tehran are not in a good situation in terms of usability. Results of MANOVA showed that there was a significant difference between the means of components of UseLearn questionnaire. Thus, UseLearn questionnaire can be used as a valid tool for assessing the usability of e-learning systems in the country. 

References:

1. Aminpour, F. (2011). How to improve web metric ranks of Iranian Medical Universities. Journal of Isfahan Medical School, 29(127), 115-125. (in Persian)


2. Badrian, M. (2008). Evaluating electronic curriculum of computer engineering on the bases of Roderick Sims Model in Khajeh Nasir University. Master's Thesis, Allameh Tabatabaei University. (in Persian).


3. Bakhshipor, A., & Dojkam, M. (2005). Confirmatory factor analysis of the Positive and Negative Affection Scale. Journal of Psychology, 9(4) 351-365. (in Persian).


4. Bevan, N. (1999). Quality in use: Meeting user needs for quality. Journal of Systems and Software, 49(1), 89-96.


5. Dadashzadeh, M. (2010). Evaluation of E-learning Course in Biomedical Engineering of Amirkabir University in 2009. Master's Thesis, Allameh Tabatabaei University. (in Persian).


6. Farzad, V., Kadivar, P., Shokri, O., & Daneshpor, Z. (2007). Confirmatory factor analysis and internal consistency of thinking styles questionnaire (short form) among students of Tabriz University. Journal of Psychology, 2(6), 83-109. (in Persian).


7. Fernandez, A., Insfran, E., & Silvia, A. (2011). Usability evaluation methods for the web: A systematic mapping study. Information and Software Technology, 53, 789-817.


8. Ghanadan, A., & Mohamadtaheri, A. (2008). Provide a model for evaluating e-learning systems. Fifth International Conference on Information and Communication Technology Management. Tehran, Iran, 17- 18 February. (in Persian).


9. Golzari, Z., Kiamanesh, A., Ghorchian, N., & Jaefari, P. (2010). Development and validation of the proposed model for evaluating the quality of e-learning in higher education system. Higher Education Curriculum Studies, 1(1), 160-185. (in Persian).


10. Hamadipor, A. (2011). Evaluating website of the medical university libraries and provide recommendations to improve them. Health Information Management, 8(2), 176-188. (in Persian).


11. Hogo, M. A. (2010). Evaluation of e-learning systems based on fuzzy clustering models and statistical tools. Expert Systems with Applications, 37, 6891–6903.


12. Homan, H. (2007). The Scientific Method in the Behavioral Sciences. Tehran: SAMT. (in Persian).


13. Hornbaek, K. (2006). Current practice in measuring usability: Challenges to studies and research. International Journal of Human Computer Studies, 64(2), 79-102.


14.  ISO 9241-11. (1998). Ergonomic requirements for office work with Visual Display Terminals (VDTs)-Part 11: Guidance on usability. Retrieved from http://www. usabilitynet.org/tools/r_international.htm


15. Karahoca, D., & Karahoca, A. (2009). Assessing effectiveness of the cognitive abilities and individual differences on e-learning portal usability evaluation. Procedia Social and Behavioral Sciences, 1, 368–380


16. Liu, Gi-Zen., Liu, Zih-Hui., & Hwang, Gwo-Jen (2011). Developing multi-dimensional evaluation criteria for English learning websites with university students and professors. Computers & Education, 56(1) 65–79.


17. McNamara, P. (2003). Usability and ELearning. Certificate in online education and training, institute of education, University of London. Retrieved from http://nte.unifr.ch/IMG/pdf/PMcNamaraUsabilityElearning.pdf


18. Mogheri, J., Ghanbarzadeh, A., Mogheri, M., Rahimifroshani, A., Akbarisari, A., & Arab, M. (2012). Validation of Farsi version of hospital survey on patient safety culture questionnaire using confirmatory factor analysis method. Hospital, 11(2), 18-28. (in Persian).


19. Mohamadi, S., Amirtimori, M., Ghasemi, M., & Atashak, M. (2009). Evaluation of Roshd educational website according to the design criteria for educational websites. Educational Innovations, 8(32), 140- 153. (in Persian).


20. Mohamadtaheri, A., & Mohamadtaheri, M. (2009). Provide a model for evaluating e-learning systems. International Conference on E-Learning and Teaching. Science and Technology University. Tehran, Iran, 9-10 December. (in Persian).


21. Momenirad, A. (2009). Learning theories in e-learning. Educational Technology, 7(27), 8-26. (in Persian).


22. Noroozi, D., & Razavi, S. A. (2011). Instructional Design Foundations. Tehran: SAMT. (in Persian).


23. Oztekin, A. (2011). A decision support system for usability evaluation of web-based information systems. Expert Systems with Applications, 38, 2110–2118.


24. Oztekin, A., Nikov, A., & Zaim, S. (2009). UWIS: An assessment methodology for usability of web-based information systems. The Journal of Systems and Software, 82, 2038–2050.


25. Oztekin, A., Zhenyu, J. K., & Ozgur, U. (2010). UseLearn: A novel checklist and usability evaluation method for eLearning systems by criticality metric analysis. International Journal of Industrial Ergonomics, 40, 455-469.


26. Razmjoian, M. (2004). Evaluating websites of research centers of the ministry of education and proposing a proposed model. Master's thesis, Islamic Azad University, North Tehran. (in Persian).


27. Rezaei, E. (2011). The effect of electronic portfolio on the attitudes, motivation, and academic achievement of e-learning center of Khajeh Nasir Toosi University. Master's thesis, Allameh Tabatabaei University. (in Persian).


28. Sarmad, Z., Bazargan, A., & Hejazi, E. (2011). Research Methods in Behavioural Sciences. Tehran: Agah. (in Persian).


29. Seeyedinazarlo, S. T. (2011). Investigating interaction between the three elements of education (students, teacher, and content) in electronically Curriculum of Khajeh Nasir Toosi University. Master's thesis, Allameh Tabatabaei University. (in Persian).


30. Seffah, A., Mohamed, T., Habieb-Mammar, H., & Abran, A. (2008). Reconciling usability and interactive system architecture using patterns. Journal of Systems and Software, 81(11), 1845-1852.


31. Shee, D. Y., & Wang, Yi-Sh. (2008). Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers & Education, 50, 894–905.


32. Zareei Zavarak, E., Aghigh K., & Rastegar, K. (2010). Measurement and evaluation of e-learning: A case study of e-learning courses of Industrial Engineering in Khaje Nasir Toosi University. Educational Assessment, 1(1), 95-119. (in Persian).