Validation of video resume to assess competencies of students based on the generalizability theory

Subject Areas : Industrial

alireza zarei ¹ , Ebrahim alizadeh ² , Abasalt Khorasani ³

1 - Department of Counseling, Faculty of Psychology, Shahid Beheshti University, Tehran, Iran
2 - Department of Counseling, Faculty of Educational Sciences and Psychology, Shahid Beheshti University, Tehran, Iran
3 - Industrial and organization Psychology, Faculty of Educational science and Psychology, Shahid Beheshti University, Tehran, Iran

Received: 2021-03-18 Accepted : 2021-09-01 Published : 2023-11-22

Keywords: competency measurement, selection, video resume, Generalizability Theory,

Abstract :

The study purpose was to validate the video resume based on the estimation of the reliability of the evaluators 'score when assessing the students' competencies in the video resume. The statistical universe of this study was the graduate students Department of Counseling, Faculty of Psychology, Shahid Beheshti University in 1398, were among those targeted 30 randomly selected to provide a video resume. The measurement tool used in this study was a researcher-made questionnaire with three questions with a descriptive graphic rating scale in seven levels, the content validity of which was estimated to be 0.82. The data were analyzed based on the generalizability theory, which is based on a two-dimensional cross-component design. the results showed that the measurement object and the interaction of the evaluators' component were to measure the largest share and 67 percent of the observed variance is related to the actual variance and in addition on these scores, the generalizability and reliability coefficients are above 0.7, which are acceptable. The findings of this study are applied in assessment centers, job seekers selection and student selection in the stages of assessment, recruitment and selection for job position and education.

References:

Aamodt, M. (2016). Industrial/organizational psychology: An applied approach. Nelson Education.

Apers,C., & Derous, E. (2017). Are they accurate? Recruiters' personality judgments in paper versus video resumes. Computers in Human Behavior, 73, 9-19. https://doi.org/10.1016/j.chb.2017.02.063

Arthur Jr, W., & Villado, A. J. (2008). The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice. Journal of Applied Psychology, 93(2), 435-442. https://psycnet.apa.org/doi/10.1037/0021-9010.93.2.435

Arvey, R. D., & Campion, J. E. (1982). The employment interview: A summary and review of recent research. Personnel psychology, 35(2), 281-322. https://doi.org/10.1111/j.1744-6570.1982.tb02197.x

Crosby, O., & Liming, D. (2009). Résumés, Applications, and Cover Letters (2009). Government Printing Office.

Derous, E., & Hiemstra, A. M. (2015). Video résumés portrayed: findings and challenges. In Employee Recruitment, Selection, and Assessment (pp. 57-72). Psychology Press.

Frasca, K. J., & Edwards, M. R. (2017). Web‐based corporate, social and video recruitment media: Effects of media richness and source credibility on organizational attraction. International Journal of Selection and Assessment, 25(2), 125-137. https://doi.org/10.1111/ijsa.12165

Gatewood, R., Feild, H. S., & Barrick, M. (2015). Human resource selection. Nelson Education.

Gissel, A. L., Thompson, L. F., & Pond, S. B. (2013). A theory‐driven investigation of prospective applicants' intentions to submit video résumés. Journal of Applied Social Psychology, 43(12), 2449-2461. https://doi.org/10.1111/jasp.12191

Hiemstra, A. M., Derous, E., Serlie, A. W., & Born, M. P. (2012). Fairness perceptions of video resumes among ethnically diverse applicants. International Journal of Selection and Assessment, 20(4), 423-433. https://doi.org/10.1111/ijsa.12005

Reynolds, A. H. (1979). The reliability of a scored oral interview for police officers. Public Personnel Management, 8(5), 324-328. https://www.ncjrs.gov/App/Publications/abstract.aspx?ID=70325

Robert L. Brennan. (2011). generalizability theory. Springer.

Scherbaum, C., Dickson, M., Larson, E., Bellenger, B., Yusko, K., & Goldstein, H. (2018). Creating Test Score Bands for Assessments Involving Ratings using a Generalizability Theory Approach to Reliability Estimation. Personnel Assessment and Decisions, 4(1), 1-8. 10.25035/pad.2018.001 

Urbina, S. (2014). Essentials of psychological testing. John Wiley & Sons.

Waung, M., Hymes, R. W., & Beatty, J. E. (2014). The effects of video and paper resumes on assessments of personality, applied social skills, mental capability, and resume outcomes. Basic and Applied Social Psychology, 36(3), 238-251. https://doi.org/10.1080/01973533.2014.894477

Waung, M., Hymes, R., Beatty, J. E., & McAuslan, P. (2015). Self‐promotion Statements in Video Resumes: Frequency, intensity, and gender effects on job applicant evaluation. International Journal of Selection and Assessment, 23(4), 345-360. https://doi.org/10.1111/ijsa.12119

Weinstein, D. (2012). The psychology of behaviorally-focused résumés on applicant selection: Are your hiring managers really hiring the ‘right’people for the ‘right’jobs?. Business Horizons, 55(1), 53-63. https://doi.org/10.1016/j.bushor.2011.09.003

Wilson, M. A., Bennett Jr, W., Gibson, S. G., & Alliger, G. M. (Eds.). (2013). The Handbook of Work Analysis: Methods, Systems, Applications and Science of Work Measurement in Organizations. Routledge.

Zaidi, N. B., Swoboda, C., Wang, L. L., & Manuel, R. S. (2014). Variance in attributes assessed by the multiple mini-interview. Medical Teacher, 36(9), 794-798. https://doi.org/10.3109/0142159X.