Validation of Managers’ Promotional Assessment Center in Isfahan Gas Company

Subject Areas : Educational

Mahdiehsadat Khoshouei ¹ , Hamidreza Oreyzi ² , Afshin Jahanbazi ³

1 - Psychology, University of Isfahan, Isfahan, Iran.
2 - Academic member, University of Isfahan, Isfahan, Iran.
3 - Psychology, University of Isfahan, Isfahan, Iran.

Received: 2016-02-07 Accepted : 2018-09-16 Published : 2018-10-23

Keywords: validity, standardization, Managers&rsquo, promotional assessment center, Reliability,

Abstract :

The goal of this research was validation of manager’s promotional assessment center in Isfahan Gas company.In order to achieve the goal,  according to assessment center designed Isfahan Gas company (khoshouei, Oreyzi and Nouri, 2014) eight mid-level managers of companyas participant and thirteen experts with masters’ degree at industrial and organizational psychology as expert and assessorselected purposefully (homogeneous sampling). Then, experts were completed the training course effectiveness questionnaire and simulation exercise effectiveness questionnaire, assessors were completed the simulation exercise effectiveness questionnaire and behaviorally anchored rating scale and managers were completed the simulation exercise effectiveness questionnaire and managerial dimensional questionnaire (Khoshouei, 2012). Therefore, standardization (by survey of experts and managers), face validiy (by survey of experts and assessors), content validiy (by survey of managers), concurrent validiy (by correlation of simulations ratings and managerial dimensional questionnaire) and construct validiy (multi-trait multi-method analysis) were established.Reliability of assessment center were found to be confirmatory by inter- rater reliability, intra-rater reliability, reliability of same dimensions in different exersices, and behaviorally anchored rating scale reliability.

References:

ابوالعلایی،‌ ب.، و غفاری، ‌ع. (1386). مدیران آینده: مبانی نظری و تجارب عملی برنامه‌های استعدادیابی و جانشین‌پروری مدیران. تهران: انتشارات سازمان مدیریت صنعتی.

بالانتاین، ی.، و پوا، ن. (1385). کانون‌‌های ارزیابی و توسعه مدیران. ترجمه مسعود سلطانی. تهران: انتشارات آسیا.

تورنتن، ج. سی. (1386). کانون‌‌های ارزیابی در مدیریت منابع انسانی. ترجمه سعید جعفری‌مقدم، مجید سلیمی و سعید شهباز مرادی. تهران: موسسه انتشارات و چاپ دانشگاه تهران.

خشوعی، م. س. (1391). طراحی کانون ارزیابی ارتقایی مدیران و بررسی ویژگی‌های روان‌سنجی و فرایندهای آن. پایان‌نامه دکتری روان‌شناسی دانشگاه اصفهان.

خشوعی، م. س. (1393). شبیه‌سازی سازمانی در مدیریت منابع انسانی: از نظریه تا عمل (راهنمای پژوهشگران و سازمان‌ها). اصفهان: انتشارات دانشگاه اصفهان.

خشوعی، م. س.، عریضی، ح. ر.، و نوری، ا. (1393). طراحی و اجرای کانون ارزیابی ارتقایی مدیران (مطالعه موردی: شرکت گاز استان اصفهان). مجله مدیریت منابع انسانی دانشگاه امام حسین (ع). 3، 47- 27.

خشوعی، م. س.، عریضی، ح. ر.، و نوری، ا.، و جهانبازی، ا. (1392). طراحی الگوی شایستگی مدیریتی. مطالعات مدیریت راهبردی، شماره 14، 165-145.

رنجبر، ه.، حقدوست، ع. ا.، صلصالی، م.، خوشدل، ع. ر.، سلیمانی، م. ع.، و  بهرامی، ن. (1391). نمونه‌گیری در پژوهش‌های کیفی: راهنمایی برای شروع. مجله دانشگاه علوم پزشکی ارتش جمهوری اسلامی ایران، 10 (3)، 250- 238.

عبدی، ا،؛ و دیانتی. م. (1387). مراکز ارزیابی، روش نوین جانشین‌پروری. تدبیر، شماره 195،31- 26.

کوک، م.، و کریپس، ب. (1388). سنجش و ارزیابی روان‌شناختی در محیط کار (راهنمای مدیران). ترجمه جهانبخش صادقی. تهران: انتشارات سمت.

گل‌پرور، م.، ‌و خاکسار، ف. (1389). رابطه بین هوش هیجانی با عملکرد شغلی کارکنان کارخانجات صنعتی شهر اصفهان. دانشور رفتار (روان‌شناسی بالینی و شخصیت)، 40، 34- 19.

نوری، ا.، عریضی،ح. ر.، مولوی، ح.، کلانتری، م.، نشاط دوست، ح. ط.، شفتی، ع.، و موسویان، ح. (1384). مهارت‌های روان‌شناختی مورد نیاز در مشاغل مدیریتی: حوزه مدیریت شرکت گاز استان اصفهان. گزارش پژوهش برون‌دانشگاهی بین دانشگاه اصفهان و شرکت ملی گاز ایران.

Bonini Campos, J. A. D., & Do Prado C, D. d. (2012). Cross-cultural adaptation of the Portuguese version

 

of the Patient-Generated Subjective Global Assessment. Nutrición Hospitalaria, 27(2): 583-594.

Bowler, M.C., & Woehr, D. J. (2006). A meta-analytic evaluation of the impact of dimension and exercise factors on assessment center ratings. Journal of Applied Psychology, 91(5), 1114-1124.

Burnett. M., & Dutsch, J. D. (2006). Competency-based training and assessment center: Strategies, technology, process, and issues. Advances in Developing Human Resources, 8 (2), 141-143.

Cahoon, M. V., Bowler, M. C., & Bowler, J. L. (2012). A reevaluation of assessment center construct-Related validity. International Journal of Business and Management, 7 (9), 3- 19.

Cascio, W. F., & Aguinis, H. (2005). Applied Psychology in Human Resource Management.  New Jersey: Prentice Hall. 

Chen, H. C. (2006). Assessment center: A critical mechanism for assessing HRD effectiveness and accountability. Advances in Developing Human Resources, 8, 247–264.

Damitz, M., Manzey, D., Kleinmann, M., & Severin, K. (2003). Assessment Center for Pilot Selection: Construct and Criterion Validity and the Impact of Assessor Type. Applied Psychology: An International Review, 52 (2), 193-212.

Dilchert, S., & Ones, D. S. (2009). Assessment center dimensions: Individual differences correlates and meta-analytic incremental validity. International Journal of Selection and Assessment, 17(3), 254-270.

Gaugler, B. B., Rosenthal, D.B., Thornton, G.C. III., & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493-511.

Harel, G.H., Arditi-Vogel, A., & Janz, T. (2003). Comparing the validity and utility of behavior description interview versus assessment center ratings. Journal of Managerial Psychology, 18 (2), 94-104.

Hoffman, B. J., & Meade, A. (2012). Alternate approaches to understanding the psychometric properties of assessment centers: An analysis of the structure and equivalence of exercise ratings. International Journal of Selection and Assessment, 20 (1), 82- 97.

International Task Force on Assessment Center Guidelines. (2009). Guidelines and ethical considerations for assessment center operations. International Journal of Selection and Assessment,17(3), 243-253.

Jansen, A., Lievens, F., & Kleinmann, M. (2011). Do Individual differences in perceiving situational demands moderate the relationship between personality and assessment center dimension ratings?.Human Performance, 24, 231–250.

Khoshouei, M.S. Oreyzi, H. R. & Nouri, A. (2012 April). Assessor Errors and Biases: Challenges in Assessment Centers. Paper presented at the International Conference on Industrial and Organizational Psychology: Trends, Challenges, and Applications, 19.

Khoshouei, M.S., Oreyzi, H.R., & Nouri, A. (2013). The Eight Managerial Competencies: Essential Competencies for Twenty First Century Managers. Iranian Journal of Management Studies (IJMS). 6 (2), 131- 152.

Krause, D, E., & Thornton III, G.C (2009). A Cross-cultural look at assessment center practices: Survey results from Western Europe and North America. Applied Psychology: An International Review, 58(4), 557-585.

Kolk, N. J., Born, M.P., van der Flier, H., & Olman, J. M. (2002). Assessment center procedures: cognitive load during the observation phase. International Journal of Selection and Assessment, 10 (4), 271- 278.

Kudisch, J. D., Avis, J. M., Fallen, J. D., Thibodeaux, H. E, III, Roberts, F. E., Rollier, T. J., & Rotolo, C. T. (1999, June). Benchmarking for success: A look at today's assessment center practices worldwide. Paper presented at the 27th annual meeting of the International Congress on Assessment Center Methods, Orlando, FL.

Lance, C. E., Foster, M. R., Nemeth, Y. M., Gentry, W. A., &Drollinger, S. (2007). Extending the nomological network of assessment center construct validity: Prediction of cross-situationally consistent and specific aspects of assessment center performance. Human Performance, 20, 345-362.

Lance, C. E., Newbolt, W. H., Gatewood, R. D., Foster, M. R., French, N.R., & Smith, D. E. (2000). Assessment center exercise factors represent cross-situational specificity, not method bias. Human Performance, 13, 323-353.

Lievens, F. (2002). Trying to understand the different pieces of the construct validity puzzle of assessment centers: An examination of assessor and assessee effects. Journal of Applied Psychology, 87, 675–686.

Lievens, F., & Conway, J. M. (2001). Dimension and exercise variance in assessment center scores: A largescale evaluation of multitrait-multimethod studies. Journal of Applied Psychology, 86, 1202–1222.

Melchers, K.G., Kleinmann, M., & Prinz, M. A. (2010). Do assessors have too much on their plates? The effects of simultaneously rating multiple assessment center candidates on rating quality. International Journal of Selection and Assessment, 18 (3), 329-341.

Nowack, K. (1989). Administration and software manual for the management practices questionnaire. Woodland Hills, CA: Organizational Performance Dimensions.

Pallant, J. (2010). SPSS survival manual: A step by step guide to data analysis using SPSS (4rd edition).  New York: McGraw-Hill.

Riggio, R. E., Mayes, B. T., & Schleicher, D. J. (2003). Using assessment center methods for measuring undergraduate business student outcomes. Journal of Management Inquiry, 12, 68–78.

Schleicher, D. J., Day, D. V., Mayes, B. T., & Riggio, R. E. (2002). A new frame for frame-of-reference training: Enhancing the construct validity of assessment centers. Journal of Applied Psychology, 87, 735–746.

Taylor, I. (2007). A Practical Guide to Assessment Centres and Selection Method: Measuring Competency for Recruitment and Development. Kogan Page.

Thornton, G.C., & Gibbons, A. M. (2009). Validity of assessment centers for personnel selection. Human Resource Management Review, 19, 169- 187.

Thornton, G. C., Ill., & Mueller-Hanson, R. A. (2004). Developing organizational simulations: A guide for practitioners and students. Lawrence Erlbaum Associates.

Thornton, G. C., Ill, & Rupp, D. E. (2006). Assessment centers in human resource management: strategies for prediction, diagnosis and development. Lawrence Erlbaum Associates.

Thornton III, G. C., Wilson, C. L., Johnson, R. M., Rogers, D. A. (2009). Managing Assessment Center Practices in the Context of Employment Discrimination Litigation. The Psychologist-Manager Journal, 12, 175–186.

Tziner, A., & Dolan, S. (1982). Validity of an assessment center for identifying future female officers in the military. Journal of Applied Psychology, 67, 728–736.

Woehr, D. J., & Arthur, W. (2003). The construct-related validity of assessment center ratings: A review and meta-analysis of the role of methodological factors. Journal of Management, 29, 231–258.