Design and validation of situational judgment test of strategic mindset of managers of Iran Alloy Steel Company

Subject Areas : Industrial

Iman Shakeri ¹ , Ali Mehdad ² , Hadi Farhadi ³

1 - Department of Psychology, Isfahan (Khorasgan) branch, Islamic Azad University, Isfahan, Iran.
2 - Department of Industrial and Organizational Psychology, Faculty of Psychology and Education, Islamic Azad University of Isfahan, Iran
3 - Department of Psychology, Faculty of Psychology and Education, University of Tehran, Tehran, Iran.

Received: 2023-05-14 Accepted : 2024-01-13 Published : 2025-06-10

Keywords: situational judgment test, Strategic Mindset, factor analysis, assessment center, managers,

Abstract :

The purpose of this research was to design and validation of situational judgment test of strategic mindset of managers of Iran Alloy Steel Company. This research was applied in terms of purpose and descriptive in terms of data analysis. The research sample included 196 subjects (for exploratory factor analysis and reliability) and 210 separate subjects (and convergent validity) from the managerial ranks of Iran Alloy Steel Company, who were selected by stratified sampling method. In order to design the questions and answer options of the test, the opinions of subject matter experts were used, and the validity of the test was investigated using exploratory and confirmatory factor analysis, correlation analysis and reliability analysis in SPSS and LISRER software. Eveidence of the validity of Situational Judgment Test of Strategic Mindset in the exploratory factor analysis with principal components method and varimax rotation, as expected, suggested a structure based on three subscales. Confirmatory factor analysis showed that these factors explain 58% of the variance of the total scores, and Cronbach's alpha coefficients for each of the components and the total scale were above 0.7 Also, the convergent validity of the test showed a moderate correlation with the scores of strategic mindsets in the assessment center. The evidence of this research showed that using Weyhrauch (2017) conceptual model and using the situational judgment method can well measure the strategic mindset of managers and potentially, it is a suitable starting point for designing educational and developmental interventions of human capital in this field.

References:

Barling, J., Christie, A., & Hoption, C. (2011). Leadership. In S. Zedeck (Ed.), APA Handbook of Industrial and Organizational Psychology, Vol. 1: Building and Developing the Organization. Washington, DC: American Psychological Association. https://doi.org/10.1037/12169-000.
Borchardt, W., Kamzabek, T. and Lovallo, D. (2022), "Behavioral strategy in the wild", Management Research Review, 45 (9), 1185-1204. https://doi.org/10.1108/MRR-12-2021-0876.
Blair, A., Hoffman. R., Ladd, T. (2016). Assessment centers vs situational judgment tests: longitudinal predictors of success, Leadership & Organization Development Journal, 37 (7), 899 – 911. https://doi.org/10.1108/LODJ-12-2014-0235.
Chen, P., Powers, J., Katragadda, K., Cohen, G., & Dweck, C. (2020). A Strategic Mindset: An orientation toward strategic behavior during goal pursuit, Psychological and cognitive sciences, 117 (25), 14066-14072. https://doi.org/10.1073/pnas.2002529117.
Dhir, S., Dhir, S. and Samanta, P. (2018), Defining and developing a scale to measure strategic thinking, Foresight, 20 (3), 271-288. https://doi.org/10.1108/FS-10-2017-0059.
Ershadi, M.J. and Eskandari Dehdazzi, R. (2019), Investigating the role of strategic thinking in establishing organizational excellence model: A moderating role of organizational forgetting, The TQM Journal, 31(4), 620-640. https://doi.org/10.1108/TQM-05-2018-0062.
Eilers, K. Peters, C. & Leimeister, J. M. (2022). Why the agile mindset matters. Technological Forecasting and Social Change. 179. 121650. 10.1016/j.techfore.2022.121650
Farida, F. A., Hermanto, Y. B., Paulus A. L., Leylasari, H. T. (2022), Strategic Entrepreneurship Mindset, Strategic Entrepreneurship Leadership, and Entrepreneurial Value Creation of SMEs in East Java, Indonesia: A Strategic Entrepreneurship Perspective. Sustainability,14(16):10321. https://doi.org/10.3390/su141610321
Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 41, 237-358. https://doi.org/10.1037/h0061470.
Libbrecht, N., & Lievens, F. (2012). Validity evidence for the situational judgment test paradigm in emotional intelligence measurement. International Journal of Psychology, 47(6), 438-447. https://doi.org/10.1080/00207594.2012.682063.
Schlegel, K. & Mortillaro, M. (2018). The Geneva Emotional Competence Test (GECo): An ability measure of workplace emotional intelligence. Journal of Applied Psychology. 104(4), 559–580. https://doi.org/10.1037/apl0000365
Morris, A. J., Brotheridge, C. M., & Urbanski, J. C. (2005). Bringing humility to leadership: Antecedents and consequences of leader humility. Human Relations, 58(10), 1323-1350. https://doi.org/10.1177/0018726705059929.
Reiser, S., Schacht, L., Thomm, E., Figalist, C., Janssen, L., Schick, K., Dörfler, E., Berberat, P., Gartmeier, M., & Bauer, J., (2022). A Video-Based Situational Judgement Test of Medical Students’ Communication Competence in Patient Encounters: Development and First Evaluation. Patient Education and Counseling, 105(5), 1283-1289.
Tabakhnick B. G., Fidell L. S.(2007). Using multivariate statistics.5th ed. Boston:Allyn & Bocon.
Thornton III, G. C., Mueller-Hanson, R. A., & Rupp, D. E. (2017). Developing organizational simulations: A guide for practitioners, students, and researchers. Routledge.
Shakeri, I. (2016). Validation of Traditional Performance Appraisal and MultiSource Appraisal of Competences through Assessment Center. Journal of Industrial and Organizational Psychology Studies 3(1), 57-70. [In Persion] 10.22055/JIOPS.2018.21906.1049
Sleesman, D. J., Conlon, D. E., McNamara, G., & Miles, J. E. (2012). Cleaning up the big muddy: A meta-analytic review of the determinants of escalation of commitment. Academy of Management Journal, 55(3), 541–562. https://doi.org/10.5465/amj.2010.0696.
Sugerman, J., Scullard, M., & Wilhelm, E. (2011). The 8 dimensions of leadership: DiSC strategies for becoming a better leader. San Francisco, CA: Berrett-Koehler.
Waltz C. F., & Bausell R. B. (1981). Nursing research: design, statistics, and computer analysis. Illustrated ed. Philadelphia: F.A. Davis Co.
Weyhrauch W. S. (2017) Development and preliminary validation of the Strategic Thinking Mindset Test (STMT). Washington DC:Consortium of Universities Washington DC.