Assessing Competencies in the Workplace: Developing a Modular Measure with Universal Applicability
Authors
-
SHL, Thames Ditton
Yin Lin -
SHL, Thames Ditton Alexandra Livesey
-
Human Measures, Greater Minneapolis - St. Paul Area Kathy Tuzinski
Keywords:
Automated Test Assembly, Assessment Tailoring, Competency Modelling, Competency Assessment, Personnel Selection, Measurement SystemAbstract
Competencies have been a common tool for talent management operations for decades. In an attempt to standardize and streamline competency modelling and assessment in the varied and evolving workplace, this paper presents a measurement architecture consisting of a modular but comprehensive construct framework and a technology-enabled assessment tailoring workflow utilizing automated test assembly and quality-check technology. The resulting tailored competency assessments demonstrated promising construct and criterion validity in a series of empirical studies. While research is still ongoing, we review the initial findings and reflect on the implications and future potentials arising from this research.Downloads
Metrics
Downloads
Published
How to Cite
Issue
Section
References
Bartram, D. (2004). Assessment in organisations. Applied Psychology, 53(2), 237-259. https://doi.org/10.1111/ j.1464-0597.2004.00170.x
Bartram, D. (2005). The great eight competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 90(6), 1185-1203. https://doi.org/10.1037/0021-9010.90.6.1185. PMid:16316273
Bartram, D., Brown, A., Fleck, S., Inceoglu, I. and Ward, K. (2006). OPQ32 technical manual. Thames Ditton, UK: SHL.
Bartram, D., Robertson, I. T. and Callinan, M. (2002). Introduction: A framework for examining organizational effectiveness. In I. T. Robertson, M. Callinan & D.
Bartram (Eds.), Organizational effectiveness: The role of psychology (pp. 1-10). Chichester, UK: Wiley. https://doi.org/10.1002/9780470696736.ch
Bish, A. J., Newton, C. J., Browning, V., O’Connor, P. and Anibaldi, R. (2014). An exploration of the professional competencies required in engineering asset management. European Journal of Engineering Education, 39(4), 432-447. https://doi.org/10.1080/03043797.2014.895701
Bosco, F. A., Aguinis, H., Singh, K., Field, J. G. and Pierce, C. A. (2015). Correlational effect size benchmarks. Journal of Applied Psychology, 100(2), 431-449. https://doi.org/10.1037/a0038047. PMid:25314367
Brown, A. and Maydeu-Olivares, A. (2011). Item response modeling of forced-choice questionnaires. Educational & Psychological Measurement, 71(3), 460-502. https://doi.org/10.1177/0013164410375112
Brown, A. and Maydeu-Olivares, A. (2013). How IRT can solve problems of ipsative data in forced-choice questionnaires. Psychological Methods, 18(1), 36-52. https://doi.org/10.1037/a0030641. PMid:23148475
Cao, M. (2016). Examining the fakability of forced-choice individual differences measures (Ph.D.). Retrieved from https://www.ideals.illinois.edu/handle/2142/93064
Christiansen, N. D., Burns, G. N. and Montgomery, G. E. (2005). Reconsidering forced-choice item formats for applicant personality assessment. Human Performance, 18(3), 267-307. https://doi.org/10.1207/s15327043hup1803_4
Cronbach, L. J. and Gleser, G. C. (1965). The bandwidthfidelity dilemma. Psychological Tests and Personnel Decisions, 97-107.
Driskell, J.E., Hogan, J., Salas, E. and Hoskin, B. (1994). Cognitive and personality predictors of training performance. Military Psychology, 6(1), 31-46. https://doi.org/10.1207/s15327876mp0601_2
Gierl, M. A. and Haladyna, T. M. (Eds.). (2013). Automatic item generation: Theory and practice. New York, NY: Routledge. https://doi.org/10.4324/9780203803912 PMCid:PMC3336114
Hogan, J. and Roberts, B.W. (1996). Issues and non†issues in the fidelity–bandwidth tradeâ€off. Journal of Organizational Behavior, 17(6), 627-637. https://doi.org/10.1002/(SICI)1099-1379(199611)17:6<627::AIDJOB2828>3.0.CO;2-F
Hunter, J. E. and Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage. https://doi.org/10.1207/S15327043HUP1304_3
Jackson, D. N., Wroblewski, V. R. and Ashton, M. C. (2000). The impact of faking on employment tests: Does forced choice offer a solution? Human Performance, 13(4), 371388.
Kantrowitz, T. M. (2014). Global assessment trends report. Thames Ditton, UK: SHL.
Kantrowitz, T. M., Tuzinski, K. A. and Raines, J. M. (2018). Global assessment trends report. Thames Ditton, UK: SHL.
Kasemsap, K. (2016). Analyzing the roles of human capital and competency in global business. In Management Association (Ed.), Project management: Concepts, methodologies, tools, and applications (pp. 2190-2218).
Hershey, PA: IGI Global. https://doi.org/10.4018/978-15225-0196-1.ch109
Kincaid, J. P., Fishburne, R. P., Rogers, R. L. and Chissom, B. S. (1975). Derivation of new readability formulas (automated readability index, fog count, and flesch reading ease formula) for navy enlisted personnel. (Research Branch Report No.8–75). Naval Air Station Memphis: Chief of Naval Technical Training. https://doi.org/10.21236/ADA006655. PMCid:PMC432753
Kurz, R. and Bartram, D. (2002). Competency and individual performance: Modeling the world of work. In I. T. Robertson, M. Callinan & D. Bartram (Eds.), Organizational effectiveness: The role of psychology (pp. 227-255). Chichester, UK: Wiley. https:// doi.org/10.1002/9780470696736.ch10
Le Bon, J. (2015). Training and qualification: Developing a competency model to assess sales leaders’ equity. In M. Zeuch (Ed.), Handbook of human resources management (pp. 1-16). Berlin, Heidelberg: Springer Berlin Heidelberg.. https://doi.org/10.1007/978-3-64240933-2_144-1
Mansfield, R. S. (1996). Building competency models: Approaches for HR professionals. Human Resource Management, 35(1), 7-18. https://doi.org/10.1002/(SICI)1099-050X(199621)35:1<7::AIDHRM1>3.0.CO;2-2
Martin, B. A., Bowen, C. C. and Hunt, S. T. (2002). How effective are people at faking on personality questionnaires? Personality and Individual Differences, 32(2), 247-256. https://doi.org/10.1016/ S0191-8869(01)00021-6
McClelland, D. C. (1973). Testing for competence rather than for “intelligenceâ€. American Psychologist, 28(1), 1-14. https://doi.org/10.1037/h0034092 PMid:4684069
McLagan, P. A. (1988). Flexible job models: A productivity strategy for the information age. In J. P. Campbell, R. J. Campbell & Associates (Eds.), Productivity in organizations: New perspectives from industrial organizational psychology. San Francisco, CA: JosseyBass.
Ones, D. S. and Viswesvaran, C. (1996). Bandwidth– fidelity dilemma in personality measurement for personnel selection. Journal of Organizational Behavior, 17(6), 609-626. https://doi.org/10.1002/(SICI)10991379(199611)17:6<609::AID-JOB1828>3.0.CO;2-K
Robertson, I. T. and Kinder, A. (1993). Personality and job competences: The criterion-related validity of some personality variables. Journal of Occupational and Organizational Psychology, 66(3), 225-244. https://doi.org/10.1111/j.2044-8325.1993.tb00534.x
Salgado, J. F. and Moscoso, S. (2019). Meta-Analysis of Interrater Reliability of Supervisory Performance Ratings: Effects of Appraisal Purpose, Scale Type, and Range Restriction. Frontiers in Psychology, 10, 2281. https://doi.org/10.3389/fpsyg.2019.02281 PMid:31681087 PMCid:PMC6813221
Saville, P., Sik, G., Nyfield, G., Hackston, J. and Maclver, R. (1996). A demonstration of the validity of the occupational personality questionnaire (OPQ) in the measurement of job competencies across time and in separate organisations. Applied Psychology, 45(3), 243262. https://doi.org/10.1111/j.1464-0597.1996.tb00767.x
SHL. (2003). The SHL competency framework: Technical reference manual. Thames Ditton, UK: SHL.
SHL. (2014). OPQ32râ„¢ Technical manual. Thames Ditton, UK: SHL.
SHL. (2019a). Aptaâ„¢ Architecture Technical manual. Thames Ditton, UK: SHL.
SHL. (2019b). Updated Universal Competency Framework Technical Manual. Thames Ditton, UK: SHL.
SHL. (2020). RemoteWorkQ Technical manual. Thames Ditton, UK: SHL.
Skorková, Z. (2016). Competency models in public sector. https://doi.org/10.1016/j.sbspro.2016.09.029 Spencer, L. M., and Spencer, S. M. (1993). Competence at work. New York: Wiley.
Testa, M. R., and Sipe, L. (2012). Service-leadership competencies for hospitality and tourism management https://doi.org/10.1016/j.ijhm.2011.08.009
Viswesvaran, C., Ones, D. S., and Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81(5), 557–574.