Assessing Competencies in the Workplace: Developing a Modular Measure with Universal Applicability

Assessing Competencies in the Workplace: Developing a Modular Measure with Universal Applicability


  • SHL, Thames Ditton
  • SHL, Thames Ditton
  • Human Measures, Greater Minneapolis - St. Paul Area


Automated Test Assembly, Assessment Tailoring, Competency Modelling, Competency Assessment, Personnel Selection, Measurement System


Competencies have been a common tool for talent management operations for decades. In an attempt to standardize and streamline competency modelling and assessment in the varied and evolving workplace, this paper presents a measurement architecture consisting of a modular but comprehensive construct framework and a technology-enabled assessment tailoring workflow utilizing automated test assembly and quality-check technology. The resulting tailored competency assessments demonstrated promising construct and criterion validity in a series of empirical studies. While research is still ongoing, we review the initial findings and reflect on the implications and future potentials arising from this research.


Download data is not yet available.


Metrics Loading ...




How to Cite

Lin, Y., Livesey, A., & Tuzinski, K. (2021). Assessing Competencies in the Workplace: Developing a Modular Measure with Universal Applicability. Journal of Applied Testing Technology. Retrieved from





Bartram, D. (2004). Assessment in organisations. Applied Psychology, 53(2), 237-259. j.1464-0597.2004.00170.x

Bartram, D. (2005). The great eight competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 90(6), 1185-1203. PMid:16316273

Bartram, D., Brown, A., Fleck, S., Inceoglu, I. and Ward, K. (2006). OPQ32 technical manual. Thames Ditton, UK: SHL.

Bartram, D., Robertson, I. T. and Callinan, M. (2002). Introduction: A framework for examining organizational effectiveness. In I. T. Robertson, M. Callinan & D.

Bartram (Eds.), Organizational effectiveness: The role of psychology (pp. 1-10). Chichester, UK: Wiley.

Bish, A. J., Newton, C. J., Browning, V., O’Connor, P. and Anibaldi, R. (2014). An exploration of the professional competencies required in engineering asset management. European Journal of Engineering Education, 39(4), 432-447.

Bosco, F. A., Aguinis, H., Singh, K., Field, J. G. and Pierce, C. A. (2015). Correlational effect size benchmarks. Journal of Applied Psychology, 100(2), 431-449. PMid:25314367

Brown, A. and Maydeu-Olivares, A. (2011). Item response modeling of forced-choice questionnaires. Educational & Psychological Measurement, 71(3), 460-502.

Brown, A. and Maydeu-Olivares, A. (2013). How IRT can solve problems of ipsative data in forced-choice questionnaires. Psychological Methods, 18(1), 36-52. PMid:23148475

Cao, M. (2016). Examining the fakability of forced-choice individual differences measures (Ph.D.). Retrieved from

Christiansen, N. D., Burns, G. N. and Montgomery, G. E. (2005). Reconsidering forced-choice item formats for applicant personality assessment. Human Performance, 18(3), 267-307.

Cronbach, L. J. and Gleser, G. C. (1965). The bandwidthfidelity dilemma. Psychological Tests and Personnel Decisions, 97-107.

Driskell, J.E., Hogan, J., Salas, E. and Hoskin, B. (1994). Cognitive and personality predictors of training performance. Military Psychology, 6(1), 31-46.

Gierl, M. A. and Haladyna, T. M. (Eds.). (2013). Automatic item generation: Theory and practice. New York, NY: Routledge. PMCid:PMC3336114

Hogan, J. and Roberts, B.W. (1996). Issues and non†issues in the fidelity–bandwidth tradeâ€off. Journal of Organizational Behavior, 17(6), 627-637.<627::AIDJOB2828>3.0.CO;2-F

Hunter, J. E. and Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.

Jackson, D. N., Wroblewski, V. R. and Ashton, M. C. (2000). The impact of faking on employment tests: Does forced choice offer a solution? Human Performance, 13(4), 371388.

Kantrowitz, T. M. (2014). Global assessment trends report. Thames Ditton, UK: SHL.

Kantrowitz, T. M., Tuzinski, K. A. and Raines, J. M. (2018). Global assessment trends report. Thames Ditton, UK: SHL.

Kasemsap, K. (2016). Analyzing the roles of human capital and competency in global business. In Management Association (Ed.), Project management: Concepts, methodologies, tools, and applications (pp. 2190-2218).

Hershey, PA: IGI Global.

Kincaid, J. P., Fishburne, R. P., Rogers, R. L. and Chissom, B. S. (1975). Derivation of new readability formulas (automated readability index, fog count, and flesch reading ease formula) for navy enlisted personnel. (Research Branch Report No.8–75). Naval Air Station Memphis: Chief of Naval Technical Training. PMCid:PMC432753

Kurz, R. and Bartram, D. (2002). Competency and individual performance: Modeling the world of work. In I. T. Robertson, M. Callinan & D. Bartram (Eds.), Organizational effectiveness: The role of psychology (pp. 227-255). Chichester, UK: Wiley. https://

Le Bon, J. (2015). Training and qualification: Developing a competency model to assess sales leaders’ equity. In M. Zeuch (Ed.), Handbook of human resources management (pp. 1-16). Berlin, Heidelberg: Springer Berlin Heidelberg..

Mansfield, R. S. (1996). Building competency models: Approaches for HR professionals. Human Resource Management, 35(1), 7-18.<7::AIDHRM1>3.0.CO;2-2

Martin, B. A., Bowen, C. C. and Hunt, S. T. (2002). How effective are people at faking on personality questionnaires? Personality and Individual Differences, 32(2), 247-256. S0191-8869(01)00021-6

McClelland, D. C. (1973). Testing for competence rather than for “intelligenceâ€. American Psychologist, 28(1), 1-14. PMid:4684069

McLagan, P. A. (1988). Flexible job models: A productivity strategy for the information age. In J. P. Campbell, R. J. Campbell & Associates (Eds.), Productivity in organizations: New perspectives from industrial organizational psychology. San Francisco, CA: JosseyBass.

Ones, D. S. and Viswesvaran, C. (1996). Bandwidth– fidelity dilemma in personality measurement for personnel selection. Journal of Organizational Behavior, 17(6), 609-626.<609::AID-JOB1828>3.0.CO;2-K

Robertson, I. T. and Kinder, A. (1993). Personality and job competences: The criterion-related validity of some personality variables. Journal of Occupational and Organizational Psychology, 66(3), 225-244.

Salgado, J. F. and Moscoso, S. (2019). Meta-Analysis of Interrater Reliability of Supervisory Performance Ratings: Effects of Appraisal Purpose, Scale Type, and Range Restriction. Frontiers in Psychology, 10, 2281. PMid:31681087 PMCid:PMC6813221

Saville, P., Sik, G., Nyfield, G., Hackston, J. and Maclver, R. (1996). A demonstration of the validity of the occupational personality questionnaire (OPQ) in the measurement of job competencies across time and in separate organisations. Applied Psychology, 45(3), 243262.

SHL. (2003). The SHL competency framework: Technical reference manual. Thames Ditton, UK: SHL.

SHL. (2014). OPQ32râ„¢ Technical manual. Thames Ditton, UK: SHL.

SHL. (2019a). Aptaâ„¢ Architecture Technical manual. Thames Ditton, UK: SHL.

SHL. (2019b). Updated Universal Competency Framework Technical Manual. Thames Ditton, UK: SHL.

SHL. (2020). RemoteWorkQ Technical manual. Thames Ditton, UK: SHL.

Skorková, Z. (2016). Competency models in public sector. Spencer, L. M., and Spencer, S. M. (1993). Competence at work. New York: Wiley.

Testa, M. R., and Sipe, L. (2012). Service-leadership competencies for hospitality and tourism management

Viswesvaran, C., Ones, D. S., and Schmidt, F. L. (1996). Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology, 81(5), 557–574.