Jw. Fleenor, CONSTRUCTS AND DEVELOPMENTAL ASSESSMENT-CENTERS - FURTHER TROUBLING EMPIRICAL-FINDINGS, Journal of business and psychology, 10(3), 1996, pp. 319-335
Research indicates that assessment center (AC) ratings typically demon
strate poor construct validity; that is, they do not measure the inten
ded dimensions of managerial performance (e.g., Sackett & Harris, 1988
). The purpose of this study was to investigate the construct validity
of dimension ratings from a developmental assessment center (N=102),
using multitrait-multimethod analysis and factor analysis. The relatio
nships between AC ratings, job performance ratings, and personality me
asures also were investigated. Results indicate that the AC ratings fa
iled to demonstrate construct validity. The ratings did not show the e
xpected relationships with the job performance and personality measure
s. Additionally, the factors underlying these ratings were found to be
the AC exercises, rather than the managerial dimensions as expected.
Potentially, this lack of construct validity of the dimension ratings
is a serious problem for a developmental assessment center. There is l
ittle evidence that the managerial weaknesses identified by the AC are
the dimensions that actually need to be improved on the job. Methods
are discussed for improving the construct validity of AC ratings, for
example, by decreasing the cognitive demands on the assessors.