Convergrent and discriminant validity of assessment center dimensions: A conceptual and empirical reexamination of the assessment confer construct-related validity paradox

This study notes that the lack of convergent and discriminant validity of a ssessment center ratings in the presence of content-related and criterion-r elated validity is paradoxical within a unitarian framework Of validity. It also empirically demonstrates an application of generalizability theory to examining the convergent and discriminant validity of assessment center di mensional ratings. Generalizability analyses indicated that person, dimensi on, and person by dimension effects contribute large proportions of varianc e to the total variance in assessment center ratings. Alternately exercise, rater person by exercise, and dimension by exercise effects are shown to c ontribute little to the total variance. Correlational and confirmatory fact or analyses results were consistent with the generalizability results. This provides strong evidence for the convergent and discriminant validity of t he assessment center dimension ratings - a finding consistent with the conc eptual underpinnings of the unitarian view of validity and inconsistent wit h previously reported results. Implications for future research and practic e are discussed. (C) 2000 Elsevier Science Inc. All rights reserved.