N. Schmitt et Ae. Mills, Traditional tests and job simulations: Minority and majority performance and test validities, J APPL PSYC, 86(3), 2001, pp. 451-458
Performance of 565 minority and 414 majority job applicants on traditional
paper-and-pencil tests and on a telephone simulation that measured similar
constructs was assessed. Models of the measurement characteristics of these
2 test batteries indicated larger subgroup mean differences on the traditi
onal tests than on the simulation. Correlations between traditional tests w
ere lower in the majority sample than in the minority sample, and the varia
nce of the minority candidates' scores on the traditional tests was much la
rger than the variance of majority applicants' scores on the same measures.
The validity of the simulation was lower than the validity of the traditio
nal tests. This study replicates previous laboratory research that has indi
cated smaller subgroup differences on simulations than on paper-and-pencil
tests and extends this research by providing evidence of the relative valid
ity of these 2 types of measures.