Prior selection causes biased estimates of standardized ethnic group differences: Simulation and analysis

Citation
Pl. Roth et al., Prior selection causes biased estimates of standardized ethnic group differences: Simulation and analysis, PERS PSYCH, 54(3), 2001, pp. 591-617
Citations number
42
Categorie Soggetti
Psycology
Journal title
PERSONNEL PSYCHOLOGY
ISSN journal
00315826 → ACNP
Volume
54
Issue
3
Year of publication
2001
Pages
591 - 617
Database
ISI
SICI code
0031-5826(200123)54:3<591:PSCBEO>2.0.ZU;2-9
Abstract
Assessment of standardized ethnic group differences (d) on predictors of jo b performance has become an important issue for applied psychologists. A nu mber of studies have used an experimental design in which the predictor of interest was administered after an initial screening predictor. We examined the influence of prior selection on a first predictor on observed A for se cond predictors in multiple-hurdle selection systems. Results of a Monte Ca rlo simulation indicate observed A on the second predictor are underestimat ed in the presence of prior selection on another predictor. More important, "downward bias" in observed standardized ethnic group difference is substa ntial (30-70%) when selection ratios are low, standardized ethnic group dif ferences on the screening predictor are high, and when the first and second predictors correlate above .30. Researchers should consider the influence of range restriction in designing studies of ethnic group differences and c omparing ds across predictors, particularly when data are collected under a multiple-hurdle design.