Assessor training strategies and their effects on accuracy, interrater reliability, and discriminant validity

This study compares the effects of data-driven assessor training with schem a-driven assessor training and control training. The sample consisted of 22 9 industrial and organizational psychology students and 161 managers who we re randomly assigned to 1 of these training strategies. Participants observ ed and rated candidates in an assessment center exercise. The data-driven a nd schema-driven assessor training approaches outperformed the control trai ning on all 3 dependent variables. The schema-driven assessor training resu lted in the largest values of interrater reliability, dimension differentia tion, and accuracy. Managers provided significantly more-accurate ratings t han students but distinguished less between the dimensions. Practical impli cations regarding the design of assessor trainings and the composition of a ssessor teams are proposed.