Jf. Salgado et S. Moscoso, METAANALYSIS OF INTERRATER RELIABILITY OF JOB-PERFORMANCE RATINGS IN VALIDITY STUDIES OF PERSONNEL-SELECTION, Perceptual and motor skills, 83(3), 1996, pp. 1195-1201
Rating scales are most frequently used to assess the criterion in stud
ies of validity in personnel selection. However, only a few articles r
eport the interrater reliability for these scales. This paper presents
four meta-analyses in which the interrater reliability was estimated
for Civil Composite Criterion, Military Composite Criterion, Total Com
posite Criterion, and Single Civil Criterion. Mean reliabilities mere
.64, .53, .62, and .40, respectively. The implications of these findin
gs for single and meta-analytic studies are discussed.