Jm. Conway et Ai. Huffcutt, PSYCHOMETRIC PROPERTIES OF MULTISOURCE PERFORMANCE RATINGS - A METAANALYSIS OF SUBORDINATE, SUPERVISOR, PEER, AND SELF-RATINGS, Human performance, 10(4), 1997, pp. 331-360
The purpose of this investigation was to examine the psychometric prop
erties (interrater reliabilities within source and correlations betwee
n sources) of subordinate, supervisor, peer, and self-ratings of job p
erformance. Different job types and dimension types were compared. Usi
ng meta-analytic methodology, we found that subordinates showed the lo
west mean reliability (.30) and supervisors showed the highest (.50),
with peers in between (.37). Mean correlations between sources were lo
w for subordinate ratings (.22 with supervisor,.22 with peer, and .14
with self-ratings) and for self-ratings (.22 with supervisor and .19 w
ith peer ratings). The mean supervisor-peer correlation was higher at
.34. Both reliabilities and correlations between sources tended to be
higher for nonmanagerial and lower complexity jobs. Comparisons of bet
ween-source correlations with within-source reliabilities indicated th
at, with some qualifications, the different sources had somewhat diffe
rent perspectives on performance. Dimension reliabilities differed som
ewhat for interpersonal and cognitive dimensions.