OBJECTIVE: The aim of this study was to determine the influence of advance
knowledge of board scores on interviewers' assessments of residency applica
nts.
STUDY DESIGN: During a 2-year period we prospectively evaluated our residen
cy selection process. In year 1 interviewers were provided with each candid
ate's entire application, whereas in year 2 the United States Medical Licen
sing Examination scores were not included. In each year interviewers were a
sked to provide numerical assessments of the applicants solely on the basis
of their own impressions of the interviews. Analysis was performed only fo
r evaluations by interviewers who participated during both study periods un
der review, interview scores were compared with United States Medical Licen
sing Examination part I scores within each year by means of a scatter plot
and correlation coefficients.
RESULTS: Applicant demographic characteristics were similar during years 1
and 2. Interview scores did not differ between year 1 (4.2 +/- 0.1) and yea
r 2 (4.3 +/- 0.1; P > .05). During year 1 interview and board scores were s
ignificantly correlated (correlation coefficient, 0.64; slope of best-fit l
ine, 13.9), whereas there was a negative correlation in year 2 (correlation
coefficient, -0.06; slope, -1.3).
CONCLUSION: When they are available to interviewers, markers of academic ac
hievement such as United States Medical Licensing Examination scores may bi
as the interview evaluation. The interview process when conducted in this m
anner may simply be a validation process for candidates already judged on t
he basis of the application alone. Knowledge of United States Medical Licen
sing Examination scores by the interviewers may therefore negate the interv
iew as an independent means of evaluating candidates.