Are NBME examination scores useful in selecting radiology residency candidates?

Rationale and Objectives. The quality of the graduates of radiology residen cy programs is powerfully affected by the quality of the candidates admitte d to them, making the evaluation and ranking of residency applicants one of the most important tasks of radiology education. In the applicant evaluati on process, evaluators frequently take into account applicants' scores on t he National Board of Medical Examiners (NBME) examination, operating on the implicit assumption that these scores help predict future performance as r esidents. The purpose of this study was to test that assumption. Materials and Methods. Using a data set consisting of information about 99 residents admitted over a period of 10 residency class years, the authors c ompared scores for parts I and II of the NBME examination with later result s on the American Board of Radiology (ABR) written and oral examinations. L ogistic regression was used to model differences in resident performance on the NBME and ABR examinations and to determine whether Variance in ABR res ults could be predicted by variance in NBME examination scores. Results. The authors were unable to demonstrate any statistically significa nt value of NBME examination scores in predicting eventual performance on t he ABR written and oral examinations. Conclusion. The authors' attempt to validate the widespread practice of usi ng NBME examination scores to evaluate and rank applicants to radiology res idency programs demonstrated no discernible value for these scores in predi cting the success of residents on the ABR examinations.