ROUTINE RECEIVER OPERATING CHARACTERISTIC ANALYSIS IN MAMMOGRAPHY AS A MEASURE OF RADIOLOGISTS PERFORMANCE

A system for calculating receiver operating characteristic (ROC) curve s from routine audit data is described. Both diagnostic opinion and pa thology outcome data from the symptomatic mammography department were recorded in an audit database, from which ROC curves were calculated. A comparison of overall radiologists' performance was made and the app ropriate performance indices discussed. Similar data were collected fr om the breast screening centre where the same radiologists read mammog rams. The radiologists' performance in the symptomatic department was compared with that in the breast screening centre and was found to be better in the screening centre. The difference could not be wholly att ributed to the different age distribution of women and highlighted the different nature of the diagnostic task and the differing sampled pop ulations. ROC curves were drawn for different clinical signs to determ ine any particular area of difficulty the radiologist may experience. ROC analysis as part of routine audit can be used for maintaining and improving the quality of an individual's performance, and targeting le arning on areas of particular weakness.