A comparison of human observer LROC and numerical observer ROC for tumor detection in SPECT images

Numerical observers that predict human performance in medical detection tas ks can relieve some of the burden of conducting psychophysical studies. Res earch for this purpose has dealt primarily with receiver operating characte ristic (ROC) studies with "signal-known-exactly" (SKE) detection tasks. How ever, clinical tasks requiring searching for tumors are more closely associ ated with localization ROC (LROC) studies. We have compared performances of humans in a LROC study to performances of a channelized Hotelling observer (CHO) in a SKE ROC study. The task was tumor detection in simulated Ga-67 scans of the chest region. The studies compared different image filters cre ated by varying the dimensionality and cut-off frequency of a 5(th)-order B utterworth filter. Image reconstruction was by filtered backprojection (FBP ) with multiplicative Chang attenuation correction. A total of 35 tumor loc ations were used. Human LROC results for 4 participants were acquired from a study of 140 images per strategy. The LROC ratings are given as areas und er the LROC curve. For the ROC study, 2 constant-Q channel models were used , with parameters determined from a previous comparison of human and CHO pe rformance in a SKE ROC study. The CHO's were applied to 200 noise realizati ons per location and strategy. The CHO ratings of the filtering strategies are given as areas under the ROC curve averaged over location. Correlation between the human and numerical observers was quantified with Spearman rank correlation tests. Rank correlation coefficients of 0.857 and 0.952 were f ound. We conclude that a ROC study with these constant-Q CHO's may be used to distinguish between considerably superior and inferior strategies, and t hus reduce the number of strategies considered by human observers in an LRO C study.