DEVELOPMENT OF A RADIOLOGY FACULTY APPRAISAL INSTRUMENT BY USING CRITICAL INCIDENT INTERVIEWING

Rationale and Objectives. To develop a valid and reliable radiology fa culty appraisal instrument based on scientific methods. Materials and Methods. Fifteen radiology residents participated in critical incident interviewing. During a 1-hour interview, a resident was asked to desc ribe five incidents each of effective and ineffective faculty behavior . Two investigators independently listened to the tape-recorded interv iews, and two different investigators sorted the incidents into broad categories. A faculty appraisal instrument was developed by listing si milar incidents under broad categories. A five-point rating scale was applied to each item. Content validity was assessed by resident and fa culty critique of the appraisal instrument. Results. A total of 168 in cidents of faculty behavior were generated. The frequency with which s imilar incidents were reported and recorded. The most common behaviors reported were related to staff expertise and teaching. Interjudge rel iability was good, as determined by computing K indices of agreement ( overall K = 0.59). There was good agreement regarding instrument conte nt validity among residents but not among faculty. Conclusion. Residen ts supported the new appraisal instrument, but further tests of validi ty and reliability and faculty acceptance of the instrument will deter mine its usefulness as a tool for monitoring faculty teaching performa nce and making decisions regarding faculty promotion.