PILOT-STUDY OF EXPLICIT GRADING CRITERIA IN THE AMERICAN-BOARD-OF-PSYCHIATRY-AND-NEUROLOGY PART II EXAMINATION

Objective: The purpose of this study was to identify specific competen cies that differentiated passing from failing performance on the Ameri can Board of Psychiatry and Neurology Part II oral board certification examination. Method: A total of 363 candidates were rated in 18 areas of competence defined by behavioral criteria. Data were analyzed to d etermine which areas best discriminated between passing and failing ca ndidates. Results: In both parts of the examination, the ability to de velop a comprehensive treatment plan was most influential. After that, specific interview and observational skills discriminated best. Faili ng candidates had most difficulty detecting and following informationa l and affective cues in their interview of a patient and presenting a biopsychosocial formulation and comprehensive treatment plan. Conclusi ons: Specific candidate competencies related to passing and failing pe rformance can be identified and assessed by a rating scale of observab le behaviors on the board certification examination in psychiatry.