SETTING PERFORMANCE STANDARDS THROUGH 2-STAGE JUDGMENTAL POLICY CAPTURING

A performance-standard-setting procedure termed judgmental policy capt uring (JPC), and its application, are described. The JPC procedure was examined and evaluated as a possible means of establishing performanc e standards for classroom teachers who seek certification from the Nat ional Board for Professional Teaching Standards. The study demonstrate d the feasibility of using the method for setting performance standard s on assessments composed of complex, multiply scored performance-base d exercises. The results of the study suggested that (a) the JPC proce dures and associated instructions were dear to panelists, (b) panelist s could provide judgments in response to as many as 200 five-dimension al profiles in a reasonably short time without undue fatigue, and (c) most panelists could achieve high levels of consistency in their respo nses to profiles, as reflected in coefficients of multiple determinati on between 0.55 and 0.83.