A NEW STANDARD-SETTING METHOD FOR PERFORMANCE ASSESSMENTS - THE DOMINANT PROFILE JUDGMENT METHOD AND SOME FIELD-TEST RESULTS

Traditional standard-setting methods are not well suited for applicati ons with polytomously scored performance assessments. The present arti cle presents a standard-setting method-the dominant profile judgment ( DPJ) method-designed for use with profiles of polytomous scores on exe rcises in a performance-based assessment. The method is direct, in tha t it guides standard-setting panelists in the articulation of their st andard-setting policies. Further, it allows complex policy statements that could incorporate compensatory and/or conjunctive components. A d etailed description of the method is provided. Results of an applicati on of this standard-setting method are presented. Recommendations for improvements in the method are discussed.