Evaluating the impact of clinical psychology training programs: Process and outcome issues

These comments identify key issues that need to be resolved to evaluate the impact or achievement of graduate training programs in clinical psychology . Three questions ought to be addressed to evaluate impact empirically: (1) What is a given training program trying to accomplish; that is, what are t he goals? (2) What features of the program are designed to contribute to th ese goals; that is, what are the means' and (3) How can the goals and the m eans be assessed to elaborate their connections? Evaluating training progra ms is not fundamentally different from other research and begins with a car eful analysis of the constructs of interest (e.g.. program goals), identifi cation of measures of the goals and the means, and considering, ruling out, or making implausible the influence of other factors (e.g., student select ion, faculty selection, curriculum) that, if not conceived of as part of tr aining, could serve as confounds.