ON POST-EVALUATION ANALYSIS - CANDLE-LIGHTING AND SURROGATE MODELS

Gleaning information from a model to guide the design of new and bette r options is an important, underemphasized facet of post-evaluation an alysis. We call this facet candle-lighting analysis. We structure this analysis as a series of questions which we incorporate into a DSS tha t uses standard mathematical and artificial intelligence techniques. C reating new options typically requires action by an organization. The DSS stores models of these actions, their cost and benefits, and infor mation about the source and accuracy of parameters. We applied candle- lighting analysis to a performance evaluation model developed with and for the US Coast Guard that is part of a prototype DSS.