2-STAGE MULTIPLE COMPARISONS WITH THE BEST FOR COMPUTER-SIMULATION

We consider the problem of comparing a small number of stochastic syst ems via computer simulation when the basis for comparison is the expec ted value of some system performance measure. To serve this problem we develop two-stage sampling procedures that provide confidence interva ls for the difference between the expected performance of each system and the best of the others. These confidence intervals are valid under mild conditions, and the procedures allow the experimenter to specify the desired precision in advance. Special cases of our results includ e standard indifference-zone selection procedures. The paper includes guidelines for experiment design and an illustrative example.