Impact of frame-of-reference and behavioral observation training on alternative training effectiveness criteria in a Canadian military sample

We examined the utility of frame-of-reference (FOR) training and behavioral observation training (BOT) for enhancing rating accuracy in a field study involving Canadian military personnel. Participants were randomly assigned to either (a) FOR training, (b) FOR training + BOT, or (c) control training . Participants were assessed on a variety of training program evaluation cr iteria, including rating accuracy, behavioral accuracy, and components of K irkpatrick's (1959) typology of training effectiveness. Results indicated t hat FOR training led to significant enhancements in rating accuracy, and BO T-trained participants also produced significantly higher levels of behavio ral accuracy compared to other conditions. However, contrary to predictions , the inclusion of BOT did not lead to significant increases in rating accu racy beyond FOR training alone. We also obtained evidence that trainee reac tions to training pre dieted transfer of training and that trainees demonst rated knowledge of the frame-of-reference material imparted during training following a 4-month delay. We suggest that FOR and BOT may be useful appro aches to rater training in field settings, although there may be some pract ical and logistical difficulties in developing and executing FOR training o utside the laboratory.