Background and Purpose Despite the frequent use of clinical rating sca
les in multicenter therapeutic stroke trials, no generally acceptable
method exists to train and certify investigators to use the instrument
consistently. We desired to train investigators to use the National I
nstitutes of Health Stroke Scale in a study of acute stroke therapy so
that all examiners rated patients comparably. Methods We devised a tw
o-camera videotape method that optimizes the visual presentation of ex
amination findings. We then measured the effectiveness of the training
by asking each investigator to evaluate a set of 11 patients, also on
videotape. We tabulated the evaluations, devised a scoring system, an
d calculated measures of interobserver agreement among the participant
s in this study. Results We trained and certified 162 investigators. W
e found moderate to excellent agreement on most Stroke Scale items (un
weighted kappa>0.60). Two items, facial paresis and ataxia, exhibited
poor agreement (unweighted kappa<0.40) and should be revised in future
editions of the scale. Performance improved with video training compa
red with previous studies. Inclusion of the motor rating of the unaffe
cted limbs in the total score did not affect reliability. Conclusions
Video training and certification is a practical and effective method t
o standardize the use of examination scales. Two cameras must be used
during the taping of patients to accurately present the clinical findi
ngs. This method is easily adapted to any study in which a large numbe
r of investigators will be enrolling patients at multiple clinical cen
ters.