Oc. Mudford et al., INTEROBSERVER AGREEMENT AND DISAGREEMENT IN CONTINUOUS RECORDING EXEMPLIFIED BY MEASUREMENT OF BEHAVIOR STATE, American journal of mental retardation, 102(1), 1997, pp. 54-66
Continuous observational recording was used to measure behavior state
of 3 adults with profound and multiple disabilities. Observations were
made over 56.7 hours, including 21.9 hours with two observers recordi
ng independently. Overall percentage agreement was satisfactory (i.e.,
exceeded 80%). Agreement on occurrence was, however, generally unsati
sfactory at a mean of 63.5%, with 5 of 16 Subject x State Agreement In
dites over 80%. Percentage disagreement on occurrence, a previously un
reported measure, was computed to quantify sources of disagreement. Th
e agreement data were superimposed on participants' behavior state pro
files to demonstrate how conclusions can; be drawn from the data, desp
ite their generally inadequate reliability. This approach to interobse
rver agreement and presentation of data is suggested for researchers i
nvestigating entities that are not directly amenable to observation.