DETECTING SEQUENTIAL PATTERNS AND DETERMINING THEIR RELIABILITY WITH FALLIBLE OBSERVERS

On the basis of recent work by W. Gardner (1995), implications of fall ible observers for observational research are discussed. Analysis show s that for identically fallible observers, values for kappa are lower when codes are few and their simple probabilities variable than when c odes are many and roughly equiprobable; thus no one value of kappa can be regarded as universally acceptable. Additional analysis shows that fallible measurement degrades indices of sequential pattern more when codes are few and their simple probabilities variable. Finally, a sim ulation study establishes likely values for intraclass correlation rel iabilities for sequential indices generated by various circumstances a nd suggests principled ways to select both lengths of sequences and ac ceptable levels of kappa for observational studies.