GENERALIZABILITY ANALYSES OF WORK KEYS LISTENING AND WRITING TESTS

In this article, univariate and multivariate generalizability theory i s employed to examine psychometric characteristics of Listening and Wr iting tests developed by American College Testing (ACT) for its Work K eys program. For both of these tests, the same tape-recorded messages provide the stimuli for written responses that are evaluated by raters . Of particular concern are the numbers of messages and raters needed for adequate measurement precision. The occurrence of relatively large person-message interactions suggested that several (at least six) mes sages are probably required. Also, the analyses suggest that it is hig hly desirable to employ at least two raters. For these sample sizes, h owever, the multivariate results are less encouraging in part because of correlated errors.