COMPUTERIZED ADAPTIVE TESTING - TRACKING CANDIDATE RESPONSE PATTERNS

Computerized adaptive testing (CAT) uses a computer algorithm to const ruct and score the best possible individualized or tailored tests for each candidate. The computer also provides an absolute record of all r esponses and changes to responses, as well as their effects on candida te performance. The detail of the data from computerized adaptive test s makes it possible to track initial responses and response alteration s, and their effect on candidate estimated ability measures, as well a s the statistical performance of the examination. The purpose of this study was to track the effect of candidate response patterns on a comp uterized adaptive test. A ninety-item certification examination was di vided into nine units of ten items each to track the pattern of initia l responses and response alterations on ability estimates and test pre cision across the nine test units. The precision of the test was affec ted most by response alterations during early segments of the test. Wh ile generally, candidates benefit from altering responses, individual candidates showed different patterns of response alterations across te st segments. Test precision is minimally affected, suggesting that the tailoring of CAT is minimally affected by response alterations.