APPLICATION OF AN AUTOMATED ITEM SELECTION METHOD TO REAL DATA

A method of automatically selecting items for inclusion in a test that has constraints on item content and statistical properties was applie d to real data. Two tests were assembled by test specialists who assem ble such tests on a routine basis. Using the same pool of items and th e same constraints, the two tests were reassembled automatically. Test specialists not involved in the original manual assembly compared the tests constructed manually to the tests constructed automatically. Th e results indicated that the progress of automated test assembly metho ds lies in improving item banking systems, classification schemes, and quality control measures, rather than in the development of different algorithms or in the improvement of computer time and cost.