A COMPARISON OF PROCEDURES TO DETECT ITEM PARAMETER DRIFT

Citation
Jr. Donoghue et Sp. Isham, A COMPARISON OF PROCEDURES TO DETECT ITEM PARAMETER DRIFT, Applied psychological measurement, 22(1), 1998, pp. 33-51
Citations number
44
Categorie Soggetti
Psychologym Experimental","Social Sciences, Mathematical Methods
ISSN journal
01466216
Volume
22
Issue
1
Year of publication
1998
Pages
33 - 51
Database
ISI
SICI code
0146-6216(1998)22:1<33:ACOPTD>2.0.ZU;2-Q
Abstract
Monte carlo methods were used to compare several measures of item para meter drift. Number of examinees, number of items, and number of drift items in the test were manipulated. Overall, Lord's chi(2) measure wa s the most effective in identifying items that exhibited drift. Howeve r, the measure was accurate only when the studied item's c parameter w as constrained to be equal across the two assessment years. Of the rem aining measures, the best methods (a z test based on Raju's exact unsi gned integral, the NAEP BILOG/PARSCALE computer program's chi(2) by su bgroup, and Kim and Cohen's closed-interval signed-area measure) requi red empirical estimates of critical values for the test statistics in order to function well. This requirement detracts from their usefulnes s.