Further evidence favoring three-option items in multiple-choice tests

This study examined the validity of an item-writing rule concerning the opt imal number of options in the design of multiple-choice test items. Althoug h measurement textbooks typically recommend the use of four or Five options - and most ability and achievement tests still follow this rule - theoreti cal papers as well as empirical research over a period of more than half a century reveal that three options may be more suitable for most ability and achievement test items. Previous results show that three-option items, com pared with their four-option versions, tend to be slightly easier (i. e., w ith higher traditional difficulty indexes) without showing any decrease in discrimination. In this study, two versions (with Four and three options) o f 90 items comprising three computerized examinations were applied in succe ssive years, showing the expected trend. In addition, there were no systema tic changes in reliability For the tests, which adds to the evidence favori ng the use of the three-option test item.