FINITE INTERSECTION TESTS - A PARADIGM FOR OPTIMIZING SIMULTANEOUS AND SEQUENTIAL INFERENCE

Citation
Gr. Hancock et Aj. Klockars, FINITE INTERSECTION TESTS - A PARADIGM FOR OPTIMIZING SIMULTANEOUS AND SEQUENTIAL INFERENCE, Journal of educational and behavioral statistics, 22(3), 1997, pp. 291-307
Citations number
29
Categorie Soggetti
Social Sciences, Mathematical Methods","Education & Educational Research
ISSN journal
10769986
Volume
22
Issue
3
Year of publication
1997
Pages
291 - 307
Database
ISI
SICI code
1076-9986(1997)22:3<291:FIT-AP>2.0.ZU;2-R
Abstract
When testing a family of comparisons or contrasts across k treatment g roups, researchers are often encouraged to maintain control over the f amilywise Type I error rate. For common families such as comparisons a gainst a reference group, sets of orthogonal and/or nonorthogonal cont rasts, and all possible pairwise comparisons, numerous simultaneous (a nd more recently sequential) resting methods have been proposed. Many of the simultaneous methods can be shown to be a form of Krishnaiah's (e.g., 1979) finite intersection test (FIT) for simultaneous multiple comparisons, which controls the familywise error rate to precisely a u nder conditions assumed in standard ANOVA scenarios. Other methods, ho wever, merely represent conservative approximations to a FIT procedure , yielding suboptimal power for conducting simultaneous testing. The p urpose of the current article is threefold. First, we discuss how FIT methodology represents a paradigm that unifies many existing methods f or simultaneous inference, as well as how it suggests an improved meth od for testing nonorthogonal contrasts. Second, we illustrate more pow erful multiple comparison procedures that combine FIT methodology with sequential hypothesis testing strategies. Third, we present a simple simulation strategy for generating critical values necessary to conduc t these more powerful FIT-based methods. Examples of these methods are given.