Models of generalizability theory in analyzing existing faculty evaluationdata

In this article, we demonstrate the use of generalizability theory in analy zing existing faculty evaluation data. Three measurement conceptualizations representing different purposes of faculty evaluation were conceived to ac count for the existing data structure. Variance components associated with these conceptualizations were estimated from random samples taken from an e xisting faculty evaluation conducted in a university in the western United States. Within each of the 3 conceptualizations, 3 decision study considera tions are presented together with the generalizability coefficient estimate s. Practical implications for faculty evaluations are discussed.