ELEMENTAL SUBSETS - THE BUILDING-BLOCKS OF REGRESSION

In a regression dataset an elemental subset consists of the minimum nu mber of cases required to estimate the unknown parameters of a regress ion model. The resulting elemental regression provides an exact fit to the cases in the elemental subset. Early methods of regression estima tion were based on combining the results of elemental regressions. Thi s approach was abandoned because of its computational infeasibility in all but the smallest datasets and because of the arrival of the least squares method. With the computing power available today, there has b een renewed interest in making use of the elemental regressions for mo del fitting and diagnostic purposes. In this paper we consider the ele mental subsets and their associated elemental regressions as useful '' building blocks'' for the estimation of regression models, Many existi ng estimators can be expressed in terms of the elemental regressions, We introduce a new classification of regression estimators that genera lizes a characterization of ordinary least squares (OLS) based on elem ental regressions, Estimators in this class are weighted averages of t he elemental regressions, where the weights are determined by leverage and residual information associated with the elemental subsets. The n ew classification incorporates many existing estimators and provides a framework for developing new alternatives to least squares regression , including the trimmed elemental estimators (TEE) proposed in this pa per.