A Note on Stagewise Regression

Citation
M. Alley, William, A Note on Stagewise Regression, American statistician , 41(2), 1987, pp. 132-134
Journal title
ISSN journal
00031305
Volume
41
Issue
2
Year of publication
1987
Pages
132 - 134
Database
ACNP
SICI code
Abstract
Suppose one estimates the coefficient .2 in E[Y] = .0 + .1 X 1 + .2 X 2 by stagewise regression.That is, first the model E[Y] . .0 + .1 X 1 is fit using simple linear regression followed by a simple linear regression of the residuals from this model on X 2 to yield the estimator .2.The ratio of the squared t statistic for the estimate b 2 from multiple regression to the squared t statistic for .2 is greater than or equal to 1.0 and is shown to be a convenient function of correlation coefficients among Y, X 1, and X 2.Examination of stagewise regression can provide useful insights when introducing concepts of multiple regression.