S. Olejnik et al., Using Wherry's adjusted R-2 and Mallow's C-p for model selection from all possible regressions, J EXP EDUC, 68(4), 2000, pp. 365-380
Selecting a subset of predictors from a pool of potential predictors contin
ues to be a common problem encountered by applied researchers in education.
Because of several limitations associated with stepwise variable selection
procedures, the examination of all possible regression solutions has been
recommended. The authors evaluated the use of Mallow's C-p and Wherry's adj
usted R-2 statistics to select a final model from a pool of model solutions
, Neither the C-p nor the adjusted R-2 statistic correctly identified the u
nderlying regression model any better and was generally worse than the step
wise selection method, which itself was poor Using any of the model selecti
on procedures studied here resulted in biased estimates of the authentic re
gression coefficients and underestimation of their standard errors, The use
of theory and professional judgment is recommended for the selection of va
riables in a prediction equation.