THE RISK INFLATION CRITERION FOR MULTIPLE-REGRESSION

Citation
Dp. Foster et Ei. George, THE RISK INFLATION CRITERION FOR MULTIPLE-REGRESSION, Annals of statistics, 22(4), 1994, pp. 1947-1975
Citations number
20
Categorie Soggetti
Statistic & Probability","Statistic & Probability
Journal title
ISSN journal
00905364
Volume
22
Issue
4
Year of publication
1994
Pages
1947 - 1975
Database
ISI
SICI code
0090-5364(1994)22:4<1947:TRICFM>2.0.ZU;2-Z
Abstract
A new criterion is proposed for the evaluation of variable selection p rocedures in multiple regression. This criterion, which we call the ri sk inflation, is based on an adjustment to the risk. Essentially, the risk inflation is the maximum increase in risk due to selecting rather than knowing the ''correct'' predictors. A new variable selection pro cedure is obtained which, in the case of orthogonal predictors, substa ntially improves on AIC, C-p and BIC and is close to optimal. In contr ast to AIC, C-p and BIC which use dimensionality penalties of 2, 2 and log n, respectively, this new procedure uses a penalty 2 log p, where p is the number of available predictors. For the case of nonorthogona l predictors, bounds for the optimal penalty are obtained.