Relative Importance by Averaging over Orderings

Citation
Kruskal, William, Relative Importance by Averaging over Orderings, American statistician , 41(1), 1987, pp. 6-10
Journal title
ISSN journal
00031305
Volume
41
Issue
1
Year of publication
1987
Pages
6 - 10
Database
ACNP
SICI code
Abstract
Many ways have been suggested for explicating the ambiguous concept of relative importance for independent variables in a multiple regression setting.There are drawbacks to all the explications, but a relatively acceptable one is available when the independent variables have a relevant, known ordering: consider the proportion of variance of the dependent variable linearly accounted for by the first independent variable; then consider the proportion of remaining variance linearly accounted for by the second independent variable; and so on.When, however, the independent variables do not have a relevant ordering, that approach fails.The primary suggestion of this article is to rescue the idea by averaging relative importance over all orderings of the independent variables.Variations and extensions of the idea are described.