Hierarchical Partitioning
- 1 May 1991
- journal article
- research article
- Published by Taylor & Francis in The American Statistician
- Vol. 45 (2) , 90-96
- https://doi.org/10.1080/00031305.1991.10475776
Abstract
Many users of regression methods are attracted to the notion that it would be valuable to determine the relative importance of independent variables. This article demonstrates a method based on hierarchies that builds on previous efforts to decompose R 2 through incremental partitioning. The standard method of incremental partitioning has been to follow one order among the many possible orders available. By taking a hierarchical approach in which all orders of variables are used, the average independent contribution of a variable is obtained and an exact partitioning results. Much the same logic is used to divide the joint effect of a variable. The method is general and applicable to all regression methods, including ordinary least squares, logistic, probit, and log-linear regression. A validation test demonstrates that the algorithm is sensitive to the relationships in the data rather than the proportion of variability accounted for by the statistical model used.Keywords
This publication has 17 references indexed in Scilit:
- Information-Theoretic Measures of Fit for Univariate and Multivariate Linear RegressionsThe American Statistician, 1988
- Sometimes R 2 > r 2 yx 1 + r 2 yx 2 : Correlated Variables Are Not Always RedundantThe American Statistician, 1987
- Relative Importance by Averaging over OrderingsThe American Statistician, 1987
- A New Measure of Attributable Risk for Public Health ApplicationsManagement Science, 1985
- Partitioning Variance in Multiple Regression Analyses as a Tool For Developing Learning ModelsAmerican Educational Research Journal, 1971
- Macro-Analysis of the American Educational SystemOperations Research, 1969
- A Development of Multiple Regression for the Analysis of Routine DataJournal of the Royal Statistical Society Series C: Applied Statistics, 1967
- An application of information theory to the analysis of contingency tables, with a table of 2n ln, n=1(1)10,000Journal of Research of the National Bureau of Standards Section B Mathematics and Mathematical Physics, 1962
- Components of a Difference Between Two RatesJournal of the American Statistical Association, 1955