In Top-Down Decisions, Weighting Variables does Not Matter: A Consequence of Wilks' Theorem
Open Access
- 1 October 1998
- journal article
- Published by SAGE Publications in Organizational Research Methods
- Vol. 1 (4) , 407-420
- https://doi.org/10.1177/109442819814003
Abstract
It is often appropriate to weight variables to form a composite for making decisions. Examples include selection systems, organizational performance criteria, test items, and decision modeling. Frequently, criterion-based regression-weighting is employed, but a sizable literature argues for unit or simple weighting. Wainer demonstrated small loss from equal weights compared to regression weights. Usually, weights are of little importance for rank ordering, echoing Wainer's "it don't make no nevermind." Wilks proved a general theorem, that under common circumstances, almost all weighted composites of a set of variables are highly correlated. That is, if a single set of variables is weighted two different ways to form two composites, the expected correlation for the two composites is very high. The authors demonstrate the effect of Wilks' theorem through illustrative examples. Implications of Wilks' theorem are discussed. When top-down decisions are made, weighting variables does not matter because the rank ordering remains almost constant.Keywords
This publication has 30 references indexed in Scilit:
- The Predictive Validity of the Asvab for Training GradesEducational and Psychological Measurement, 1992
- Understanding the Relations Between Selection Factors and Pilot Training Performance: Does the Criterion Make a Difference?The International Journal of Aviation Psychology, 1992
- Accounting for nonlinear utility functions in composite measures of productivity and performanceOrganizational Behavior and Human Decision Processes, 1991
- A Comparison of Five Methods for Combining Multiple Criteria into a Single CompositeEducational and Psychological Measurement, 1982
- Estimating coefficients in linear models: It don't make no nevermind.Psychological Bulletin, 1976
- Unit weighting schemes for decision makingOrganizational Behavior and Human Performance, 1975
- Linear models in decision making.Psychological Bulletin, 1974
- ANOTHER LOOK AT WEIGHTING TEST ITEMSJournal of Educational Measurement, 1966
- The Relative Efficiency of four Test Weighting Methods in Multiple PredictionEducational and Psychological Measurement, 1959
- Weighting questions in the essay-type examination.Journal of Educational Psychology, 1938