Appropriate Moderated Regression and Inappropriate Research Strategy: A Demonstration of Information Loss Due to Scale Coarseness
- 1 September 1991
- journal article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 15 (3) , 257-266
- https://doi.org/10.1177/014662169101500305
Abstract
Paunonen and Jackson (1988) demonstrated that stepwise moderated regression provides a test of interaction effects that protects the nominal Type I error rate. However, the stepwise procedure has also been characterized as failing to detect interaction effects in empirical studies. This issue has led to questions regarding the method’s statistical power (Bobko, 1986; Zedeck, 1971) in applied research. It is demonstrated that, because of a research strategy frequently used in empirical investigations, the probability of Type II error in detecting a true interaction effect is unknown. Specifically, the number of scale steps used in measuring the dependent variable is shown to result in a form of systematic error that can spuriously increase or decrease the expected effect size of the interaction. The problem is also discussed in the context of testing more complex models. Recommendations for eliminating this problem in future research designs are provided. Index terms: information loss, interaction effects, Likert scales, moderated regression, response transformationKeywords
This publication has 25 references indexed in Scilit:
- A solution to some dilemmas when testing hypotheses about ordinal interactions.Journal of Applied Psychology, 1986
- Importance of factors in the review of grant proposals.Journal of Applied Psychology, 1986
- Individual decision processes in an assessment center.Journal of Applied Psychology, 1985
- The Cost of DichotomizationApplied Psychological Measurement, 1983
- Modeling effort decisions with behavioral decision theory: Toward an individual differences model of expectancy theoryOrganizational Behavior and Human Performance, 1981
- A Monte Carlo study of factors affecting three indices of composite scale reliability.Journal of Applied Psychology, 1977
- The Analysis of Nonlinearity Via Linear Regression with Polynomial and Product Variables: An ExaminationReview of Educational Research, 1976
- Spurious Product Correlation1Educational and Psychological Measurement, 1976
- Note on GroupingJournal of the American Statistical Association, 1957
- A comparison of the Thurstone and Likert techniques of attitude scale construction.Journal of Applied Psychology, 1946