Effect Size and Power in Assessing Moderating Effects of Categorical Variables Using Multiple Regression: A 30-Year Review.
Top Cited Papers
- 1 January 2005
- journal article
- review article
- Published by American Psychological Association (APA) in Journal of Applied Psychology
- Vol. 90 (1) , 94-107
- https://doi.org/10.1037/0021-9010.90.1.94
Abstract
The authors conducted a 30-year review (1969-1998) of the size of moderating effects of categorical variables as assessed using multiple regression. The median observed effect size (f(2)) is only .002, but 72% of the moderator tests reviewed had power of .80 or greater to detect a targeted effect conventionally defined as small. Results suggest the need to minimize the influence of artifacts that produce a downward bias in the observed effect size and put into question the use of conventional definitions of moderating effect sizes. As long as an effect has a meaningful impact, the authors advise researchers to conduct a power analysis and plan future research designs on the basis of smaller and more realistic targeted effect sizes.Keywords
This publication has 54 references indexed in Scilit:
- The Role of General Cognitive Ability and Job Performance: Why There Cannot Be a DebateHuman Performance, 2002
- The Abuse of PowerThe American Statistician, 2001
- Media ReviewsEducational Media International, 1996
- Male-female differences: A computer simulation.American Psychologist, 1996
- Seasickness as a self-fulfilling prophecy: Raising self-efficacy to boost performance at sea.Journal of Applied Psychology, 1995
- Investigation of general and program-specific attitudes toward corporate drug-testing policies.Journal of Applied Psychology, 1994
- On Theory, Statistics, and the Search for Interactions in the Organizational SciencesJournal of Management, 1994
- SELF‐ASSESSED TRAINING NEEDS: THE EFFECTS OF ATTITUDES TOWARD TRAINING, MANAGERIAL LEVEL, AND FUNCTIONPersonnel Psychology, 1987
- Large Sample Estimators for Standard Errors of Functions of Correlation CoefficientsApplied Psychological Measurement, 1980
- Problems with the use of "moderator" variables.Psychological Bulletin, 1971