Researchers Misunderstand Confidence Intervals and Standard Error Bars.
- 1 January 2005
- journal article
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 10 (4) , 389-396
- https://doi.org/10.1037/1082-989x.10.4.389
Abstract
Little is known about researchers' understanding of confidence intervals (CIs) and standard error (SE) bars. Authors of journal articles in psychology, behavioral neuroscience, and medicine were invited to visit a Web site where they adjusted a figure until they judged 2 means, with error bars, to be just statistically significantly different (p < .05). Results from 473 respondents suggest that many leading researchers have severe misconceptions about how error bars relate to statistical significance, do not adequately distinguish CIs and SE bars, and do not appreciate the importance of whether the 2 means are independent or come from a repeated measures design. Better guidelines for researchers and less ambiguous graphical conventions are needed before the advantages of CIs for research communication can be realized.Keywords
This publication has 15 references indexed in Scilit:
- Inference by Eye: Confidence Intervals and How to Read Pictures of Data.American Psychologist, 2005
- Editors Can Lead Researchers to Confidence Intervals, but Can't Make Them ThinkPsychological Science, 2004
- Using confidence intervals for graphically based data interpretation.Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale, 2003
- Past and Future American Psychological Association Guidelines for Statistical PracticeTheory & Psychology, 2002
- A Primer on the Understanding, Use, and Calculation of Confidence Intervals That Are Based on Central and Noncentral DistributionsEducational and Psychological Measurement, 2001
- Reporting of Statistical Inference in the Journal of Applied Psychology: Little Evidence of ReformEducational and Psychological Measurement, 2001
- Why “Encouraging” Effect Size Reporting Is Not Working: The Etiology of Researcher Resistance to Changing PracticesThe Journal of Psychology, 1999
- The earth is round (p < .05).American Psychologist, 1994
- What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.American Psychologist, 1992
- Things I have learned (so far).American Psychologist, 1990