Biases of Success Rate Differences Shown in Binomial Effect Size Displays.
- 1 January 2004
- journal article
- Published by American Psychological Association (APA) in Psychological Methods
- Vol. 9 (2) , 183-197
- https://doi.org/10.1037/1082-989x.9.2.183
Abstract
The intent of a binomial effect size display (BESD) is to show "the [real-world] importance of [an] effect indexed by a correlation [r]" (R. Rosenthal, 1994, p. 242) by reexpressing this correlation as a success rate difference (SRD) (e.g., treatment group success rate-control group success rate). However, SRDs displayed in BESDs generally overestimate real-world SRDs implied by correlations of (a) dichotomous X and Y variables (phi coefficients), (b) dichotomous X and continuous Y variables (point-biserial coefficients [rpbs]). and (c) continuous X and Y variables (rxys). Furthermore, overestimation biases are larger for rxys than for rpbs. Differences in the sizes of biases linked to different correlations suggest that BESD SRDs reported for different correlations are not comparable. The stochastic difference index (N. Cliff, 1993: A. Vargha & H. D. Delaney, 2000) is recommended as an alternative to the BESD.Keywords
This publication has 44 references indexed in Scilit:
- Psychological testing and psychological assessment: A review of evidence and issues.American Psychologist, 2001
- A Critique and Improvement of the "CL" Common Language Effect Size Statistics of McGraw and WongJournal of Educational and Behavioral Statistics, 2000
- An Evaluation of Rosenthal and Rubin's Binomial Effect Size DisplayJournal of Educational and Behavioral Statistics, 1997
- Computing contrasts, effect sizes, and counternulls on other people's published data: General procedures for research consumers.Psychological Methods, 1996
- Dichotomization, Partial Correlation, and Conditional IndependenceJournal of Educational and Behavioral Statistics, 1996
- Progress in clinical psychology: Is there any?Clinical Psychology: Science and Practice, 1995
- Statistical analysis of ordinal categorical status after therapies.Journal of Consulting and Clinical Psychology, 1994
- How are we doing in soft psychology?American Psychologist, 1990
- A Measure of Experimental Effect Size Based on Success RatesEducational and Psychological Measurement, 1983
- On the geometrical treatment of the 'normal curve' of statistics, with especial reference to correlation and to the theory of errorProceedings of the Royal Society of London, 1898