Escaping the Bonferroni iron claw in ecological studies
Top Cited Papers
- 14 May 2004
- Vol. 105 (3) , 657-663
- https://doi.org/10.1111/j.0030-1299.2004.13046.x
Abstract
I analyze some criticisms made about the application of alpha‐inflation correction procedures to repeated‐test tables in ecological studies. Common pitfalls during application, the statistical properties of many ecological datasets, and the strong control of the tablewise error rate made by the widely used sequential Bonferroni procedures, seem to be responsible for some ‘illogical’ results when such corrections are applied. Sharpened Bonferroni‐type procedures may alleviate the decrease in power associated to standard methods as the number of tests increases.More powerful methods, based on controlling the false discovery rate (FDR), deserve a more frequent use in ecological studies, especially in those involving large repeated‐test tables in which several or many individual null hypotheses have been rejected, and the most significant p‐value is relatively large.I conclude that some reasonable control of alpha inflation is required of authors as a safeguard against striking, but spurious findings, which may strongly affect the credibility of ecological research.Keywords
This publication has 34 references indexed in Scilit:
- Identifying differentially expressed genes using false discovery rate controlling proceduresBioinformatics, 2003
- A Direct Approach to False Discovery RatesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- Empirical bayes methods and false discovery rates for microarraysGenetic Epidemiology, 2002
- Familywise Robustness Criteria for Multiple-Comparison ProceduresJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- Controlling the False-Discovery Rate in Astrophysical Data AnalysisThe Astronomical Journal, 2001
- The control of the false discovery rate in multiple testing under dependencyThe Annals of Statistics, 2001
- Stepwise normal theory multiple test procedures controlling the false discovery rateJournal of Statistical Planning and Inference, 2000
- Plots of P-values to evaluate many tests simultaneouslyBiometrika, 1982
- A Note on a Method for the Analysis of Significances en masseTechnometrics, 1968