False discovery and false nondiscovery rates in single-step multiple testing procedures
Open Access
- 1 February 2006
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 34 (1) , 394-415
- https://doi.org/10.1214/009053605000000778
Abstract
Results on the false discovery rate (FDR) and the false nondiscovery rate (FNR) are developed for single-step multiple testing procedures. In addition to verifying desirable properties of FDR and FNR as measures of error rates, these results extend previously known results, providing further insights, particularly under dependence, into the notions of FDR and FNR and related measures. First, considering fixed configurations of true and false null hypotheses, inequalities are obtained to explain how an FDR- or FNR-controlling single-step procedure, such as a Bonferroni or Šidák procedure, can potentially be improved. Two families of procedures are then constructed, one that modifies the FDR-controlling and the other that modifies the FNR-controlling Šidák procedure. These are proved to control FDR or FNR under independence less conservatively than the corresponding families that modify the FDR- or FNR-controlling Bonferroni procedure. Results of numerical investigations of the performance of the modified Šidák FDR procedure over its competitors are presented. Second, considering a mixture model where different configurations of true and false null hypotheses are assumed to have certain probabilities, results are also derived that extend some of Storey’s work to the dependence case.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- A stochastic process approach to false discovery controlThe Annals of Statistics, 2004
- Robbins, empirical Bayes and microarraysThe Annals of Statistics, 2003
- A Direct Approach to False Discovery RatesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- Operating Characteristics and Extensions of the False Discovery Rate ProcedureJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- Some Results on False Discovery Rate in Stepwise multiple testing proceduresThe Annals of Statistics, 2002
- The control of the false discovery rate in multiple testing under dependencyThe Annals of Statistics, 2001
- On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent StatisticsJournal of Educational and Behavioral Statistics, 2000
- Some probability inequalities for ordered $\rm MTP\sb 2$ random variables: a proof of the Simes conjectureThe Annals of Statistics, 1998
- More powerful procedures for multiple significance testingStatistics in Medicine, 1990
- An improved Bonferroni procedure for multiple tests of significanceBiometrika, 1986