Estimatingp-values in small microarray experiments
Open Access
- 30 October 2006
- journal article
- research article
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 23 (1) , 38-43
- https://doi.org/10.1093/bioinformatics/btl548
Abstract
Motivation: Microarray data typically have small numbers of observations per gene, which can result in low power for statistical tests. Test statistics that borrow information from data across all of the genes can improve power, but these statistics have non-standard distributions, and their significance must be assessed using permutation analysis. When sample sizes are small, the number of distinct permutations can be severely limited, and pooling the permutation-derived test statistics across all genes has been proposed. However, the null distribution of the test statistics under permutation is not the same for equally and differentially expressed genes. This can have a negative impact on both p-value estimation and the power of information borrowing statistics. Results: We investigate permutation based methods for estimating p-values. One of methods that uses pooling from a selected subset of the data are shown to have the correct type I error rate and to provide accurate estimates of the false discovery rate (FDR). We provide guidelines to select an appropriate subset. We also demonstrate that information borrowing statistics have substantially increased power compared to the t-test in small experiments. Contact:garyc@jax.org Supplementary information: Supplementary data are available at Bioinformatics online.Keywords
This publication has 13 references indexed in Scilit:
- Removing intensity effects and identifying significant genes for Affymetrix arrays in macrophage migration inhibitory factor-suppressed neuroblastoma cellsProceedings of the National Academy of Sciences, 2005
- A note on using permutation-based false discovery rate estimates to compare different analysis methods for microarray dataBioinformatics, 2005
- Improved statistical tests for differential gene expression by shrinking variance components estimatesBiostatistics, 2004
- Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray ExperimentsStatistical Applications in Genetics and Molecular Biology, 2004
- The positive false discovery rate: a Bayesian interpretation and the q-valueThe Annals of Statistics, 2003
- A Direct Approach to False Discovery RatesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- Significance analysis of microarrays applied to the ionizing radiation responseProceedings of the National Academy of Sciences, 2001
- R: A Language for Data Analysis and GraphicsJournal of Computational and Graphical Statistics, 1996
- Robust Locally Weighted Regression and Smoothing ScatterplotsJournal of the American Statistical Association, 1979
- Robust Locally Weighted Regression and Smoothing ScatterplotsJournal of the American Statistical Association, 1979