Selection bias in gene extraction on the basis of microarray gene-expression data
Top Cited Papers
- 30 April 2002
- journal article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 99 (10) , 6562-6566
- https://doi.org/10.1073/pnas.102102699
Abstract
In the context of cancer diagnosis and treatment, we consider the problem of constructing an accurate prediction rule on the basis of a relatively small number of tumor tissue samples of known type containing the expression data on very many (possibly thousands) genes. Recently, results have been presented in the literature suggesting that it is possible to construct a prediction rule from only a few genes such that it has a negligible prediction error rate. However, in these results the test error or the leave-one-out cross-validated error is calculated without allowance for the selection bias. There is no allowance because the rule is either tested on tissue samples that were used in the first instance to select the genes being used in the rule or because the cross-validation of the rule is not external to the selection process; that is, gene selection is not performed in training the rule at each stage of the cross-validation process. We describe how in practice the selection bias can be assessed and corrected for by either performing a cross-validation or applying the bootstrap external to the selection process. We recommend using 10-fold rather than leave-one-out cross-validation, and concerning the bootstrap, we suggest using the so-called .632+ bootstrap error estimate designed to handle overfitted prediction rules. Using two published data sets, we demonstrate that when correction is made for the selection bias, the cross-validated error is no longer zero for a subset of only a few genes.Keywords
This publication has 23 references indexed in Scilit:
- Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression DataJournal of the American Statistical Association, 2002
- Gene expression patterns of breast carcinomas distinguish tumor subclasses with clinical implicationsProceedings of the National Academy of Sciences, 2001
- Feature (Gene) Selection in Gene Expression-Based Tumor ClassificationMolecular Genetics and Metabolism, 2001
- Recursive partitioning for tumor classification with gene expression microarray dataProceedings of the National Academy of Sciences, 2001
- Coupled two-way clustering analysis of gene microarray dataProceedings of the National Academy of Sciences, 2000
- Tissue Classification with Gene Expression ProfilesJournal of Computational Biology, 2000
- Comparison of algorithms that select features for pattern classifiersPattern Recognition, 2000
- Wrappers for feature subset selectionArtificial Intelligence, 1997
- Estimating the Error Rate of a Prediction Rule: Improvement on Cross-ValidationJournal of the American Statistical Association, 1983
- Bootstrap Methods: Another Look at the JackknifeThe Annals of Statistics, 1979