Improved centroids estimation for the nearest shrunken centroid classifier
Open Access
- 24 March 2007
- journal article
- research article
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 23 (8) , 972-979
- https://doi.org/10.1093/bioinformatics/btm046
Abstract
Motivation: The nearest shrunken centroid (NSC) method has been successfully applied in many DNA-microarray classification problems. The NSC uses ‘shrunken’ centroids as prototypes for each class and identifies subsets of genes that best characterize each class. Classification is then made to the nearest (shrunken) centroid. The NSC is very easy to implement and very easy to interpret, however, it has drawbacks. Results: We show that the NSC method can be interpreted in the framework of LASSO regression. Based on that, we consider two new methods, adaptive L∞-norm penalized NSC (ALP-NSC) and adaptive hierarchically penalized NSC (AHP-NSC), with two different penalty functions for microarray classification, which improve over the NSC. Unlike the L1-norm penalty used in LASSO, the penalty terms that we consider make use of the fact that parameters belonging to one gene should be treated as a natural group. Numerical results indicate that the two new methods tend to remove irrelevant genes more effectively and provide better classification results than the L1-norm approach. Availability: R code for the ALP-NSC and the AHP-NSC algorithms are available from authors upon request. Contact:jizhu@umich.edu Supplementary information: Supplementary data are available at Bioinformatics online.Keywords
This publication has 20 references indexed in Scilit:
- Multicategory ψ-LearningJournal of the American Statistical Association, 2006
- Classification of microarrays to nearest centroidsBioinformatics, 2005
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observationsBernoulli, 2004
- A comparative review of statistical methods for discovering differentially expressed genes in replicated microarray experimentsBioinformatics, 2002
- Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression DataJournal of the American Statistical Association, 2002
- Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networksNature Medicine, 2001
- Distinct types of diffuse large B-cell lymphoma identified by gene expression profilingNature, 2000
- Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression MonitoringScience, 1999
- Cluster analysis and display of genome-wide expression patternsProceedings of the National Academy of Sciences, 1998
- Better Subset Regression Using the Nonnegative GarroteTechnometrics, 1995