Regularization and Variable Selection Via the Elastic Net
Top Cited Papers
- 9 March 2005
- journal article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 67 (2) , 301-320
- https://doi.org/10.1111/j.1467-9868.2005.00503.x
Abstract
Summary. We propose the elastic net, a new regularization and variable selection method. Real world data and a simulation study show that the elastic net often outperforms the lasso, while enjoying a similar sparsity of representation. In addition, the elastic net encourages a grouping effect, where strongly correlated predictors tend to be in or out of the model together. The elastic net is particularly useful when the number of predictors (p) is much bigger than the number of observations (n). By contrast, the lasso is not a very satisfactory variable selection method in the p≫n case. An algorithm called LARS‐EN is proposed for computing elastic net regularization paths efficiently, much like algorithm LARS does for the lasso.Keywords
Funding Information
- National Science Foundation (DMS-0204162)
- National Institutes of Health (RO1-EB0011988-08)
This publication has 19 references indexed in Scilit:
- Classification of gene microarrays by penalized logistic regressionBiostatistics, 2004
- Finding predictive gene groups from microarray dataJournal of Multivariate Analysis, 2004
- Least angle regressionThe Annals of Statistics, 2004
- Regression Approaches for Microarray Data AnalysisJournal of Computational Biology, 2003
- Diagnosis of multiple cancer types by shrunken centroids of gene expressionProceedings of the National Academy of Sciences, 2002
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle PropertiesJournal of the American Statistical Association, 2001
- Significance analysis of microarrays applied to the ionizing radiation responseProceedings of the National Academy of Sciences, 2001
- Heuristics of instability and stabilization in model selectionThe Annals of Statistics, 1996
- A Statistical View of Some Chemometrics Regression ToolsTechnometrics, 1993
- Regularized Discriminant AnalysisJournal of the American Statistical Association, 1989