L1-Regularization Path Algorithm for Generalized Linear Models
Top Cited Papers
- 7 August 2007
- journal article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 69 (4) , 659-677
- https://doi.org/10.1111/j.1467-9868.2007.00607.x
Abstract
Summary. We introduce a path following algorithm for L1-regularized generalized linear models. The L1-regularization procedure is useful especially because it, in effect, selects variables according to the amount of penalization on the L1-norm of the coefficients, in a manner that is less greedy than forward selection–backward deletion. The generalized linear model path algorithm efficiently computes solutions along the entire regularization path by using the predictor–corrector method of convex optimization. Selecting the step length of the regularization parameter is critical in controlling the overall accuracy of the paths; we suggest intuitive and flexible strategies for choosing appropriate values. We demonstrate the implementation with several simulated and real data sets.Keywords
Funding Information
- National Science Foundation (DMS-0505676)
- National Institutes of Health (2R01 CA 72028-07)
This publication has 17 references indexed in Scilit:
- Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Least angle regressionThe Annals of Statistics, 2004
- A simple and efficient algorithm for gene selection using sparse logistic regressionBioinformatics, 2003
- A solution to the problem of separation in logistic regressionStatistics in Medicine, 2002
- Diagnosis of multiple cancer types by shrunken centroids of gene expressionProceedings of the National Academy of Sciences, 2002
- A new approach to variable selection in least squares problemsIMA Journal of Numerical Analysis, 2000
- Bias reduction of maximum likelihood estimatesBiometrika, 1993
- Bias Reduction of Maximum Likelihood EstimatesBiometrika, 1993
- Estimation of the Mean of a Multivariate Normal DistributionThe Annals of Statistics, 1981
- Covariance Analysis of Heart Transplant Survival DataJournal of the American Statistical Association, 1977