An Interior-Point Method for Large-Scale -Regularized Least Squares
Top Cited Papers
- 1 December 2007
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 1 (4) , 606-617
- https://doi.org/10.1109/jstsp.2007.910971
Abstract
Recently, a lot of attention has been paid to regularization based methods for sparse signal reconstruction (e.g., basis pursuit denoising and compressed sensing) and feature selection (e.g., the Lasso algorithm) in signal processing, statistics, and related fields. These problems can be cast as -regularized least-squares programs (LSPs), which can be reformulated as convex quadratic programs, and then solved by several standard methods such as interior-point methods, at least for small and medium size problems. In this paper, we describe a specialized interior-point method for solving large-scale -regularized LSPs that uses the preconditioned conjugate gradients algorithm to compute the search direction. The interior-point method can solve large sparse problems, with a million variables and observations, in a few tens of minutes on a PC. It can efficiently solve large dense problems, that arise in sparse signal recovery with orthogonal transforms, by exploiting fast algorithms for these transforms. The method is illustrated on a magnetic resonance imaging data set.Keywords
This publication has 42 references indexed in Scilit:
- Forward stagewise regression and the monotone lassoElectronic Journal of Statistics, 2007
- The Adaptive Lasso and Its Oracle PropertiesJournal of the American Statistical Association, 2006
- Stable signal recovery from incomplete and inaccurate measurementsCommunications on Pure and Applied Mathematics, 2006
- Addendum: Regularization and Variable Selection Via the Elastic NetJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Recovery of Exact Sparse Representations in the Presence of Bounded NoiseIEEE Transactions on Information Theory, 2005
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- Least angle regressionThe Annals of Statistics, 2004
- A new approach to variable selection in least squares problemsIMA Journal of Numerical Analysis, 2000
- Interior-point methodology for 3-D PET reconstructionIEEE Transactions on Medical Imaging, 2000
- LSQR: An Algorithm for Sparse Linear Equations and Sparse Least SquaresACM Transactions on Mathematical Software, 1982