A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Top Cited Papers
- 1 January 2009
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Imaging Sciences
- Vol. 2 (1) , 183-202
- https://doi.org/10.1137/080716542
Abstract
We consider the class of iterative shrinkage-thresholding algorithms (ISTA) for solving linear inverse problems arising in signal/image processing. This class of methods, which can be viewed as an extension of the classical gradient algorithm, is attractive due to its simplicity and thus is adequate for solving large-scale problems even with dense matrix data. However, such methods are also known to converge quite slowly. In this paper we present a new fast iterative shrinkage-thresholding algorithm (FISTA) which preserves the computational simplicity of ISTA but with a global rate of convergence which is proven to be significantly better, both theoretically and practically. Initial promising numerical results for wavelet-based image deblurring demonstrate the capabilities of FISTA which is shown to be faster than ISTA by several orders of magnitude.Keywords
Funding Information
- Israel Science Foundation (48906)
This publication has 22 references indexed in Scilit:
- Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse ProblemsIEEE Journal of Selected Topics in Signal Processing, 2007
- A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image RestorationIEEE Transactions on Image Processing, 2007
- Coordinate and subspace optimization methods for linear least squares with non-quadratic regularizationApplied and Computational Harmonic Analysis, 2007
- Signal Recovery by Proximal Forward-Backward SplittingMultiscale Modeling & Simulation, 2005
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- An EM algorithm for wavelet-based image restorationIEEE Transactions on Image Processing, 2003
- Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkageIEEE Transactions on Image Processing, 1998
- Atomic Decomposition by Basis PursuitSIAM Journal on Scientific Computing, 1998
- Adapting to Unknown Smoothness via Wavelet ShrinkageJournal of the American Statistical Association, 1995
- On the weak convergence of an ergodic iteration for the solution of variational inequalities for monotone operators in Hilbert spaceJournal of Mathematical Analysis and Applications, 1977