An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
Top Cited Papers
- 26 August 2004
- journal article
- research article
- Published by Wiley in Communications on Pure and Applied Mathematics
- Vol. 57 (11) , 1413-1457
- https://doi.org/10.1002/cpa.20042
Abstract
We consider linear inverse problems where the solution is assumed to have a sparse expansion on an arbitrary preassigned orthonormal basis. We prove that replacing the usual quadratic regularizing penalties by weighted 𝓁p‐penalties on the coefficients of such expansions, with 1 ≤ p ≤ 2, still regularizes the problem. Use of such 𝓁p‐penalized problems with p < 2 is often advocated when one expects the underlying ideal noiseless solution to have a sparse expansion with respect to the basis under consideration. To compute the corresponding regularized solutions, we analyze an iterative algorithm that amounts to a Landweber iteration with thresholding (or nonlinear shrinkage) applied at each iteration step. We prove that this algorithm converges in norm.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- An EM algorithm for wavelet-based image restorationIEEE Transactions on Image Processing, 2003
- Deconvolution by thresholding in mirror wavelet basesIEEE Transactions on Image Processing, 2003
- Wavelet methods for inverting the Radon transform with noisy dataIEEE Transactions on Image Processing, 2001
- Orthonormal Ridgelets and Linear SingularitiesSIAM Journal on Mathematical Analysis, 2000
- Wavelet decomposition approaches to statistical inverse problemsBiometrika, 1998
- Wavelet-Galerkin methods for ill-posed problemsJIIP, 1996
- Superresolution via Sparsity ConstraintsSIAM Journal on Mathematical Analysis, 1992
- Iteration methods for convexly constrained ill-posed problems in hilbert spaceNumerical Functional Analysis and Optimization, 1992
- On Tikhonov's Method for Ill-Posed ProblemsMathematics of Computation, 1974
- An Iteration Formula for Fredholm Integral Equations of the First KindAmerican Journal of Mathematics, 1951