A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration
Top Cited Papers
- 19 November 2007
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 16 (12) , 2992-3004
- https://doi.org/10.1109/tip.2007.909319
Abstract
Iterative shrinkage/thresholding (1ST) algorithms have been recently proposed to handle a class of convex unconstrained optimization problems arising in image restoration and other linear inverse problems. This class of problems results from combining a linear observation model with a nonquadratic regularizer (e.g., total variation or wavelet-based regularization). It happens that the convergence rate of these 1ST algorithms depends heavily on the linear observation operator, becoming very slow when this operator is ill-conditioned or ill-posed. In this paper, we introduce two-step 1ST (TwIST) algorithms, exhibiting much faster convergence rate than 1ST for ill-conditioned problems. For a vast class of nonquadratic convex regularizers (lscrP norms, some Besov norms, and total variation), we show that TwIST converges to a minimizer of the objective function, for a given range of values of its parameters. For noninvertible observation operators, we introduce a monotonic version of TwIST (MTwIST); although the convergence proof does not apply to this scenario, we give experimental evidence that MTwIST exhibits similar speed gains over IST. The effectiveness of the new methods are experimentally confirmed on problems of image deconvolution and of restoration with missing samples.Keywords
This publication has 37 references indexed in Scilit:
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- A Tutorial on MM AlgorithmsThe American Statistician, 2004
- ForWaRD: Fourier-Wavelet Regularized Deconvolution for Ill-Conditioned SystemsIEEE Transactions on Signal Processing, 2004
- Adaptive sparseness for supervised learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- An EM algorithm for wavelet-based image restorationIEEE Transactions on Image Processing, 2003
- On the convergence of nonstationary iterative methods for symmetric positive (semi)definite systemsApplied Numerical Mathematics, 2001
- Solving variational inequality problems via smoothing-nonsmooth reformulationsJournal of Computational and Applied Mathematics, 2001
- Adapting to Unknown Smoothness via Wavelet ShrinkageJournal of the American Statistical Association, 1995
- On some Bayesian/regularization methods for image restorationIEEE Transactions on Image Processing, 1995
- On the Convergence Properties of the EM AlgorithmThe Annals of Statistics, 1983