Bayesian wavelet-based image deconvolution: a GEM algorithm exploiting a class of heavy-tailed priors
- 20 March 2006
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 15 (4) , 937-951
- https://doi.org/10.1109/tip.2005.863972
Abstract
Image deconvolution is formulated in the wavelet domain under the Bayesian framework. The well-known sparsity of the wavelet coefficients of real-world images is modeled by heavy-tailed priors belonging to the Gaussian scale mixture (GSM) class; i.e., priors given by a linear (finite of infinite) combination of Gaussian densities. This class includes, among others, the generalized Gaussian, the Jeffreys , and the Gaussian mixture priors. Necessary and sufficient conditions are stated under which the prior induced by a thresholding/shrinking denoising rule is a GSM. This result is then used to show that the prior induced by the "nonnegative garrote" thresholding/shrinking rule, herein termed the garrote prior, is a GSM. To compute the maximum a posteriori estimate, we propose a new generalized expectation maximization (GEM) algorithm, where the missing variables are the scale factors of the GSM densities. The maximization step of the underlying expectation maximization algorithm is replaced with a linear stationary second-order iterative method. The result is a GEM algorithm of O(NlogN) computational complexity. In a series of benchmark tests, the proposed approach outperforms or performs similarly to state-of-the art methods, demanding comparable (in some cases, much less) computational complexity.Keywords
This publication has 41 references indexed in Scilit:
- ForWaRD: Fourier-Wavelet Regularized Deconvolution for Ill-Conditioned SystemsIEEE Transactions on Signal Processing, 2004
- An EM algorithm for wavelet-based image restorationIEEE Transactions on Image Processing, 2003
- Wavelet-based image estimation: an empirical Bayes approach using Jeffrey's noninformative priorIEEE Transactions on Image Processing, 2001
- Wavelet domain image restoration with adaptive edge-preserving regularizationIEEE Transactions on Image Processing, 2000
- Thresholding implied by truncated quadratic regularizationIEEE Transactions on Signal Processing, 2000
- Spatially adaptive wavelet-based multiscale image restorationIEEE Transactions on Image Processing, 1996
- Mean field annealing using compound Gauss-Markov random fields for edge detection and image estimationIEEE Transactions on Neural Networks, 1993
- Compound Gauss-Markov random fields for image estimationIEEE Transactions on Signal Processing, 1991
- On the Convergence Properties of the EM AlgorithmThe Annals of Statistics, 1983
- On the asymptotic eigenvalue distribution of Toeplitz matricesIEEE Transactions on Information Theory, 1972