Statistical mechanics of image restoration
- 7 February 1995
- journal article
- Published by IOP Publishing in Journal of Physics A: General Physics
- Vol. 28 (3) , 511-532
- https://doi.org/10.1088/0305-4470/28/3/009
Abstract
We develop the statistical mechanics formulation of the image restoration problem, pioneered by Geman and Geman (1984). Using Bayesian methods we establish the posterior probability distribution for restored images, for given data (corrupted image) and prior (assumptions about source and corruption process). In the simplest cases, studied here, the posterior is controlled by a cost function analagous to the configurational energy of an Ising model with local fields whose sense is defined by the data. Through a combination of Monte Carlo simulation and mean-field theory we address three key issues. First, we explore the sensitivity of the posterior distribution to the choice of prior parameters: we find phase transitions separating regions in which the distribution is effective (data-dominated) from regions in which it is ineffective (prior-dominated). Second, we examine the question of how best to use the posterior distribution to prescribe a single "optimal" restored image: we argue that the mean of the posterior is, in general, to be preferred over the mode, both in principle and in practice. Finally, borrowing from Monte Carlo techniques for free-energy calculations, we address the question of prior parameter estimation within the "evidence" framework of Gull (1989) and MacKay (1992): our results suggest that parameters identified by this framework provide effective priors, leading to optimal restoration, only to the extent that the forms of the priors are well matched to the processes they claim to represent.Keywords
This publication has 30 references indexed in Scilit:
- Parameter estimation and restoration of noisy images using Gibbs distributions in hidden Markov modelsCVGIP: Graphical Models and Image Processing, 1992
- Compound Gauss-Markov random fields for image estimationIEEE Transactions on Signal Processing, 1991
- Simultaneous parameter estimation and segmentation of Gibbs random fields using simulated annealingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- A renormalization group approach to image processing problemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Inference for Discrete Markov Fields: The Simplest Nontrivial CaseJournal of the American Statistical Association, 1987
- Probabilistic Solution of Ill-Posed Problems in Computational VisionJournal of the American Statistical Association, 1987
- Estimation and choice of neighbors in spatial-interaction models of imagesIEEE Transactions on Information Theory, 1983
- On the estimation and testing of spatial interaction in Gaussian lattice processesBiometrika, 1975
- Estimation Methods for Models of Spatial InteractionJournal of the American Statistical Association, 1975
- Bayesian-Based Iterative Method of Image Restoration*Journal of the Optical Society of America, 1972