Approximate maximum likelihood hyperparameter estimation for Gibbs priors
- 1 June 1997
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 6 (6) , 844-861
- https://doi.org/10.1109/83.585235
Abstract
The parameters of the prior, the hyperparameters, play an important role in Bayesian image estimation. Of particular importance for the case of Gibbs priors is the global hyperparameter, beta, which multiplies the Hamiltonian. Here we consider maximum likelihood (ML) estimation of beta from incomplete data, i.e., problems in which the image, which is drawn from a Gibbs prior, is observed indirectly through some degradation or blurring process. Important applications include image restoration and image reconstruction from projections. Exact ML estimation of beta from incomplete data is intractable for most image processing. Here we present an approximate ML estimator that is computed simultaneously with a maximum a posteriori (MAP) image estimate. The algorithm is based on a mean field approximation technique through which multidimensional Gibbs distributions are approximated by a separable function equal to a product of one-dimensional (1-D) densities. We show how this approach can be used to simplify the ML estimation problem. We also show how the Gibbs-Bogoliubov-Feynman (GBF) bound can be used to optimize the approximation for a restricted class of problems. We present the results of a Monte Carlo study that examines the bias and variance of this estimator when applied to image restoration.Keywords
This publication has 24 references indexed in Scilit:
- Study of the effects of using anatomical priors in PET reconstructionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- ML parameter estimation for Markov random fields with applications to Bayesian tomographyIEEE Transactions on Image Processing, 1998
- Maximum-likelihood parameter estimation for unsupervised stochastic model-based image segmentationIEEE Transactions on Image Processing, 1994
- The mean field theory in EM procedures for blind Markov random field image restorationIEEE Transactions on Image Processing, 1993
- The mean field theory for image motion estimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1993
- The mean field theory in EM procedures for Markov random fieldsIEEE Transactions on Signal Processing, 1992
- A study of methods of choosing the smoothing parameter in image restoration by regularizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1991
- Spline Models for Observational DataPublished by Society for Industrial & Applied Mathematics (SIAM) ,1990
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of ImagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1984
- Pitfalls in the Numerical Solution of Linear Ill-Posed ProblemsSIAM Journal on Scientific and Statistical Computing, 1983