Prior learning and Gibbs reaction-diffusion
- 1 January 1997
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 19 (11) , 1236-1250
- https://doi.org/10.1109/34.632983
Abstract
This article addresses two important themes in early visual computation: it presents a novel theory for learning the universal statistics of natural images, and, it proposes a general framework of designing reaction-diffusion equations for image processing. We studied the statistics of natural images including the scale invariant properties, then generic prior models were learned to duplicate the observed statistics, based on minimax entropy theory. The resulting Gibbs distributions have potentials of the form U(I; Λ, S)=Σα=1kΣx,yλ (α)((F(α)*I)(x,y)) with S={F(1) , F(2),...,F(K)} being a set of filters and Λ={λ(1)(),λ(2)(),...,λ (K)()} the potential functions. The learned Gibbs distributions confirm and improve the form of existing prior models such as line-process, but, in contrast to all previous models, inverted potentials were found to be necessary. We find that the partial differential equations given by gradient descent on U(I; Λ, S) are essentially reaction-diffusion equations, where the usual energy terms produce anisotropic diffusion, while the inverted energy terms produce reaction associated with pattern formation, enhancing preferred image features. We illustrate how these models can be used for texture pattern rendering, denoising, image enhancement, and clutter removal by careful choice of both prior and data models of this type, incorporating the appropriate featuresKeywords
This publication has 36 references indexed in Scilit:
- Minimax Entropy Principle and Its Application to Texture ModelingNeural Computation, 1997
- Region competition: unifying snakes, region growing, and Bayes/MDL for multiband image segmentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- Nonlinear image filtering with edge and corner enhancementPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1992
- A renormalization group approach to image processing problemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Efficiency of a model human image codeJournal of the Optical Society of America A, 1987
- Multilevel computational processes for visual surface reconstructionComputer Vision, Graphics, and Image Processing, 1983
- A Pre-pattern formation mechanism for animal coat markingsJournal of Theoretical Biology, 1981
- The renormalization group: Critical phenomena and the Kondo problemReviews of Modern Physics, 1975
- The chemical basis of morphogenesisPhilosophical Transactions of the Royal Society of London. B, Biological Sciences, 1952
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951