Probabilistic framework for the adaptation and comparison of image codes
- 1 July 1999
- journal article
- Published by Optica Publishing Group in Journal of the Optical Society of America A
- Vol. 16 (7) , 1587-1601
- https://doi.org/10.1364/josaa.16.001587
Abstract
We apply a Bayesian method for inferring an optimal basis to the problem of finding efficient image codes for natural scenes. The basis functions learned by the algorithm are oriented and localized in both space and frequency, bearing a resemblance to two-dimensional Gabor functions, and increasing the number of basis functions results in a greater sampling density in position, orientation, and scale. These properties also resemble the spatial receptive fields of neurons in the primary visual cortex of mammals, suggesting that the receptive-field structure of these neurons can be accounted for by a general efficient coding principle. The probabilistic framework provides a method for comparing the coding efficiency of different bases objectively by calculating their probability given the observed data or by measuring the entropy of the basis function coefficients. The learned bases are shown to have better coding efficiency than traditional Fourier and wavelet bases. This framework also provides a Bayesian solution to the problems of image denoising and filling in of missing pixels. We demonstrate that the results obtained by applying the learned bases to these problems are improved over those obtained with traditional techniques.Keywords
This publication has 33 references indexed in Scilit:
- Sparse coding with an overcomplete basis set: A strategy employed by V1?Published by Elsevier ,2003
- Independent component filters of natural images compared with simple cells in primary visual cortexProceedings Of The Royal Society B-Biological Sciences, 1998
- Minimax Entropy Principle and Its Application to Texture ModelingNeural Computation, 1997
- Reliable online human signature verification systemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1996
- An Information-Maximization Approach to Blind Separation and Blind DeconvolutionNeural Computation, 1995
- Karhunen–Loève procedure for gappy dataJournal of the Optical Society of America A, 1995
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993
- Entropy reduction and decorrelation in visual coding by oriented neural receptive fieldsIEEE Transactions on Biomedical Engineering, 1989
- Complete discrete 2-D Gabor transforms by neural networks for image analysis and compressionIEEE Transactions on Acoustics, Speech, and Signal Processing, 1988