Wavelets, vision and the statistics of natural scenes
- 1 September 1999
- journal article
- research article
- Published by The Royal Society in Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
- Vol. 357 (1760) , 2527-2542
- https://doi.org/10.1098/rsta.1999.0446
Abstract
The processing of spatial information by the visual system shows a number of similarities to the wavelet transforms that have become popular in applied mathematics. Over the last decade, a range of studies have focused on the question of ‘why’ the visual system would evolve this strategy of coding spatial information. One such approach has focused on the relationship between the visual code and the statistics of natural scenes under the assumption that the visual system has evolved this strategy as a means of optimizing the representation of its visual environment. This paper reviews some of this literature and looks at some of the statistical properties of natural scenes that allow this code to be efficient. It is argued that such wavelet codes are efficient because they increase the independence of the vectors' outputs (i.e. they increase the independence of the responses of the visual neurons) by finding the sparse structure available in the input. Studies with neural networks that attempt to maximize the ‘sparsity’ of the representation have been shown to produce vectors (neural receptive fields) that have many of the properties of a wavelet representation. It is argued that the visual environment has the appropriate sparse structure to make this sparse output possible. It is argued that these sparse/independent representations make it computationally easier to detect and represent the higher–order structure present in complex environmental data.Keywords
This publication has 44 references indexed in Scilit:
- Sparse coding with an overcomplete basis set: A strategy employed by V1?Published by Elsevier ,2003
- BCM network develops orientation selectivity and ocular dominance in natural scene environmentVision Research, 1997
- Amplitude spectra of natural imagesOphthalmic and Physiological Optics, 1992
- Feature Extraction Using an Unsupervised Neural NetworkNeural Computation, 1992
- Do Gabor functions provide appropriate descriptions of visual cortical receptive fields?Journal of the Optical Society of America A, 1990
- Network model of shape-from-shading: neural function arises from both receptive and projective fieldsNature, 1988
- Spatial properties of neurons in the monkey striate cortexProceedings of the Royal Society of London. B. Biological Sciences, 1987
- The structure and symmetry of simple-cell receptive-field profiles in the cat’s visual cortexProceedings of the Royal Society of London. B. Biological Sciences, 1986
- Relationship between spatial-frequency and orientation tuning of striate-cortex cellsJournal of the Optical Society of America A, 1985
- On the variety of spatial frequency selectivities shown by neurons in area 17 of the catProceedings of the Royal Society of London. B. Biological Sciences, 1981