On the Analysis and Interpretation of Inhomogeneous Quadratic Forms as Receptive Fields
- 1 August 2006
- journal article
- Published by MIT Press in Neural Computation
- Vol. 18 (8) , 1868-1895
- https://doi.org/10.1162/neco.2006.18.8.1868
Abstract
In this letter, we introduce some mathematical and numerical tools to analyze and interpret inhomogeneous quadratic forms. The resulting characterization is in some aspects similar to that given by experimental studies of cortical cells, making it particularly suitable for application to second-order approximations and theoretical models of physiological receptive fields. We first discuss two ways of analyzing a quadratic form by visualizing the coefficients of its quadratic and linear term directly and by considering the eigenvectors of its quadratic term. We then present an algorithm to compute the optimal excitatory and inhibitory stimuli—those that maximize and minimize the considered quadratic form, respectively, given a fixed energy constraint. The analysis of the optimal stimuli is completed by considering their invariances, which are the transformations to which the quadratic form is most insensitive, and by introducing a test to determine which of these are statistically significant. Next we propose a way to measure the relative contribution of the quadratic and linear term to the total output of the quadratic form. Furthermore, we derive simpler versions of the above techniques in the special case of a quadratic form without linear term. In the final part of the letter, we show that for each quadratic form, it is possible to build an equivalent two-layer neural network, which is compatible with (but more general than) related networks used in some recent articles and with the energy model of complex cells. We show that the neural network is unique only up to an arbitrary orthogonal transformation of the excitatory and inhibitory subunits in the first layer.Keywords
This publication has 22 references indexed in Scilit:
- Slow feature analysis yields a rich repertoire of complex cell propertiesJournal of Vision, 2005
- Quadratic forms in natural imagesNetwork: Computation in Neural Systems, 2003
- Second-order statistics of natural imagesNeurocomputing, 2003
- Spatial frequency selectivity of cells in macaque visual cortexPublished by Elsevier ,2003
- A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural imagesVision Research, 2001
- Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature SubspacesNeural Computation, 2000
- Responses of neurons in primary and inferior temporal visual cortices to natural scenesProceedings Of The Royal Society B-Biological Sciences, 1997
- Spatiotemporal energy models for the perception of motionJournal of the Optical Society of America A, 1985
- The orientation and direction selectivity of cells in macaque visual cortexVision Research, 1982
- Receptive fields, binocular interaction and functional architecture in the cat's visual cortexThe Journal of Physiology, 1962