Optimal Short-Term Population Coding: When Fisher Information Fails
- 1 October 2002
- journal article
- Published by MIT Press in Neural Computation
- Vol. 14 (10) , 2317-2351
- https://doi.org/10.1162/08997660260293247
Abstract
Efficient coding has been proposed as a first principle explaining neuronal response properties in the central nervous system. The shape of optimal codes, however, strongly depends on the natural limitations of the particular physical system. Here we investigate how optimal neuronal encoding strategies are influenced by the finite number of neurons N (place constraint), the limited decoding time window length T (time constraint), the maximum neuronal firing rate fmax (power constraint), and the maximal average rate fmax (energy constraint). While Fisher information provides a general lower bound for the mean squared error of unbiased signal reconstruction, its use to characterize the coding precision is limited. Analyzing simple examples, we illustrate some typical pitfalls and thereby show that Fisher information provides a valid measure for the precision of a code only if the dynamic range (fmin T, fmax T) is sufficiently large. In particular, we demonstrate that the optimal width of gaussian tuning curves depends on the available decoding time T. Within the broader class of unimodal tuning functions, it turns out that the shape of a Fisher-optimal coding scheme is not unique. We solve this ambiguity by taking the minimum mean square error into account, which leads to flat tuning curves. The tuning width, however, remains to be determined by energy constraints rather than by the principle of efficient coding.Keywords
This publication has 20 references indexed in Scilit:
- Point process models of single-neuron dischargesJournal of Computational Neuroscience, 1996
- Speed, noise, information and the graded nature of neuronal responsesNetwork: Computation in Neural Systems, 1996
- Energy Efficient Neural CodesNeural Computation, 1996
- Processing speed in the cerebral cortex and the neurophysiology of visual maskingProceedings Of The Royal Society B-Biological Sciences, 1994
- Information-theoretic asymptotics of Bayes methodsIEEE Transactions on Information Theory, 1990
- A theory for the use of visual orientation information which exploits the columnar structure of striate cortexBiological Cybernetics, 1988
- Neuronal Population Coding of Movement DirectionScience, 1986
- Topography of the retina and striate cortex and its relationship to visual acuity in rhesus monkeys and squirrel monkeysExperimental Brain Research, 1970
- Some informational aspects of visual perception.Psychological Review, 1954
- Sur l'extension de certaines evaluations statistiques au cas de petits echantillonsRevue de l'Institut International de Statistique / Review of the International Statistical Institute, 1943