Energy Efficient Neural Codes
- 1 April 1996
- journal article
- Published by MIT Press in Neural Computation
- Vol. 8 (3) , 531-543
- https://doi.org/10.1162/neco.1996.8.3.531
Abstract
In 1969 Barlow introduced the phrase "economy of impulses" to express the tendency for successive neural systems to use lower and lower levels of cell firings to produce equivalent encodings. From this viewpoint, the ultimate economy of impulses is a neural code of minimal redundancy. The hypothesis motivating our research is that energy expenditures, e.g., the metabolic cost of recovering from an action potential relative to the cost of inactivity, should also be factored into the economy of impulses. In fact, coding schemes with the largest representational capacity are not, in general, optimal when energy expenditures are taken into account. We show that for both binary and analog neurons, increased energy expenditure per neuron implies a decrease in average firing rate if energy efficient information transmission is to be maintained.Keywords
This publication has 10 references indexed in Scilit:
- Spatial correlates of firing patterns of single cells in the subiculum of the freely moving ratJournal of Neuroscience, 1994
- Supervised Factorial LearningNeural Computation, 1993
- Information maintenance and statistical dependence reduction in simple neural networksBiological Cybernetics, 1992
- Could information theory provide an ecological theory of sensory processing?Network: Computation in Neural Systems, 1992
- Correlations in high dimensional or asymmetric data sets: Hebbian neuronal processingNeural Networks, 1991
- Forming sparse representations by local anti-Hebbian learningBiological Cybernetics, 1990
- Differential effects of electrical stimulation of sciatic nerve on metabolic activity in spinal cord and dorsal root ganglion in the rat.Proceedings of the National Academy of Sciences, 1985
- Metabolic activation of specific postsynaptic elements in superior cervical ganglion by antidromic stimulation of external carotid nerveBrain Research, 1985
- Oxygen consumption and phosphate efflux in mammalian non‐myelinated nerve fibres.The Journal of Physiology, 1980
- Information Theory and Statistical MechanicsPhysical Review B, 1957