Effective Neuronal Learning with Ineffective Hebbian Learning Rules
- 1 April 2001
- journal article
- Published by MIT Press in Neural Computation
- Vol. 13 (4) , 817-840
- https://doi.org/10.1162/089976601300014367
Abstract
In this article we revisit the classical neuroscience paradigm of Hebbian learning. We find that it is difficult to achieve effective associative memory storage by Hebbian synaptic learning, since it requires network-level information at the synaptic level or sparse coding level. Effective learning can yet be achieved even with nonsparse patterns by a neuronal process that maintains a zero sum of the incoming synaptic efficacies. This weight correction improves the memory capacity of associative networks from an essentially bounded one to a memory capacity that scales linearly with network size. It also enables the effective storage of patterns with multiple levels of activity within a single network. Such neuronal weight correction can be successfully carried out by activity-dependent homeostasis of the neuron's synaptic efficacies, which was recently observed in cortical tissue. Thus, our findings suggest that associative learning by Hebbian synaptic learning should be accompanied by continuous remodeling of neuronally driven regulatory processes in the brain.Keywords
This publication has 24 references indexed in Scilit:
- Hebbian learning and spiking neuronsPhysical Review E, 1999
- Synaptic Economics: Competition and Cooperation in Synaptic PlasticityNeuron, 1996
- Long-Term Depression in HippocampusAnnual Review of Neuroscience, 1996
- The Role of Weight Normalization in Competitive LearningNeural Computation, 1994
- The Role of Constraints in Hebbian LearningNeural Computation, 1994
- Activity-Dependent Regulation of Conductances in Model NeuronsScience, 1993
- A synaptic model of memory: long-term potentiation in the hippocampusNature, 1993
- On the Information Storage Capacity of Local Learning RulesNeural Computation, 1992
- Optimising synaptic learning rules in linear associative memoriesBiological Cybernetics, 1991
- Simplified neuron model as a principal component analyzerJournal of Mathematical Biology, 1982