On setting unit thresholds in an incompletely connected associative net
- 1 November 1993
- journal article
- Published by Taylor & Francis in Network: Computation in Neural Systems
- Vol. 4 (4) , 441-459
- https://doi.org/10.1088/0954-898x/4/4/003
Abstract
The associative net is a matrix model of associative memory which has an efficiency of recall approaching that of a random access memory with no associative capability. This is a fully connected network, which makes it possible to use a simple strategy for setting the thresholds of the units in recall. However, most brain structures that are thought to underlie learning and memory have only partial interconnectivity. We describe five different strategies for setting the thresholds of units in partially connected nets. The simplest is a mechanism of the winners-take-all type. The most sophisticated strategy employs information about the density of modified synapses and their distribution on each output unit. The action of this mechanism is shown to be equivalent to minimization of output error but without requiring numerical solution of a set of equations, which would be biologically implausible. Simulation results demonstrate the superiority of this mechanism in a typical case. Parameter sensitivity analysis of this mechanism shows its robustness and that performance improves as connectivity becomes more complete.Keywords
This publication has 7 references indexed in Scilit:
- Hippocampal synaptic enhancement and information storage within a distributed memory systemPublished by Elsevier ,2003
- Performance characteristics of the associative netNetwork: Computation in Neural Systems, 1992
- An assessment of Marr’s theory of the hippocampus as a temporary memory storePhilosophical Transactions Of The Royal Society B-Biological Sciences, 1990
- Information storage in sparsely coded memory netsNetwork: Computation in Neural Systems, 1990
- On associative memoryBiological Cybernetics, 1980
- Simple memory: a theory for archicortexPhilosophical Transactions of the Royal Society of London. B, Biological Sciences, 1971
- Non-Holographic Associative MemoryNature, 1969