Storage and retrieval of complex sequences in neural networks
- 1 December 1988
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review A
- Vol. 38 (12) , 6365-6372
- https://doi.org/10.1103/physreva.38.6365
Abstract
The storage and retrieval of complex sequences, with bifurcation points, for instance, in fully connected networks of formal neurons, is investigated. We present a model which involves the transmission of informations undergoing various delays from all neurons to one neuron, through synaptic connections, possibly of high order. Assuming parallel dynamics, an exact solution is proposed; it allows one to store without errors a number of elementary transitions which are of the order of the number of synaptic connections related to one neuron. A fast-learning algorithm, requiring a single presentation of the prototype sequences, is derived; it guarantees the exact storage of the transitions. It is shown that local learning procedures with repeated presentations, used for pattern storage, can be generalized to sequence storage.Keywords
This publication has 13 references indexed in Scilit:
- Neural networks counting chimes.Proceedings of the National Academy of Sciences, 1988
- Noise-Driven Temporal Association in Neural NetworksEurophysics Letters, 1987
- Learning algorithms with optimal stability in neural networksJournal of Physics A: General Physics, 1987
- Neural networks that learn temporal sequences by selection.Proceedings of the National Academy of Sciences, 1987
- Neural computation by concentrating information in time.Proceedings of the National Academy of Sciences, 1987
- Learning of correlated patterns in spin-glass networks by local learning rulesPhysical Review Letters, 1987
- Temporal Association in Asymmetric Neural NetworksPhysical Review Letters, 1986
- Sequential state generation by model neural networks.Proceedings of the National Academy of Sciences, 1986
- Collective computational properties of neural networks: New learning mechanismsPhysical Review A, 1986
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982