Neural networks with dynamical thresholds
- 1 July 1989
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review A
- Vol. 40 (2) , 1036-1044
- https://doi.org/10.1103/physreva.40.1036
Abstract
We incorporate local threshold functions into the dynamics of the Hopfield model. These functions depend on the history of the individual spin (= neuron). They reach a maximal height if the spin remains constant. The resulting one-pattern model has ferromagnetic, paramagnetic, and periodic phases. This model is solved by a master equation and approximated by simplified systems of equations that are substantiated by numerical simulations. When several patterns are included as memories in the model, it exhibits transitions—as well as oscillations—between them. The latter can be excluded by known methods. By introducing threshold functions which affect only spins which remain positive, thus mimicking fatigue of the individual neurons, one can obtain open-ended movement in pattern space. Using couplings which form pointers from one pattern to another, our system leads to self-driven temporal sequences of patterns, resembling the process of associative thinking.Keywords
This publication has 12 references indexed in Scilit:
- Processing of Temporal Sequences in Neural NetworksPhysical Review Letters, 1988
- Neural networks counting chimes.Proceedings of the National Academy of Sciences, 1988
- Noise-Driven Temporal Association in Neural NetworksEurophysics Letters, 1987
- An Exactly Solvable Asymmetric Neural Network ModelEurophysics Letters, 1987
- Temporal Association in Asymmetric Neural NetworksPhysical Review Letters, 1986
- Sequential state generation by model neural networks.Proceedings of the National Academy of Sciences, 1986
- Storing Infinite Numbers of Patterns in a Spin-Glass Model of Neural NetworksPhysical Review Letters, 1985
- Spin-glass models of neural networksPhysical Review A, 1985
- Neurons with graded response have collective computational properties like those of two-state neurons.Proceedings of the National Academy of Sciences, 1984
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982