Zero temperature parallel dynamics for infinite range spin glasses and neural networks
- 1 January 1987
- journal article
- Published by EDP Sciences in Journal de Physique
- Vol. 48 (5) , 741-755
- https://doi.org/10.1051/jphys:01987004805074100
Abstract
We present the results of analytical and numerical calculations for the zero temperature parallel dynamics of spin glass and neural network models. We use an analytical approach to calculate the magnetization and the overlaps after a few time steps. For the long time behaviour, the analytical approach becomes too complicated and we use numerical simulations. For the Sherrington-Kirkpatrick model, we measure the remanent magnetization and the overlaps at different times and we observe power law decays towards the infinite time limit. When one iterates two configurations in parallel, their distance d(∞) in the limit of infinite time depends on their initial distance d(0). Our numerical results suggest that d(∞) has a finite limit when d(0) → 0. This result can be regarded as a collective effect between an infinite number of spins. For the Little-Hopfield model, we compute the time evolution of the overlap with a stored pattern. We find regimes for which the system learns better after a few time steps than in the infinite time limitKeywords
This publication has 10 references indexed in Scilit:
- Random Networks of Automata: A Simple Annealed ApproximationEurophysics Letters, 1986
- Metastable states of a spin glass chain at 0 temperatureJournal de Physique, 1986
- Spin-glass models of neural networksPhysical Review A, 1985
- Scaling laws for the attractors of Hopfield networksJournal de Physique Lettres, 1985
- Collective properties of neural networks: A statistical physics approachBiological Cybernetics, 1984
- Optimization by Simulated AnnealingScience, 1983
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982
- Dynamic Theory of the Spin-Glass PhasePhysical Review Letters, 1981
- The ground state of a spin glassJournal of Physics F: Metal Physics, 1980
- The existence of persistent states in the brainMathematical Biosciences, 1974