Partial annealing and overfrustration in disordered systems
- 7 April 1994
- journal article
- Published by IOP Publishing in Journal of Physics A: General Physics
- Vol. 27 (7) , 2351-2365
- https://doi.org/10.1088/0305-4470/27/7/016
Abstract
We study disordered systems with the replica method keeping the number of replicas finite and negative. This is shown to bias the distribution of samples towards overfrustrated ones. General results on the thermodynamics of such a system is presented. The physical situation described by this finite-n approach is one where the usually quenched variables evolve on long timescales, their evolution being driven by the quasi-equilibrium correlations of the thermalized variables. In the case of neural networks this amounts to a coupled dynamics of neurons (on fast timescales) and synapses (on longer timescales). The storage capacity of the Hopfield model is shown to be substantially increased by these coupled dynamics.Keywords
This publication has 14 references indexed in Scilit:
- Statistical mechanics of neural networks near saturationPublished by Elsevier ,2004
- Coupled dynamics of fast spins and slow interactions in neural networks and spin systemsJournal of Physics A: General Physics, 1993
- Increasing the efficiency of a neural network through unlearningPhysica A: Statistical Mechanics and its Applications, 1990
- "Unlearning" increases the storage capacity of content addressable memoriesBiophysical Journal, 1987
- Parisi's mean-field solution for spin glasses as an analytic continuation in the replica numberJournal of Physics A: General Physics, 1983
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982
- A sequence of approximated solutions to the S-K model for spin glassesJournal of Physics A: General Physics, 1980
- Ising replica magnetsJournal of Physics A: General Physics, 1980
- Toward a mean field theory for spin glassesPhysics Letters A, 1979
- Solvable Model of a Spin-GlassPhysical Review Letters, 1975