Replica-symmetric theory of nonlinear analogue neural networks
- 21 September 1990
- journal article
- Published by IOP Publishing in Journal of Physics A: General Physics
- Vol. 23 (18) , L1009-L1017
- https://doi.org/10.1088/0305-4470/23/18/012
Abstract
On the basis of the theory of the naive mean field model of spin glasses, analogue neural networks of the Hopfield type are investigated in the saturation limit. The saddle-point equations for the order parameters describing retrieval and spin glass phases of the networks are obtained by means of a statistical mechanical analysis within the framework of the replica-symmetric theory and are shown to undergo a modification to that of AGS theory, due to the absence of the Onsager reaction term in the TAP equation. Based on the equations, the memory storage capacity of the networks is analysed as a function of the analogue gain beta . A small increase in the critical storage capacity is found for finite values of beta , compared with that of the Ising model networks with corresponding inverse temperature, although the qualitative nature of the phase diagram is unchanged.Keywords
This publication has 10 references indexed in Scilit:
- Statistical mechanics of neural networks near saturationPublished by Elsevier ,2004
- Associative memory in an analog iterated-map neural networkPhysical Review A, 1990
- On the 'naive' mean-field equations for spin glassesJournal of Physics C: Solid State Physics, 1986
- Storing Infinite Numbers of Patterns in a Spin-Glass Model of Neural NetworksPhysical Review Letters, 1985
- Spin-glass models of neural networksPhysical Review A, 1985
- “Neural” computation of decisions in optimization problemsBiological Cybernetics, 1985
- Neurons with graded response have collective computational properties like those of two-state neurons.Proceedings of the National Academy of Sciences, 1984
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982
- Solution of 'Solvable model of a spin glass'Philosophical Magazine, 1977
- Theory of spin glassesJournal of Physics F: Metal Physics, 1975