Stability of the replica-symmetric solution for the information conveyed by a neural network
- 1 March 1998
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 57 (3) , 3302-3310
- https://doi.org/10.1103/physreve.57.3302
Abstract
The information that a pattern of firing in the output layer of a feedforward network of threshold-linear neurons conveys about the network’s inputs is considered. A replica-symmetric solution is found to be stable for all but small amounts of noise. The region of instability depends on the contribution of the threshold and the sparseness: for distributed pattern distributions, the unstable region extends to higher noise variances than for very sparse distributions, for which it is almost nonexistent.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Statistical mechanics of neural networks near saturationPublished by Elsevier ,2004
- Quantitative estimate of the information relayed by the Schaffer collateralsJournal of Computational Neuroscience, 1995
- Duality Between Learning Machines: A Bridge Between Supervised and Unsupervised LearningNeural Computation, 1994
- Are spin-glass effects relevant to understanding realistic auto-associative networks?Journal of Physics A: General Physics, 1991
- Threshold-linear formal neurons in auto-associative netsJournal of Physics A: General Physics, 1990
- Understanding the Efficiency of Human PerceptionPhysical Review Letters, 1988
- Optimal storage properties of neural network modelsJournal of Physics A: General Physics, 1988
- The space of interactions in neural network modelsJournal of Physics A: General Physics, 1988
- Stability of the Sherrington-Kirkpatrick solution of a spin glass modelJournal of Physics A: General Physics, 1978
- Solvable Model of a Spin-GlassPhysical Review Letters, 1975