Properties of neural networks storing spatially correlated patterns
- 7 July 1992
- journal article
- research article
- Published by IOP Publishing in Journal of Physics A: General Physics
- Vol. 25 (13) , 3701-3720
- https://doi.org/10.1088/0305-4470/25/13/019
Abstract
The author studies the behaviour of a feedforward neural network supplied with spatially organized data. This inner structure is taken into account by a matrix Cij, whose coefficients equal the average correlation between two pixels i and j of the input patterns. The storage capacity alpha is computed as a function of the required stability and of the eigenvalues of C. The author proposes a geometrical transformation allowing an intuitive interpretation of these results. Numerical simulations using real and binary patterns show a very good agreement with the theory. Finally, the author analyses the synaptic couplings correlations resulting from the training of the network with structured patterns. Focusing on exponentially decreasing correlations one and two dimensions, the author finds that they exhibit a 'Mexican hat' profile, the excitatory centre size of which depends on alpha .This publication has 23 references indexed in Scilit:
- On the capacity of neural networks with binary weightsJournal of Physics A: General Physics, 1992
- Storage capacity of a Potts-perceptronJournal de Physique I, 1991
- Storage Capacity of a Multilayer Neural Network with Binary WeightsEurophysics Letters, 1991
- Statistical mechanics of a multilayered neural networkPhysical Review Letters, 1990
- Capacity of neural networks with discrete synaptic couplingsJournal of Physics A: General Physics, 1990
- Storage capacity of memory networks with binary couplingsJournal de Physique, 1989
- Potts-glass models of neural networksPhysical Review A, 1988
- Self-organization in a perceptual networkComputer, 1988
- Optimal storage properties of neural network modelsJournal of Physics A: General Physics, 1988
- The space of interactions in neural network modelsJournal of Physics A: General Physics, 1988