An analog feedback associative memory
- 1 January 1993
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 4 (1) , 117-126
- https://doi.org/10.1109/72.182701
Abstract
A method for the storage of analog vectors, i.e., vectors whose components are real-valued, is developed for the Hopfield continuous-time network. An important requirement is that each memory vector has to be an asymptotically stable (i.e. attractive) equilibrium of the network. Some of the limitations imposed by the continuous Hopfield model on the set of vectors that can be stored are pointed out. These limitations can be relieved by choosing a network containing visible as well as hidden units. An architecture consisting of several hidden layers and a visible layer, connected in a circular fashion, is considered. It is proved that the two-layer case is guaranteed to store any number of given analog vectors provided their number does not exceed 1 + the number of neurons in the hidden layer. A learning algorithm that correctly adjusts the locations of the equilibria and guarantees their asymptotic stability is developed. Simulation results confirm the effectiveness of the approach.Keywords
This publication has 20 references indexed in Scilit:
- A synthesis procedure for Hopfield's continuous-time associative memoryIEEE Transactions on Circuits and Systems, 1990
- Linear and logarithmic capacities in associative neural networksIEEE Transactions on Information Theory, 1989
- Qualitative analysis of neural networksIEEE Transactions on Circuits and Systems, 1989
- OSCILLATIONS AND SYNCHRONIZATIONS IN NEURAL NETWORKS: AN EXPLORATION OF THE LABELING HYPOTHESISInternational Journal of Neural Systems, 1989
- Dynamics and architecture for neural computationJournal of Complexity, 1988
- Qualitative analysis and synthesis of a class of neural networksIEEE Transactions on Circuits and Systems, 1988
- A study on neural networksInternational Journal of Intelligent Systems, 1988
- On the stability, storage capacity, and design of nonlinear continuous neural networksIEEE Transactions on Systems, Man, and Cybernetics, 1988
- Bidirectional associative memoriesIEEE Transactions on Systems, Man, and Cybernetics, 1988
- Information storage and retrieval in spin-glass like neural networksJournal de Physique Lettres, 1985