Analysis and synthesis techniques for Hopfield type synchronous discrete time neural networks with application to associative memory
- 1 November 1990
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems
- Vol. 37 (11) , 1356-1366
- https://doi.org/10.1109/31.62410
Abstract
A qualitative theory for synchronous discrete time Hopfield-type neural networks is established. The authors' objectives are accomplished in two phases. First, they address the analysis of the class of neural networks considered. Next, making use of these results, they develop a synthesis procedure for the class of neural networks considered. In the analysis section, techniques from the theory of large-scale interconnected dynamical systems are used to derive tests for the asymptotic stability of an equilibrium of the neural network. Estimates for the rate at which the trajectories of the network will converge from an initial condition to a final state are presented. In the synthesis section the stability tests from the analysis section are used as constraints to develop a design algorithm for associative memories. The algorithm presented guarantees that each desired memory will be stored as an equilibrium, and that each desired memory will be asymptotically stable. The applicability of these results is demonstrated by means of two specific examples.<>Keywords
This publication has 17 references indexed in Scilit:
- A synthesis procedure for Hopfield's continuous-time associative memoryIEEE Transactions on Circuits and Systems, 1990
- Analysis and synthesis of a class of neural networks: variable structure systems with infinite grainIEEE Transactions on Circuits and Systems, 1989
- Qualitative analysis and synthesis of a class of neural networksIEEE Transactions on Circuits and Systems, 1988
- The capacity of the Hopfield associative memoryIEEE Transactions on Information Theory, 1987
- Dynamics of microfabricated electronic neural networksApplied Physics Letters, 1987
- Collective computational properties of neural networks: New learning mechanismsPhysical Review A, 1986
- Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuitIEEE Transactions on Circuits and Systems, 1986
- Information storage and retrieval in spin-glass like neural networksJournal de Physique Lettres, 1985
- Neurons with graded response have collective computational properties like those of two-state neurons.Proceedings of the National Academy of Sciences, 1984
- A theory for the acquisition and loss of neuron specificity in visual cortexBiological Cybernetics, 1979