Analysis and verification of an analog VLSI incremental outer-product learning system
- 1 May 1992
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 3 (3) , 488-497
- https://doi.org/10.1109/72.129421
Abstract
An architecture is described for the microelectronic implementation of arbitrary outer-product learning rules in analog floating-gate CMOS matrix-vector multiplier networks. The weights are stored permanently on floating gates and are updated under uniform UV illumination with a general incremental analog four-quadrant outer-product learning scheme, performed locally on-chip by a single transistor per matrix element on average. From the mechanism of floating gate relaxation under UV radiation, the authors derive the learning parameters and their dependence on the illumination level and circuit parameters. It is shown that the weight increments consists of two parts: one term contains the outer product of two externally applied learning vectors; the other part represents a uniform weight decay, with time constant originating from the floating gate relaxation. The authors address the implementation of supervised and unsupervised learning algorithms with emphasis on the delta rule. Experimental results from a simple implementation of the delta rule on an 8x7 linear network are included.Keywords
This publication has 12 references indexed in Scilit:
- An adaptive CMOS matrix-vector multiplier for large scale analog hardware neural network applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Analog floating-gate synapses for general-purpose VLSI neural computationIEEE Transactions on Circuits and Systems, 1991
- Implementation of a learning Kohonen neuron based on a new multilevel storage techniqueIEEE Journal of Solid-State Circuits, 1991
- Analog Storage of Adjustable Synaptic WeightsPublished by Springer Nature ,1991
- Programmable analog vector-matrix multipliersIEEE Journal of Solid-State Circuits, 1990
- Analog electronic neural network circuitsIEEE Circuits and Devices Magazine, 1989
- A programmable analog neural network chipIEEE Journal of Solid-State Circuits, 1989
- Adaptive RetinaPublished by Springer Nature ,1989
- Analogue circuits for variable-synapse electronic neural networksElectronics Letters, 1987
- An Adaptive Associative Memory PrincipleIEEE Transactions on Computers, 1974