Functional abilities of a stochastic logic neural network
- 1 May 1992
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 3 (3) , 434-443
- https://doi.org/10.1109/72.129416
Abstract
The authors have studied the information processing ability of stochastic logic neural networks, which constitute one of the pulse-coded artificial neural network families. These networks realize pseudoanalog performance with local learning rules using digital circuits, and therefore suit silicon technology. The synaptic weights and the outputs of neurons in stochastic logic are represented by stochastic pulse sequences. The limited range of the synaptic weights reduces the coding noise and suppresses the degradation of memory storage capacity. To study the effect of the coding noise on an optimization problem, the authors simulate a probabilistic Hopfield model (Gaussian machine) which has a continuous neuron output function and probabilistic behavior. A proper choice of the coding noise amplitude and scheduling improves the network's solutions of the traveling salesman problem (TSP). These results suggest that stochastic logic may be useful for implementing probabilistic dynamics as well as deterministic dynamics.Keywords
This publication has 13 references indexed in Scilit:
- Global search of adaptive IIR filter error surfaces using stochastic learning automataPublished by SPIE-Intl Soc Optical Eng ,1990
- DNNA: A Digital Neural Network ArchitecturePublished by Springer Nature ,1990
- Pulse-density modulation technique in VLSI implementations of neural network algorithmsIEEE Journal of Solid-State Circuits, 1990
- A digital architecture employing stochasticism for the simulation of Hopfield neural netsIEEE Transactions on Circuits and Systems, 1989
- On a simple stochastic neuron — Like unitBiological Cybernetics, 1988
- Statistical neurodynamics of associative memoryNeural Networks, 1988
- Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuitIEEE Transactions on Circuits and Systems, 1986
- VLSI implementation of a neural network memory with several hundreds of neuronsAIP Conference Proceedings, 1986
- “Neural” computation of decisions in optimization problemsBiological Cybernetics, 1985
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of ImagesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1984