A digital multilayer neural network with limited binary expressions
Open Access
- 1 January 1990
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 587-592 vol.2
- https://doi.org/10.1109/ijcnn.1990.137769
Abstract
A design methodology is presented for digital multilayer neural networks with limited binary expressions. An error back-propagation algorithm is modified as follows: the number of binary bits used for connections and unit outputs are decreased step by step in the training process. In order to express unit outputs with two-level values, the differential of the logistic function is replaced by a small positive constant used in weight change equations. After the training is completed, binary expressions for connections and unit outputs can be reduced to several-bit and two-level values, respectively. Therefore, no multipliers or nonlinear functions are required in the resulting network, which will be used for pattern recognition. Furthermore, memory capacity and adder circuit hardware can be reduced. The network performance is also insensitive to noisy patternsKeywords
This publication has 4 references indexed in Scilit:
- A digital neuro-chip with unlimited connectability for large scale neural networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Fully digital neural network implementation based on pulse density modulationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Parallel Distributed ProcessingPublished by MIT Press ,1986
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences, 1982