A parallel Kalman algorithm for fast learning of multilayer neural networks
- 1 January 1991
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2044-2049 vol.3
- https://doi.org/10.1109/ijcnn.1991.170644
Abstract
A fast learning algorithm is proposed for training of multilayer feedforward neural networks, based on a combination of optimal linear Kalman filtering theory and error propagation. In this algorithm, all the information available from the start of the training process to the current training sample is exploited in the update procedure for the weight vector of each neuron in the network in an efficient parallel recursive method. This innovation is a massively parallel implementation and has better convergence properties than the conventional backpropagation learning technique. Its performance is illustrated on some examples, such as a XOR logical operation and a nonlinear mapping of two continuous signals.Keywords
This publication has 8 references indexed in Scilit:
- Training feed-forward networks with the extended Kalman algorithmPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Analysis of a perceptron learning algorithm with momentum updatingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- MEKA-a fast, local algorithm for training feedforward neural networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1990
- An adaptive least squares algorithm for the efficient training of artificial neural networksIEEE Transactions on Circuits and Systems, 1989
- Fast learning in artificial neural systems: multilayer perceptron training using optimal estimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1988
- Application of Fast Kalman Estimation to Adaptive EqualizationIEEE Transactions on Communications, 1978
- Channel Equalization Using a Kalman Filter for Fast Data TransmissionIBM Journal of Research and Development, 1974
- A New Approach to Linear Filtering and Prediction ProblemsJournal of Basic Engineering, 1960