Selecting radial basis function network centers with recursive orthogonal least squares training
- 1 March 2000
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 11 (2) , 306-314
- https://doi.org/10.1109/72.839002
Abstract
Recursive orthogonal least squares (ROLS) is a numerically robust method for solving for the output layer weights of a radial basis function (RBF) network, and requires less computer memory than the batch alternative. In the paper, the use of ROLS is extended to selecting the centers of an RBF network. It is shown that the information available in an ROLS algorithm after network training can be used to sequentially select centers to minimize the network output error. This provides efficient methods for network reduction to achieve smaller architectures with acceptable accuracy and without retraining. Two selection methods are developed, forward and backward. The methods are illustrated in applications of RBF networks to modeling a nonlinear time series and a real multiinput-multioutput chemical process. The final network models obtained achieve acceptable accuracy with significant reductions in the number of required centers.Keywords
This publication has 18 references indexed in Scilit:
- Sensor fault diagnosis in a chemical process via RBF neural networksControl Engineering Practice, 1999
- Givens rotation based fast backward elimination algorithm for RBF neural network pruningIEE Proceedings - Control Theory and Applications, 1997
- Dynamic structure neural networks for stable adaptive control of nonlinear systemsIEEE Transactions on Neural Networks, 1996
- An algorithm for RLS identification parameters that vary quickly with timeIEEE Transactions on Automatic Control, 1993
- Neural networks for nonlinear dynamic system modelling and identificationInternational Journal of Control, 1992
- Identification of non-linear processes using reciprocal multiquadric functionsJournal of Process Control, 1992
- Orthogonal least-squares algorithm for training multioutput radial basis function networksIEE Proceedings F Radar and Signal Processing, 1992
- Model selection and validation methods for non-linear systemsInternational Journal of Control, 1987
- Least Squares Computations by Givens Transformations Without Square RootsIMA Journal of Applied Mathematics, 1973
- Fitting autoregressive models for predictionAnnals of the Institute of Statistical Mathematics, 1969