RBF neural network center selection based on Fisher ratio class separability measure
- 7 November 2002
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 13 (5) , 1211-1217
- https://doi.org/10.1109/tnn.2002.1031953
Abstract
For classification applications, the role of hidden layer neurons of a radial basis function (RBF) neural network can be interpreted as a function which maps input patterns from a nonlinear separable space to a linear separable space. In the new space, the responses of the hidden layer neurons form new feature vectors. The discriminative power is then determined by RBF centers. In the present study, we propose to choose RBF centers based on Fisher ratio class separability measure with the objective of achieving maximum discriminative power. We implement this idea using a multistep procedure that combines Fisher ratio, an orthogonal transform, and a forward selection search method. Our motivation of employing the orthogonal transform is to decouple the correlations among the responses of the hidden layer neurons so that the class separability provided by individual RBF neurons can be evaluated independently. The strengths of our method are double fold. First, our method selects a parsimonious network architecture. Second, this method selects centers that provide large class separation.Keywords
This publication has 17 references indexed in Scilit:
- Selecting radial basis function network centers with recursive orthogonal least squares trainingIEEE Transactions on Neural Networks, 2000
- Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networksIEEE Transactions on Neural Networks, 1999
- An overview of statistical learning theoryIEEE Transactions on Neural Networks, 1999
- Conditional fuzzy clustering in the design of radial basis function neural networksIEEE Transactions on Neural Networks, 1998
- A nonlinear discriminant algorithm for feature extraction and data classificationIEEE Transactions on Neural Networks, 1998
- Comparing support vector machines with Gaussian kernels to radial basis function classifiersIEEE Transactions on Signal Processing, 1997
- Kernel orthonormalization in radial basis function neural networksIEEE Transactions on Neural Networks, 1997
- Algorithms for minimal model structure detection in nonlinear dynamic system identificationInternational Journal of Control, 1997
- On the efficiency of the orthogonal least squares training method for radial basis function networksIEEE Transactions on Neural Networks, 1996
- Fast Learning in Networks of Locally-Tuned Processing UnitsNeural Computation, 1989