Integrated feature architecture selection
- 1 July 1996
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 7 (4) , 1007-1014
- https://doi.org/10.1109/72.508942
Abstract
In this paper, we present an integrated approach to feature and architecture selection for single hidden layer-feedforward neural networks trained via backpropagation. In our approach, we adopt a statistical model building perspective in which we analyze neural networks within a nonlinear regression framework. The algorithm presented in this paper employs a likelihood-ratio test statistic as a model selection criterion. This criterion is used in a sequential procedure aimed at selecting the best neural network given an initial architecture as determined by heuristic rules. Application results for an object recognition problem demonstrate the selection algorithm's effectiveness in identifying reduced neural networks with equivalent prediction accuracy.Keywords
This publication has 22 references indexed in Scilit:
- Improved feature screening in feedforward neural networksNeurocomputing, 1996
- Feedforward nets for interpolation and classificationJournal of Computer and System Sciences, 1992
- Back-propagation algorithm which varies the number of hidden unitsNeural Networks, 1991
- Learning in Artificial Neural Networks: A Statistical PerspectiveNeural Computation, 1989
- Theory of the backpropagation neural networkPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Multilayer feedforward networks are universal approximatorsNeural Networks, 1989
- An additional hidden unit test for neglected nonlinearity in multilayer feedforward networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Estimating hidden unit number for two-layer perceptronsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Nonlinear Statistical ModelsWiley Series in Probability and Statistics, 1987
- On the Uniform Convergence of Relative Frequencies of Events to Their ProbabilitiesTheory of Probability and Its Applications, 1971