A performance comparison of trained multilayer perceptrons and trained classification trees
- 13 January 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Multilayer perceptrons and trained classification trees are two very different techniques which have recently become popular. Giving enough data and time, both methods are capable of performing arbitrary nonlinear classification. The two techniques have not previously been compared on real-world problems. The authors first consider the important differences between multilayer perceptrons and classification trees and conclude that there is not enough theoretical basis for the clear-cut superiority of one technique over the other. They then present results of a number of empirical tests on quite different problems in power system load forecasting and speaker-independent vowel identification. They compare the performance for classification and prediction in terms of accuracy outside the training set. In all cases, even with various sizes of training sets, the multilayer perceptron performed as well as or better than the trained classification trees. The authors are confident that the univariate version of the trained classification trees do not perform as well as the multilayer perceptron. More studies are needed, however, on the comparative performance of the linear combination version of the classification trees.Keywords
This publication has 10 references indexed in Scilit:
- Speaker-independent vowel recognition: comparison of backpropagation and trained classification treesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Electric load forecasting using an artificial neural networkIEEE Transactions on Power Systems, 1991
- Image processing for image understanding with neural netsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1989
- Projection Pursuit Density EstimationJournal of the American Statistical Association, 1984
- On-Line Algorithms for Forecasting Hourly Loads of an Electric UtilityIEEE Transactions on Power Apparatus and Systems, 1981
- A Partitioning Algorithm with Application in Pattern Classification and the Optimization of Decision TreesIEEE Transactions on Computers, 1973
- Adaptive Short-Term Forecasting of Hourly Loads Using Weather InformationIEEE Transactions on Power Apparatus and Systems, 1972
- Short-Term Load Forecasting Using General Exponential SmoothingIEEE Transactions on Power Apparatus and Systems, 1971
- Control Methods Used in a Study of the VowelsThe Journal of the Acoustical Society of America, 1952
- A logical calculus of the ideas immanent in nervous activityBulletin of Mathematical Biology, 1943