An iterative growing and pruning algorithm for classification tree design
- 1 January 1991
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 13 (2) , 163-174
- https://doi.org/10.1109/34.67645
Abstract
A critical issue in classification tree design is obtaining right-sized trees, i.e., trees which neither underfit nor overfit the data. Instead of using stopping rules to halt partitioning, we follow the approach of growing a large tree with pure terminal nodes and selectively pruning it back. A new efficient iterative method is proposed to grow and prune classification trees. This method divides the data sample into two subsets and iteratively grows a tree with one subset and prunes it with the other subset, successively interchanging the roles of the two subsets. The convergence and other properties of the algorithm are established. Theoretical and practical considerations suggest that the iterative tree growing and pruning algorithm should perform better and require less computation than other widely used tree growing and pruning algorithms. Numerical results on a waveform recognition problem are presented to support this view.Keywords
This publication has 26 references indexed in Scilit:
- Decision tree design from a communication theory standpointIEEE Transactions on Information Theory, 1988
- Analysis and Design of a Decision Tree Based on Entropy Reduction and Its Application to Large Character Set RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1984
- Binary tree versus single level tree classification of white blood cellsPattern Recognition, 1983
- Decision rules for a hierarchical classifierPattern Recognition Letters, 1983
- The optimal strategy of a tree classifierPattern Recognition, 1983
- Automatic classification of cervical cells using a binary tree classifierPattern Recognition, 1983
- Application of a Multilayer Decision Tree in Computer Recognition of Chinese CharactersPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1983
- On the Mean Accuracy of Hierarchical ClassifiersIEEE Transactions on Computers, 1978
- The decision tree classifier: Design and potentialIEEE Transactions on Geoscience Electronics, 1977
- A Nonparametric Partitioning Procedure for Pattern ClassificationIEEE Transactions on Computers, 1969