Dynamic Programming as Applied to Feature Subset Selection in a Pattern Recognition System
- 1 March 1973
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics
- Vol. SMC-3 (2) , 166-171
- https://doi.org/10.1109/tsmc.1973.5408499
Abstract
This paper proposes dynamic programming search procedures to expedite the feature subset selection processes in a pattern recognition system. It is shown that in general the proposed procedures require much fewer subsets to be evaluated than the exhaustive search procedure. For example, a problem of selecting the best subset of 4 features from a set of 24 features requires an evaluation of (24/4) = 10626 subsets by using the exhaustive search procedure; on the other hand, it requires only 175 and 136 subsets to be considered by employing the proposed Procedures I and II, respectively, to solve the same problem. While the number of subsets to be evaluated for the dynamic programming search procedures is slightly greater than that for the without-replacement search procedure, the best feature subset selected by the proposed methods may, however, not necessarily contain all of the best single features selected in the previous stages.Keywords
This publication has 6 references indexed in Scilit:
- A Direct Method of Nonparametric Measurement SelectionIEEE Transactions on Computers, 1971
- A Comparison of Seven Techniques for Choosing Subsets of Pattern Recognition PropertiesIEEE Transactions on Computers, 1971
- Feature Selection in Pattern RecognitionIEEE Transactions on Systems Science and Cybernetics, 1970
- A Dynamic Programming Approach to the Selection of Pattern FeaturesIEEE Transactions on Systems Science and Cybernetics, 1968
- A Dynamic Programming Approach to Sequential Pattern RecognitionIEEE Transactions on Electronic Computers, 1967
- On the effectiveness of receptors in recognition systemsIEEE Transactions on Information Theory, 1963