Design of Pattern Classifiers with the Updating Property Using Stochastic Approximation Techniques
- 1 September 1968
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. C-17 (9) , 861-872
- https://doi.org/10.1109/tc.1968.229146
Abstract
—A nonparametric training procedure for finding the optimal weights of the discriminant functions of a pattern classifier in any optimization criterion, expressible as a convex function from an arbitrary sequence of sample patterns, is proposed. This design procedure is based on the stochastic approximation technique, and has the updating property because it processes the sample patterns whenever they become available. This procedure is used to find the optimal weights for the least-mean-square error criterion, and is shown to require very simple computation which leads to simple implementation. Both two-category and multi-category cases are considered, and an acceleration scheme to increase the rate of convergence for the training procedure is also presented. These results are demonstrated by examples.Keywords
This publication has 26 references indexed in Scilit:
- On Bayesian Learning and Stochastic ApproximationIEEE Transactions on Systems Science and Cybernetics, 1967
- Pattern Classification by Iteratively Determined Linear and Piecewise Linear Discriminant FunctionsIEEE Transactions on Electronic Computers, 1966
- Recovery of functions from noisy measurements taken at randomly selected points and its application to pattern classificationProceedings of the IEEE, 1966
- On Stochastic ApproximationTheory of Probability and Its Applications, 1965
- A geometric test-synthesis procedure for a threshold deviceInformation and Control, 1963
- Multidimensional Stochastic Approximation MethodsThe Annals of Mathematical Statistics, 1954
- On a Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1954
- Approximation Methods which Converge with Probability oneThe Annals of Mathematical Statistics, 1954
- Stochastic Estimation of the Maximum of a Regression FunctionThe Annals of Mathematical Statistics, 1952
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951