An adaptive nonparametric linear classifier
- 1 January 1976
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Proceedings of the IEEE
- Vol. 64 (8) , 1162-1171
- https://doi.org/10.1109/proc.1976.10287
Abstract
The equalized-error ("EE") training procedure, introduced in this paper, is a new nonparametric training procedure for linear classifiers in a multiple-feautre stochastic environment. This procedure is a form of stochastic approximation that minimizes the sum of the expected normalized first moments of the fasely classified pattern vectors about the decision hyperplane. This sum is the "EE loss function." The minimization is achived by a simply implemented recursive equation. We show that the sequence of decision hyperplanes generated by this recursive equation converges in mean square and with probability one to a hyperplane that minimizes the EE loss function. We provide premiliminary qualitative and quantitative evidence that the EE training procedure converges rapidly and achives low asymptotic error probabilities over a wide range of overlapping pairs of class densities and nonlinearly separable pairs of class densities.Keywords
This publication has 10 references indexed in Scilit:
- A stopping rule for threshold learningInternational Journal of Systems Science, 1973
- A Continuous Two-Dimensional Model of Threshold LearningIEEE Transactions on Systems, Man, and Cybernetics, 1973
- Training a One-Dimensional Classifier to Minimize the Probability of ErrorIEEE Transactions on Systems, Man, and Cybernetics, 1972
- Stability of threshold learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1971
- An Algorithm for Linear Inequalities and its ApplicationsIEEE Transactions on Electronic Computers, 1965
- Threshold training of two-mode signal detectionIEEE Transactions on Information Theory, 1965
- Effects of Adaptation Parameters on Convergence Time and Tolerance for Adaptive Threshold ElementsIEEE Transactions on Electronic Computers, 1964
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958
- The Relaxation Method for Linear InequalitiesCanadian Journal of Mathematics, 1954
- The Relaxation Method for Linear InequalitiesCanadian Journal of Mathematics, 1954