Linear classifiers in perceptron design
- 1 January 1996
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 4 (10514651) , 763-767 vol.4
- https://doi.org/10.1109/icpr.1996.547666
Abstract
It is shown adaptive training of the nonlinear single layer perceptron can lead to seven different statistical classifiers: (1) Euclidean distance classifier; (2) standard Fisher linear discriminant function; (3) Fisher linear discriminant function, with pseudoinverse of the covariance matrix; (4) regularised discriminant analysis; (5) generalised Fisher discriminant function; (6) minimum empirical error classifier; and (7) maximum margin classifier and to intermediate ones. Which particular type of the classifier will be obtained depends on: 1) initialisation interval and its relation to the training data; 2) an initial value of the learning step; and 3) its change during the iteration process, the stopping criteria.Keywords
This publication has 15 references indexed in Scilit:
- Mathematical aspects of optimal linear discriminant functionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Support-vector networksMachine Learning, 1995
- A training algorithm for optimal margin classifiersPublished by Association for Computing Machinery (ACM) ,1992
- Generalized Linear and Quadratic Discriminant Functions Using Robust EstimatesJournal of the American Statistical Association, 1978
- An Algorithm for the Optimal Solution of Linear Inequalities and its Application to Pattern RecognitionIEEE Transactions on Computers, 1973
- Iterative least squares development of discriminant functions for spectroscopic data analysis by pattern recognitionPattern Recognition, 1972
- An optimal algorithm for pattern classification†International Journal of Control, 1971
- Design of Pattern Classifiers with the Updating Property Using Stochastic Approximation TechniquesIEEE Transactions on Computers, 1968
- The estimation of the optimum linear decision function with a sequential random methodIEEE Transactions on Information Theory, 1966
- The use of an adaptive threshold element to design a linear optimal pattern classifierIEEE Transactions on Information Theory, 1966