A method for improving classification reliability of multilayer perceptrons
- 1 January 1995
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 6 (5) , 1140-1147
- https://doi.org/10.1109/72.410358
Abstract
Criteria for evaluating the classification reliability of a neural classifier and for accordingly making a reject option are proposed. Such an option, implemented by means of two rules which can be applied independently of topology, size, and training algorithms of the neural classifier, allows one to improve the classification reliability. It is assumed that a performance function P is defined which, taking into account the requirements of the particular application, evaluates the quality of the classification in terms of recognition, misclassification, and reject rates. Under this assumption the optimal reject threshold value, determining the best trade-off between reject rate and misclassification rate, is the one for which the function P reaches its absolute maximum. No constraints are imposed on the form of P, but the ones necessary in order that P actually measures the quality of the classification process. The reject threshold is evaluated on the basis of some statistical distributions characterizing the behavior of the classifier when operating without reject option; these distributions are computed once the training phase of the net has been completed. The method has been tested with a neural classifier devised for handprinted and multifont printed characters, by using a database of about 300000 samples. Experimental results are discussed.Keywords
This publication has 7 references indexed in Scilit:
- Fast training algorithms for multilayer neural netsIEEE Transactions on Neural Networks, 1991
- Back-propagation algorithm which varies the number of hidden unitsNeural Networks, 1991
- Pattern classification using neural networksIEEE Communications Magazine, 1989
- Convergence and limit points of neural network and its application to pattern recognitionIEEE Transactions on Systems, Man, and Cybernetics, 1989
- Learning representations by back-propagating errorsNature, 1986
- Neocognitron: A neural network model for a mechanism of visual pattern recognitionIEEE Transactions on Systems, Man, and Cybernetics, 1983
- On optimum recognition error and reject tradeoffIEEE Transactions on Information Theory, 1970