A k-nearest neighbor classification rule based on Dempster-Shafer theory
- 1 May 1995
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics
- Vol. 25 (5) , 804-813
- https://doi.org/10.1109/21.376493
Abstract
In this paper, the problem of classifying an unseen pattern on the basis of its nearest neighbors in a recorded data set is addressed from the point of view of Dempster-Shafer theory. Each neighbor of a sample to be classified is considered as an item of evidence that supports certain hypotheses regarding the class membership of that pattern. The degree of support is defined as a function of the distance between the two vectors. The evidence of the k nearest neighbors is then pooled by means of Dempster's rule of combination. This approach provides a global treatment of such issues as ambiguity and distance rejection, and imperfect knowledge regarding the class membership of training patterns. The effectiveness of this classification scheme as compared to the voting and distance-weighted k-NN procedures is demonstrated using several sets of simulated and real-world data.< >Keywords
This publication has 15 references indexed in Scilit:
- Approximations for efficient computation in the theory of evidenceArtificial Intelligence, 1993
- A statistical decision rule with incomplete knowledge about classesPattern Recognition, 1993
- Decision making with imprecise probabilities: Dempster‐Shafer Theory and applicationWater Resources Research, 1992
- [Probabilistic Expert Systems in Medicine: Practical Issues in Handling Uncertainty]: CommentStatistical Science, 1987
- A fuzzy K-nearest neighbor algorithmIEEE Transactions on Systems, Man, and Cybernetics, 1985
- A learning scheme for a fuzzy k-NN rulePattern Recognition Letters, 1983
- The Distance-Weighted k-Nearest-Neighbor RuleIEEE Transactions on Systems, Man, and Cybernetics, 1976
- The Nearest Neighbor Classification Rule with a Reject OptionIEEE Transactions on Systems Science and Cybernetics, 1970
- On optimum recognition error and reject tradeoffIEEE Transactions on Information Theory, 1970
- Nearest neighbor pattern classificationIEEE Transactions on Information Theory, 1967