Exploiting hierarchical domain structure to compute similarity
Top Cited Papers
- 1 January 2003
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 21 (1) , 64-93
- https://doi.org/10.1145/635484.635487
Abstract
The notion of similarity between objects finds use in many contexts, for example, in search engines, collaborative filtering, and clustering. Objects being compared often are modeled as sets, with their similarity traditionally determined based on set intersection. Intersection-based measures do not accurately capture similarity in certain domains, such as when the data is sparse or when there are known relationships between items within sets. We propose new measures that exploit a hierarchical domain structure in order to produce more intuitive similarity scores. We extend our similarity measures to provide appropriate results in the presence of multisets (also handled unsatisfactorily by traditional measures), for example, to correctly compute the similarity between customers who buy several instances of the same product (say milk), or who buy several products in the same category (say dairy products). We also provide an experimental comparison of our measures against traditional similarity measures, and report on a user study that evaluated how well our measures match human intuition.Keywords
This publication has 7 references indexed in Scilit:
- INFORMATION RETRIEVAL BASED ON CONCEPTUAL DISTANCE IN IS‐A HIERARCHIESJournal of Documentation, 1993
- Using collaborative filtering to weave an information tapestryCommunications of the ACM, 1992
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- A MODEL OF KNOWLEDGE BASED INFORMATION RETRIEVAL WITH HIERARCHICAL CONCEPT GRAPHJournal of Documentation, 1990
- Development and application of a metric on semantic netsIEEE Transactions on Systems, Man, and Cybernetics, 1989
- Term-weighting approaches in automatic text retrievalInformation Processing & Management, 1988
- Order Invariant Methods for Data AnalysisJournal of the Royal Statistical Society Series B: Statistical Methodology, 1972