The maximum entropy approach and probabilistic IR models
- 1 July 2000
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 18 (3) , 246-287
- https://doi.org/10.1145/352595.352597
Abstract
This paper takes a fresh look at modeling approaches to information retrieval that have been the basis of much of the probabilistically motivated IR research over the last 20 years. We shall adopt a subjectivist Bayesian view of probabilities and argue that classical work on probabilistic retrieval is best understood from this perspective. The main focus of the paper will be the ranking formulas corresponding to the Binary Independence Model (BIM), presented originally by Roberston and Sparck Jones [1977] and the Combination Match Model (CMM), developed shortly thereafter by Croft and Harper [1979]. We will show how these same ranking formulas can result from a probabilistic methodology commonly known as Maximum Entropy (MAXENT).Keywords
This publication has 20 references indexed in Scilit:
- Inducing features of random fieldsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1997
- The Retrieval Effects of Query Expansion on a Feedback Document Retrieval SystemThe Computer Journal, 1983
- Exploiting the maximum entropy principle to increase retrieval effectivenessJournal of the American Society for Information Science, 1983
- USING PROBABILISTIC MODELS OF DOCUMENT RETRIEVAL WITHOUT RELEVANCE INFORMATIONJournal of Documentation, 1979
- Image reconstruction from incomplete and noisy dataNature, 1978
- AN EVALUATION OF FEEDBACK IN DOCUMENT RETRIEVAL USING CO‐OCCURRENCE DATAJournal of Documentation, 1978
- THE PROBABILITY RANKING PRINCIPLE IN IRJournal of Documentation, 1977
- A THEORETICAL BASIS FOR THE USE OF CO‐OCCURRENCE DATA IN INFORMATION RETRIEVALJournal of Documentation, 1977
- Generalized Iterative Scaling for Log-Linear ModelsThe Annals of Mathematical Statistics, 1972
- A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVALJournal of Documentation, 1972