Passage retrieval based on language models
Top Cited Papers
- 4 November 2002
- proceedings article
- Published by Association for Computing Machinery (ACM)
- p. 375-382
- https://doi.org/10.1145/584792.584854
Abstract
Previous research has shown that passage-level evidence can bring added benefits to document retrieval when documents are long or span different subject areas. Recent developments in language modeling approach to IR provided a new effective alternative to traditional retrieval models. These two streams of research motivate us to examine the use of passages in a language model framework. This paper reports on experiments using passages in a simple language model and a relevance model, and compares the results with document-based retrieval. Results from the INQUERY search engine, which is not based on a language modeling approach, are also given for comparison. Test data include two heterogeneous and one homogeneous document collections. Our experiments show that passage retrieval is feasible in the language modeling context, and more importantly, it can provide more reliable performance than retrieval based on full documents.Keywords
This publication has 21 references indexed in Scilit:
- Cross-lingual relevance modelsPublished by Association for Computing Machinery (ACM) ,2002
- Relevance based language modelsPublished by Association for Computing Machinery (ACM) ,2001
- Document language models, query models, and risk minimization for information retrievalPublished by Association for Computing Machinery (ACM) ,2001
- A general language model for information retrievalPublished by Association for Computing Machinery (ACM) ,1999
- A Linguistically Motivated Probabilistic Model of Information RetrievalPublished by Springer Nature ,1998
- Text segmentation by topicPublished by Springer Nature ,1997
- Automatic text decomposition and structuringInformation Processing & Management, 1996
- Efficient retrieval of partial documentsInformation Processing & Management, 1995
- Relevance feedback with too much dataPublished by Association for Computing Machinery (ACM) ,1995
- Passage-Level Evidence in Document RetrievalPublished by Springer Nature ,1994