FRank
Top Cited Papers
- 23 July 2007
- proceedings article
- Published by Association for Computing Machinery (ACM)
- p. 383-390
- https://doi.org/10.1145/1277741.1277808
Abstract
Ranking problem is becoming important in many fields, especially in information retrieval (IR). Many machine learning techniques have been proposed for ranking problem, such as RankSVM, RankBoost, and RankNet. Among them, RankNet, which is based on a probabilistic ranking framework, is leading to promising results and has been applied to a commercial Web search engine. In this paper we conduct further study on the probabilistic ranking framework and provide a novel loss function named fidelity loss for measuring loss of ranking. The fidelity loss notonly inherits effective properties of the probabilistic ranking framework in RankNet, but possesses new properties that are helpful for ranking. This includes the fidelity loss obtaining zero for each document pair, and having a finite upper bound that is necessary for conducting query-level normalization. We also propose an algorithm named FRank based on a generalized additive model for the sake of minimizing the fedelity loss and learning an effective ranking function. We evaluated the proposed algorithm for two datasets: TREC dataset and real Web search dataset. The experimental results show that the proposed FRank algorithm outperforms other learning-based ranking methods on both conventional IR problem and Web search.Keywords
This publication has 12 references indexed in Scilit:
- Adapting ranking SVM to document retrievalPublished by Association for Computing Machinery (ACM) ,2006
- Improving web search ranking by incorporating user behavior informationPublished by Association for Computing Machinery (ACM) ,2006
- A study of relevance propagation for web searchPublished by Association for Computing Machinery (ACM) ,2005
- Exploiting the hierarchical structure for link analysisPublished by Association for Computing Machinery (ACM) ,2005
- Learning to rank using gradient descentPublished by Association for Computing Machinery (ACM) ,2005
- Discriminative models for information retrievalPublished by Association for Computing Machinery (ACM) ,2004
- Cumulated gain-based evaluation of IR techniquesACM Transactions on Information Systems, 2002
- Optimizing search engines using clickthrough dataPublished by Association for Computing Machinery (ACM) ,2002
- OUTLINE OF A GENERAL PROBABILISTIC RETRIEVAL MODELJournal of Documentation, 1983
- THE PROBABILITY RANKING PRINCIPLE IN IRJournal of Documentation, 1977