Automatic evaluation of summaries using N-gram co-occurrence statistics
Top Cited Papers
- 1 January 2003
- proceedings article
- Published by Association for Computational Linguistics (ACL)
- Vol. 1, 71-78
- https://doi.org/10.3115/1073445.1073465
Abstract
Following the recent adoption by the machine translation community of automatic evaluation using the BLEU/NIST scoring process, we conduct an in-depth study of a similar idea for evaluating summaries. The results show that automatic evaluation using unigram co-occurrences between summary pairs correlates surprising well with human evaluations, based on various statistical metrics; while direct application of the BLEU evaluation procedure does not always give good results.Keywords
This publication has 0 references indexed in Scilit: