arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.00052cs.CL
收藏

Systematically Exploring Redundancy Reduction in Summarizing Long Documents

University of British Columbia(不列颠哥伦比亚大学)

Wen Xiao, Giuseppe Carenini

英文摘要:

Our analysis of large summarization datasets indicates that redundancy is a very serious problem when summarizing long documents. Yet, redundancy reduction has not been thoroughly investigated in neural summarization. In this work, we systematically explore and compare different ways to deal with redundancy when summarizing long documents. Specifically, we organize the existing methods into categories based on when and how the redundancy is considered. Then, in the context of these categories, we propose three additional methods balancing non-redundancy and importance in a general and flexible way. In a series of experiments, we show that our proposed methods achieve the state-of-the-art with respect to ROUGE scores on two scientific paper datasets, Pubmed and arXiv, while reducing redundancy significantly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑