arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2307.04507cs.CLcs.AI

通过对比奖励学习提升抽象式摘要的事实性

Improving Factuality of Abstractive Summarization via Contrastive Reward Learning

Carnegie Mellon University(卡内基梅隆大学);Shanghai Jiao Tong University(上海交通大学)

I-Chun Chern, Zhiruo Wang, Sanjan Das, Bhavuk Sharma, Pengfei Liu, Graham Neubig

AI总结:

本文提出一种结合奖励学习与事实性指标的对比学习框架,使抽象式摘要模型从事实性反馈中学习,从而生成更符合事实的摘要。

摘要:

现代抽象式摘要模型常常生成包含幻觉或矛盾信息的摘要。本文提出了一种简单而有效的对比学习框架,该框架结合了奖励学习和事实性指标的最新进展。实证研究表明,所提出的框架使摘要模型能够通过对比奖励学习从事实性指标的反馈中学习,从而在人类评估中生成更具事实性的摘要。这表明学习和评估算法的进一步进步可以直接用于提供更具事实性的摘要。

英文摘要:

Modern abstractive summarization models often generate summaries that contain hallucinated or contradictory information. In this paper, we propose a simple but effective contrastive learning framework that incorporates recent developments in reward learning and factuality metrics. Empirical studies demonstrate that the proposed framework enables summarization models to learn from feedback of factuality metrics using contrastive reward learning, leading to more factual summaries by human evaluations. This suggests that further advances in learning and evaluation algorithms can feed directly into providing more factual summaries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑