结论不重复:基于决定点加工的多样化注意的综合性摘要
In Conclusion Not Repetition: Comprehensive Abstractive Summarization With Diversified Attention Based On Determinantal Point Processes
摘要:
近年来,各种为机器翻译设计的Seq2Seq学习模型被应用于抽象摘要任务。尽管这些模型提供了很高的ROUGE分数,但由于其退化的注意力分布,它们仅限于生成具有高抽象级别的综合摘要。我们引入了多样卷积Seq2Seq模型(DivCNN Seq2Seq),使用确定性点过程方法(微观DPPs和宏观DPPs)来产生考虑质量和多样性的注意力分布。在不破坏端到端架构的情况下,DivCNN Seq2Seq实现了比普通模型和强大基线更高水平的全面性。所有可复制的代码和数据集都可以在线获得。
英文摘要:
Various Seq2Seq learning models designed for machine translation were applied for abstractive summarization task recently. Despite these models provide high ROUGE scores, they are limited to generate comprehensive summaries with a high level of abstraction due to its degenerated attention distribution. We introduce Diverse Convolutional Seq2Seq Model(DivCNN Seq2Seq) using Determinantal Point Processes methods(Micro DPPs and Macro DPPs) to produce attention distribution considering both quality and diversity. Without breaking the end to end architecture, DivCNN Seq2Seq achieves a higher level of comprehensiveness compared to vanilla models and strong baselines. All the reproducible codes and datasets are available online.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。