GLIMPSE:面向学术评审的语用信息性多文档摘要
GLIMPSE: Pragmatically Informative Multi-Document Summarization for Scholarly Reviews
AI总结:
GLIMPSE是一种基于Rational Speech Act框架的学术评审多文档摘要方法,通过新颖的独特性评分同时提取评审中的共同与独特意见,在人工评估中生成比基线更具区分度的摘要,且自动指标性能相当。
摘要:
科学同行评审对学术出版物的质量至关重要。然而,提交到会议的论文数量不断增加,给评审过程带来了压力。这一激增给领域主席带来了负担,他们必须仔细阅读日益增长的评审意见,并在决策过程中辨别每位审稿人的主要论点。在本文中,我们介绍了GLIMPSE,这是一种旨在为学术评审提供简洁而全面概述的摘要方法。与传统的基于共识的方法不同,GLIMPSE从评审中提取共同意见和独特意见。我们基于Rational Speech Act框架引入了新颖的独特性评分,以识别评审中的相关句子。我们的方法旨在提供对所有评审的语用性概览,从而对其意见提供平衡的视角。我们使用自动指标和人工评估进行的实验结果表明,GLIMPSE在人工评估方面生成了比基线方法更具区分度的摘要,同时在自动指标方面取得了与这些方法相当的性能。
英文摘要:
Scientific peer review is essential for the quality of academic publications. However, the increasing number of paper submissions to conferences has strained the reviewing process. This surge poses a burden on area chairs who have to carefully read an ever-growing volume of reviews and discern each reviewer's main arguments as part of their decision process. In this paper, we introduce \sys, a summarization method designed to offer a concise yet comprehensive overview of scholarly reviews. Unlike traditional consensus-based methods, \sys extracts both common and unique opinions from the reviews. We introduce novel uniqueness scores based on the Rational Speech Act framework to identify relevant sentences in the reviews. Our method aims to provide a pragmatic glimpse into all reviews, offering a balanced perspective on their opinions. Our experimental results with both automatic metrics and human evaluation show that \sys generates more discriminative summaries than baseline methods in terms of human evaluation while achieving comparable performance with these methods in terms of automatic metrics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。