arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.19271cs.CL
收藏

复杂问题的简明答案:长文本答案的摘要生成

Concise Answers to Complex Questions: Summarization of Long-form Answers

The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Abhilash Potluri, Fangyuan Xu, Eunsol Choi

AI总结:

本文首次研究长文本问答答案的摘要生成,提出抽取式与去语境化方法,并通过用户研究和1K条答案的数据集验证其有效性,推动多粒度问答智能体的发展。

摘要:

长文本问答系统通过呈现段落级答案来提供丰富信息,这些答案通常包含可选的背景或辅助信息。虽然这种全面的答案很有帮助,但并非所有信息都是回答问题所必需的(例如,具备领域知识的用户不需要背景解释)。我们能否通过摘要生成来提供答案的简明版本,同时仍然解决问题?我们对由最先进模型生成的摘要答案以及我们新提出的抽取式与去语境化方法进行了用户研究。我们发现,在ELI5领域中,很大比例(超过90%)的长文本答案可以被至少一个系统充分摘要,而复杂和隐式答案则难以压缩。我们观察到,去语境化提高了抽取式摘要的质量,展示了其在摘要任务中的潜力。为了促进未来工作,我们提供了一个覆盖1K条长文本答案的抽取式摘要数据集以及我们的用户研究标注。总之,我们提出了首个关于长文本答案摘要生成的研究,为能够提供多粒度答案的问答智能体向前迈出了一步。

英文摘要:

Long-form question answering systems provide rich information by presenting paragraph-level answers, often containing optional background or auxiliary information. While such comprehensive answers are helpful, not all information is required to answer the question (e.g. users with domain knowledge do not need an explanation of background). Can we provide a concise version of the answer by summarizing it, while still addressing the question? We conduct a user study on summarized answers generated from state-of-the-art models and our newly proposed extract-and-decontextualize approach. We find a large proportion of long-form answers (over 90%) in the ELI5 domain can be adequately summarized by at least one system, while complex and implicit answers are challenging to compress. We observe that decontextualization improves the quality of the extractive summary, exemplifying its potential in the summarization task. To promote future work, we provide an extractive summarization dataset covering 1K long-form answers and our user study annotations. Together, we present the first study on summarizing long-form answers, taking a step forward for QA agents that can provide answers at multiple granularities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑