面向可读、相关且符合事实的生物医学通俗摘要的背景知识锚定
Background Knowledge Grounding for Readable, Relevant, and Factual Biomedical Lay Summaries
AI总结:
针对生物医学通俗摘要生成存在事实错误、锚定知识的使用方式不明的问题,提出锚定来源选择与整合方法,经BioLaySum数据集验证,该方法可提升摘要可读性与相关性但无法改善事实性。
摘要:
向公众传递科学研究成果对帮助非专业人士了解救命医疗手段等领域的进展至关重要。然而,从科学文献生成可读性强的通俗摘要颇具挑战,当前这类摘要存在严重的事实错误问题。提升事实性的一种常用干预手段是利用额外的外部知识提供事实锚定支撑,但目前尚不清楚应如何检索、选择或整合这些锚定来源,也不清楚补充的锚定文献会对生成摘要的可读性或相关性产生怎样的影响。我们提出了一种选择锚定来源并将其与源文献整合的简易方法,随后使用BioLaySum摘要数据集评估了不同锚定来源对摘要质量的影响。研究发现,对源文献进行知识锚定能够提升通俗摘要的相关性和可读性,但无法提升其事实性;在零样本摘要生成场景下这一结论依然成立——我们此前曾假设在该场景下锚定对生成符合事实的通俗摘要可能更为重要。
英文摘要:
Communication of scientific findings to the public is important for keeping non-experts informed of developments such as life-saving medical treatments. However, generating readable lay summaries from scientific documents is challenging, and currently, these summaries suffer from critical factual errors. One popular intervention for improving factuality is using additional external knowledge to provide factual grounding. However, it is unclear how these grounding sources should be retrieved, selected, or integrated, and how supplementary grounding documents might affect the readability or relevance of the generated summaries. We develop a simple method for selecting grounding sources and integrating them with source documents. We then use the BioLaySum summarization dataset to evaluate the effects of different grounding sources on summary quality. We found that grounding source documents improves the relevance and readability of lay summaries but does not improve factuality of lay summaries. This continues to be true in zero-shot summarization settings where we hypothesized that grounding might be even more important for factual lay summaries.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。