arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2503.00751cs.CLcs.AI
收藏

RAPID:基于写作规划与信息发现的高效检索增强长文本生成

RAPID: Efficient Retrieval-Augmented Long Text Generation with Writing Planning and Information Discovery

University of Science and Technology of China(中国科学技术大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室)

Hongchao Gu, Dexun Li, Kuicai Dong, Hao Zhang, Hang Lv, Hao Wang, Defu Lian, Yong Liu, Enhong Chen

AI总结:

针对大型语言模型生成知识密集型长文本时存在的幻觉、主题不连贯和高延迟问题,提出高效检索增强生成框架RAPID,通过检索增强大纲生成、属性约束搜索和规划引导生成三模块,在FreshWiki-2024基准上显著优于现有方法。

摘要:

为大型语言模型生成知识密集且全面的长文本(如百科全书文章)仍面临重大挑战。这不仅需要精准整合事实,还需在整篇文章中保持主题连贯性。现有方法(如直接生成和多智能体讨论)常受困于幻觉、主题不连贯和显著延迟等问题。为应对这些挑战,我们提出了RAPID,一个高效的检索增强长文本生成框架。RAPID包含三个主要模块:(1)检索增强的初步大纲生成以减少幻觉;(2)属性约束搜索以实现高效信息发现;(3)规划引导的文章生成以增强连贯性。在我们新编制的基准数据集FreshWiki-2024上的大量实验表明,RAPID在广泛的评估指标(如长文本生成、大纲质量、延迟等)上均显著优于最先进的方法。我们的工作为自动化长文本生成的挑战提供了稳健且高效的解决方案。

英文摘要:

Generating knowledge-intensive and comprehensive long texts, such as encyclopedia articles, remains significant challenges for Large Language Models. It requires not only the precise integration of facts but also the maintenance of thematic coherence throughout the article. Existing methods, such as direct generation and multi-agent discussion, often struggle with issues like hallucinations, topic incoherence, and significant latency. To address these challenges, we propose RAPID, an efficient retrieval-augmented long text generation framework. RAPID consists of three main modules: (1) Retrieval-augmented preliminary outline generation to reduce hallucinations, (2) Attribute-constrained search for efficient information discovery, (3) Plan-guided article generation for enhanced coherence. Extensive experiments on our newly compiled benchmark dataset, FreshWiki-2024, demonstrate that RAPID significantly outperforms state-of-the-art methods across a wide range of evaluation metrics (e.g. long-text generation, outline quality, latency, etc). Our work provides a robust and efficient solution to the challenges of automated long-text generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑