arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2502.09604cs.CLcs.AIcs.LG
收藏

SelfCite:面向大语言模型上下文归因的自监督对齐方法

SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models

Massachusetts Institute of Technology(麻省理工学院);Meta FAIR

Yung-Sung Chuang, Benjamin Cohen-Wang, Shannon Zejiang Shen, Zhaofeng Wu, Hu Xu, Xi Victoria Lin, James Glass, Shang-Wen Li, Wen-tau Yih

AI总结:

针对大语言模型上下文归因的引用生成问题,提出自监督方法SelfCite,通过上下文消融获取模型自身的奖励信号,用于推理采样和偏好优化,在长文本问答基准上显著提升引用F1值。

摘要:

我们提出了SelfCite,这是一种新颖的自监督方法,用于对齐大语言模型(LLM),使其为生成回复中的陈述生成高质量、细粒度的句子级引用。SelfCite并非仅依赖成本高昂且耗费人力的标注,而是利用LLM自身通过上下文消融提供的奖励信号:若某条引用是必要的,从上下文中移除被引用文本应会导致无法生成相同回复;若该引用是充分的,仅保留被引用文本应能维持相同回复。该奖励既可引导推理阶段的N次采样择优策略,显著提升引用质量,也可用于偏好优化,直接微调模型以生成更优引用。在LongBench-Cite基准的五项长文本问答任务上,SelfCite将引用F1值最高提升了5.3个点,证明了其有效性。源代码可在https://github.com/facebookresearch/SelfCite获取。

英文摘要:

We introduce SelfCite, a novel self-supervised approach that aligns LLMs to generate high-quality, fine-grained, sentence-level citations for the statements in their generated responses. Instead of only relying on costly and labor-intensive annotations, SelfCite leverages a reward signal provided by the LLM itself through context ablation: If a citation is necessary, removing the cited text from the context should prevent the same response; if sufficient, retaining the cited text alone should preserve the same response. This reward can guide the inference-time best-of-N sampling strategy to improve citation quality significantly, as well as be used in preference optimization to directly fine-tune the models for generating better citations. The effectiveness of SelfCite is demonstrated by increasing citation F1 up to 5.3 points on the LongBench-Cite benchmark across five long-form question answering tasks. The source code is available at https://github.com/facebookresearch/SelfCite

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑