arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.13865cs.CL
收藏

用于生成多论文引用的上下文增强语言模型

Context-Enhanced Language Models for Generating Multi-Paper Citations

Indraprastha Institute of Information Technology, Delhi(德里英迪拉普拉斯塔信息技术学院)

Avinash Anand, Kritarth Prasad, Ujjwal Goel, Mohit Gupta, Naman Lal, Astha Verma, Rajiv Ratn Shah

AI总结:

针对多论文引用生成需求,提出利用LLMs结合知识图谱增强上下文的方法,构建MCG-S2ORC数据集并验证LLaMA等模型性能,有效提升多引用文本生成质量。

摘要:

引用文本在阐明科学文献之间的联系中发挥关键作用,要求对被引文献有深入理解。构建引用通常耗时,需要研究者深入广泛文献并费力组织相关内容。为应对此挑战,引用文本生成(CTG)领域应运而生。然而,早期方法主要集中于生成单句引用,而实际场景常需在单段落中引用多篇文献。为弥补此差距,我们提出一种利用大型语言模型(LLMs)生成多引用句的方法。该方法涉及单一源论文与一组目标论文,最终生成包含多句引用文本的连贯段落。此外,我们引入名为MCG-S2ORC的精选数据集,由计算机科学领域的英文学术研究论文构成,展示多引用实例。实验中,我们评估LLaMA、Alpaca和Vicuna三种LLMs,以确定最有效模型。另外,通过将目标论文的知识图谱整合到生成引用文本的提示中,我们展示了性能提升。本研究凸显利用LLMs进行引用生成的潜力,为探索科学文献间复杂联系开辟新途径。

英文摘要:

Citation text plays a pivotal role in elucidating the connection between scientific documents, demanding an in-depth comprehension of the cited paper. Constructing citations is often time-consuming, requiring researchers to delve into extensive literature and grapple with articulating relevant content. To address this challenge, the field of citation text generation (CTG) has emerged. However, while earlier methods have primarily centered on creating single-sentence citations, practical scenarios frequently necessitate citing multiple papers within a single paragraph. To bridge this gap, we propose a method that leverages Large Language Models (LLMs) to generate multi-citation sentences. Our approach involves a single source paper and a collection of target papers, culminating in a coherent paragraph containing multi-sentence citation text. Furthermore, we introduce a curated dataset named MCG-S2ORC, composed of English-language academic research papers in Computer Science, showcasing multiple citation instances. In our experiments, we evaluate three LLMs LLaMA, Alpaca, and Vicuna to ascertain the most effective model for this endeavor. Additionally, we exhibit enhanced performance by integrating knowledge graphs from target papers into the prompts for generating citation text. This research underscores the potential of harnessing LLMs for citation generation, opening a compelling avenue for exploring the intricate connections between scientific documents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑