arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2408.07884cs.CL
收藏

指导大语言模型逐步生成科学文献综述

Instruct Large Language Models to Generate Scientific Literature Survey Step by Step

The Open University of China(国家开放大学);FloatMiracle;PLA Academy of Military Science(中国人民解放军军事科学院)

Yuxuan Lai, Yupeng Wu, Yidan Wang, Wenpeng Hu, Chen Zheng

AI总结:

本研究设计分步提示词引导大语言模型生成科学文献综述,基于Qwen-long的方案在NLPCC 2024评测中获第三名,软标题召回率95.84%,单篇生成成本仅0.1元,兼具效果与实用性。

摘要:

自动生成科学文献综述是一项极具价值的任务,可显著提升科研效率。然而,文献综述中信息的多样性与复杂性给生成模型带来了巨大挑战。本文设计了一系列提示词,系统性地利用大语言模型(LLMs),通过分步方法生成全面的文献综述。具体而言,我们设计提示词引导LLMs依次生成文献综述的标题、摘要、层级标题和主体内容。我们认为,这种设计能够从高层视角生成标题。在内容生成过程中,该设计通过限制LLM查询中输入和输出内容的长度,有效利用相关信息的同时将成本降至最低。我们基于Qwen-long的实现方案在NLPCC 2024科学文献综述生成评测任务中获得第三名,总分仅比第二名队伍低0.03%。此外,我们的软标题召回率为95.84%,在所有提交作品中排名第二。得益于高效的提示词设计和Qwen-long API的低成本,我们的方法将生成每篇文献综述的费用降至0.1元人民币,提升了方法的实用价值。

英文摘要:

Abstract. Automatically generating scientific literature surveys is a valuable task that can significantly enhance research efficiency. However, the diverse and complex nature of information within a literature survey poses substantial challenges for generative models. In this paper, we design a series of prompts to systematically leverage large language models (LLMs), enabling the creation of comprehensive literature surveys through a step-by-step approach. Specifically, we design prompts to guide LLMs to sequentially generate the title, abstract, hierarchical headings, and the main content of the literature survey. We argue that this design enables the generation of the headings from a high-level perspective. During the content generation process, this design effectively harnesses relevant information while minimizing costs by restricting the length of both input and output content in LLM queries. Our implementation with Qwen-long achieved third place in the NLPCC 2024 Scientific Literature Survey Generation evaluation task, with an overall score only 0.03% lower than the second-place team. Additionally, our soft heading recall is 95.84%, the second best among the submissions. Thanks to the efficient prompt design and the low cost of the Qwen-long API, our method reduces the expense for generating each literature survey to 0.1 RMB, enhancing the practical value of our method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑