arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.13994cs.CLcs.AI
收藏

基于对比学习的大语言模型知识型问题生成

Contrastive Learning for Knowledge-Based Question Generation in Large Language Models

George Washington University(乔治华盛顿大学);Stony Brook University(石溪大学);New York University(纽约大学);Singapore University of Technology and Design(新加坡科技设计大学);Trine University(特莱恩大学)

Zhenhong Zhang, Jiajing Chen, Weiyan Shi, Lingjie Yi, Chihang Wang, Qian Yu

AI总结:

本文针对大语言模型在知识型问题生成中的幻觉与知识缺口问题,提出融合对比学习与思维链提示的增强方法,通过多模型联合挖掘领域知识,显著提升了生成问题的质量和准确性。

摘要:

随着人工智能技术的快速发展,尤其是问答系统应用的日益广泛,高质量的问题生成已成为支撑这些系统发展的关键组成部分。本文聚焦于基于知识的问题生成技术,旨在使计算机能够在理解特定文本或知识库的基础上模拟人类的提问过程。针对大规模语言模型在应用于知识密集型任务时存在的幻觉和知识缺口问题,本文提出了一种融合对比学习的增强型问题生成方法。该方法利用多个模型联合挖掘领域知识,并利用对比学习引导模型减少生成中的噪声和幻觉。实验结果表明,通过设计包含对比示例的提示,模型在问题生成方面的性能显著提升,特别是当同时使用对比指令和示例时,生成问题的质量最高,准确率也有所提高。这些结果表明,本研究提出的结合对比上下文和思维链提示的方法,能够有效提高问题生成的质量和实用性。

英文摘要:

With the rapid development of artificial intelligence technology, especially the increasingly widespread application of question-and-answer systems, high-quality question generation has become a key component in supporting the development of these systems. This article focuses on knowledge-based question generation technology, which aims to enable computers to simulate the human questioning process based on understanding specific texts or knowledge bases. In light of the issues of hallucination and knowledge gaps present in large-scale language models when applied to knowledge-intensive tasks, this paper proposes an enhanced question generation method that incorporates contrastive learning. This method utilizes multiple models to jointly mine domain knowledge and uses contrastive learning to guide the model in reducing noise and hallucinations in generation. Experimental results show that by designing prompts containing contrasting examples, the model's performance in question generation improves considerably, particularly when contrasting instructions and examples are used simultaneously, leading to the highest quality of generated questions and improved accuracy. These results demonstrate that the method proposed in this study, which combines contrasting context and chain-of-thought prompts, can effectively improve both the quality and the practicality of question generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑