上下文至关重要:利用图结构知识上下文拓展开放式答案生成的边界
Context Matters: Pushing the Boundaries of Open-Ended Answer Generation with Graph-Structured Knowledge Context
AI总结:
本文提出GraphContextGen框架,结合图驱动上下文检索与知识图谱增强,提升参数较少LLMs在特定社区问答平台上的开放式问题回答能力,在事实准确性和知识奠基方面优于主流文本检索系统。
摘要:
在不断发展的AI领域,通过大型语言模型(LLMs)生成具有丰富上下文且有意义的内容至关重要。研究人员越来越意识到,参数较少的LLMs在尝试为开放式问题提供合适答案时面临的挑战。为了解决这些障碍,整合前沿策略,为LLMs增加丰富的外部领域知识,能带来显著的改进。本文提出了一个新颖的框架,结合图驱动上下文检索与基于知识图谱的增强,提升LLMs的能力,特别是在AskUbuntu、Unix和ServerFault等特定领域的社区问答平台上的表现。我们在不同参数规模的各种LLMs上进行了实验,以评估它们在为开放式问题生成答案时奠定知识基础和判断事实准确性的能力。我们的方法GraphContextGen始终优于主流的基于文本的检索系统,展示了其鲁棒性以及对大量用例的适应性。这一进步突显了将上下文丰富的数据检索与LLMs相结合的重要性,为AI系统中的知识获取与生成提供了新的方法。我们还表明,由于丰富的上下文数据检索,关键实体以及生成的答案在事实上与黄金答案保持一致。
英文摘要:
In the continuously advancing AI landscape, crafting context-rich and meaningful responses via Large Language Models (LLMs) is essential. Researchers are becoming more aware of the challenges that LLMs with fewer parameters encounter when trying to provide suitable answers to open-ended questions. To address these hurdles, the integration of cutting-edge strategies, augmentation of rich external domain knowledge to LLMs, offers significant improvements. This paper introduces a novel framework that combines graph-driven context retrieval in conjunction to knowledge graphs based enhancement, honing the proficiency of LLMs, especially in domain specific community question answering platforms like AskUbuntu, Unix, and ServerFault. We conduct experiments on various LLMs with different parameter sizes to evaluate their ability to ground knowledge and determine factual accuracy in answers to open-ended questions. Our methodology GraphContextGen consistently outperforms dominant text-based retrieval systems, demonstrating its robustness and adaptability to a larger number of use cases. This advancement highlights the importance of pairing context rich data retrieval with LLMs, offering a renewed approach to knowledge sourcing and generation in AI systems. We also show that, due to rich contextual data retrieval, the crucial entities, along with the generated answer, remain factually coherent with the gold answer.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。