arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.04483cs.AIcs.CL
收藏

GraphInstruct:赋予大型语言模型图理解与推理能力

GraphInstruct: Empowering Large Language Models with Graph Understanding and Reasoning Capability

National Engineering Research Center for Big Data Technology and System(大数据技术与系统国家工程研究中心);System Lab, Cluster(系统实验室,集群);Grid Computing Lab, School of Computer Science(网格计算实验室,计算机科学学院);Huazhong University of Science and Technology(华中科技大学);School of Computer Science(计算机科学学院);Microsoft Research Asia, Beijing 100190, China(微软亚洲研究院,北京100190,中国)

Zihan Luo, Xiran Song, Hong Huang, Jianxun Lian, Chenhao Zhang, Jinqi Jiang, Xing Xie, Hai Jin

AI总结:

为提升大型语言模型(LLMs)的图理解与推理能力,本文提出动态基准GraphInstruct(含21项图推理任务),基于其通过指令调优开发GraphSolver及标签掩码训练策略构建GraphSolver+,实验证明二者在图理解与推理上优于其他开源LLMs。

摘要:

提升大型语言模型(LLMs)的通用能力是一个活跃的研究课题。作为许多现实领域中的常见数据结构,理解图数据是推进通用智能的关键部分。为此,本文提出一个名为GraphInstruct的动态基准,它全面涵盖21项经典图推理任务,为每个样本提供多样的图生成管道和详细的中间推理步骤。基于GraphInstruct,我们通过高效指令调优开发了GraphSolver,与其他开源LLMs相比,它展现出卓越的图理解能力。为进一步赋予LLMs多步图推理能力,我们提出标签掩码训练策略并构建GraphSolver+,该策略通过对中间推理标记的掩码监督来强调关键节点识别信号。作为增强LLMs图理解与推理能力的开创性工作之一,大量实验表明GraphSolver和GraphSolver+优于其他LLMs。我们真诚希望GraphInstruct能促进LLMs在图结构数据上的进一步研究。我们的代码和数据已公开于:https://github.com/CGCL-codes/GraphInstruct。

英文摘要:

Improving the general capabilities of large language models (LLMs) is an active research topic. As a common data structure in many real-world domains, understanding graph data is a crucial part of advancing general intelligence. To this end, we propose a dynamic benchmark named GraphInstruct in this paper, which comprehensively includes 21 classical graph reasoning tasks, providing diverse graph generation pipelines and detailed intermediate reasoning steps for each sample. Based on GraphInstruct, we develop GraphSolver via efficient instruction-tuning, which demonstrates prominent graph understanding capability compared to other open-sourced LLMs. To further endow LLMs with multi-step graph reasoning capability, we propose a label-mask training strategy and build GraphSolver+, which leverages masked supervision on intermediate reasoning tokens to emphasize crucial node-identification signals. As one of the pioneering efforts to enhance the graph understanding and reasoning abilities of LLMs, extensive experiments have demonstrated the superiority of GraphSolver and GraphSolver+ over other LLMs. We sincerely hope GraphInstruct will facilitate further research on applying LLMs to graph-structured data. Our code and data are released publicly at: https://github.com/CGCL-codes/GraphInstruct.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑