arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.16029cs.CL
收藏

GraphWiz:一种面向图问题的指令跟随语言模型

GraphWiz: An Instruction-Following Language Model for Graph Problems

The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学)

Nuo Chen, Yuhan Li, Jianheng Tang, Jia Li

AI总结:

本文提出GraphInstruct指令微调数据集并构建GraphWiz模型,结合DPO框架提升图问题求解能力,在九项任务上平均准确率达65%,超越GPT-4,并探讨了数据量与过拟合及跨任务迁移能力。

摘要:

大型语言模型(LLMs)在多个领域取得了令人瞩目的成功,但它们在理解和解决复杂图问题方面的能力尚未得到充分探索。为弥补这一差距,我们引入了GraphInstruct,这是一个新颖且全面的指令微调数据集,旨在赋予语言模型利用显式推理路径处理广泛图问题的能力。利用GraphInstruct,我们构建了GraphWiz,这是一个开源语言模型,能够解决多种图问题类型,同时生成清晰的推理过程。为增强模型的能力和可靠性,我们将直接偏好优化(Direct Preference Optimization,DPO)框架引入图问题求解场景。增强后的模型GraphWiz-DPO在九个不同复杂度级别的任务上取得了65%的平均准确率,超过了平均准确率为43.8%的GPT-4。此外,我们的研究深入探讨了训练数据量与模型性能之间的微妙平衡,揭示了数据量增加可能带来的过拟合风险。我们还探索了模型推理能力在不同图任务之间的可迁移性,表明该模型具有良好的适应性和实际应用潜力。我们的研究为开发专长于图推理和问题求解的大型语言模型提供了新的蓝图和有价值的见解。

英文摘要:

Large language models (LLMs) have achieved impressive success across several fields, but their proficiency in understanding and resolving complex graph problems is less explored. To bridge this gap, we introduce GraphInstruct, a novel and comprehensive instruction-tuning dataset designed to equip language models with the ability to tackle a broad spectrum of graph problems using explicit reasoning paths. Utilizing GraphInstruct, we build GraphWiz, an open-source language model capable of resolving various graph problem types while generating clear reasoning processes. To enhance the model's capability and reliability, we incorporate the Direct Preference Optimization (DPO) framework into the graph problem-solving context. The enhanced model, GraphWiz-DPO, achieves an average accuracy of 65% across nine tasks with different complexity levels, surpassing GPT-4 which has an average accuracy of 43.8%. Moreover, our research delves into the delicate balance between training data volume and model performance, highlighting the potential for overfitting with increased data. We also explore the transferability of the model's reasoning ability across different graph tasks, indicating the model's adaptability and practical application potential. Our investigation offers a new blueprint and valuable insights for developing LLMs specialized in graph reasoning and problem-solving.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑