GraphInstruct: Empowering Large Language Models with Graph Understanding and Reasoning Capability
National Engineering Research Center for Big Data Technology and System(大数据技术与系统国家工程研究中心);System Lab, Cluster(系统实验室,集群);Grid Computing Lab, School of Computer Science(网格计算实验室,计算机科学学院);Huazhong University of Science and Technology(华中科技大学);School of Computer Science(计算机科学学院);Microsoft Research Asia, Beijing 100190, China(微软亚洲研究院,北京100190,中国)
Zihan Luo, Xiran Song, Hong Huang, Jianxun Lian, Chenhao Zhang, Jinqi Jiang, Xing Xie, Hai Jin
备注:
The article has been accepted by Frontiers of Computer Science (FCS), with the DOI: {10.1007/s11704-025-51382-0}
Improving the general capabilities of large language models (LLMs) is an active research topic. As a common data structure in many real-world domains, understanding graph data is a crucial part of advancing general intelligence. To this end, we propose a dynamic benchmark named GraphInstruct in this paper, which comprehensively includes 21 classical graph reasoning tasks, providing diverse graph generation pipelines and detailed intermediate reasoning steps for each sample. Based on GraphInstruct, we develop GraphSolver via efficient instruction-tuning, which demonstrates prominent graph understanding capability compared to other open-sourced LLMs. To further endow LLMs with multi-step graph reasoning capability, we propose a label-mask training strategy and build GraphSolver+, which leverages masked supervision on intermediate reasoning tokens to emphasize crucial node-identification signals. As one of the pioneering efforts to enhance the graph understanding and reasoning abilities of LLMs, extensive experiments have demonstrated the superiority of GraphSolver and GraphSolver+ over other LLMs. We sincerely hope GraphInstruct will facilitate further research on applying LLMs to graph-structured data. Our code and data are released publicly at: https://github.com/CGCL-codes/GraphInstruct.
ARMOR: Empowering Multimodal Understanding Model with Interleaved Multimodal Generation Capability
Nankai University(南开大学);Shanghai Innovation Institute(上海创新研究院);University of Science and Technology of China(中国科学技术大学);Wuhan University(武汉大学);Shanghai AI Laboratory(上海人工智能实验室)
Empowering Few-Shot Relation Extraction with The Integration of Traditional RE Methods and Large Language Models
University of Science and Technology of China(中国科学技术大学);School of Data Science(数据科学学院);School of Computer Science and Technology(计算机科学与技术学院);State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室)
Focus on the Core: Empowering Diffusion Large Language Models by Self-Contrast
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Renmin University of China(中国人民大学);Xiaohongshu Inc.(小红书公司)
Sibyl: Empowering Empathetic Dialogue Generation in Large Language Models via Sensible and Visionary Commonsense Inference
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);WeChat AI, Tencent Inc(腾讯微信人工智能);Meituan Group(美团集团)
Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents
School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, China(计算机科学与技术学院,哈尔滨工业大学,深圳,中国);Huawei Technologies Co., Ltd.(华为技术有限公司)
Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detector
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);DIRO, Université de Montréal(蒙特利尔大学 DIRO 学院);Kuaishou(快手);School of Information, Renmin University of China(中国人民大学信息学院)
ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model
Northeastern University(东北大学);University of California San Diego(加州大学圣地亚哥分校);University of Maryland(马里兰大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);University of Washington(华盛顿大学)
Empowering Edge Agents: A Systematic Analysis of Edge-Cloud Collaboration in LLM Agent Execution
School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);China Mobile Online Services Co., Ltd.(中移在线服务有限公司)
Automated Proof Generation for Rust Code via Self-Evolution
Peking University(北京大学);Microsoft Research(微软研究院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Columbia University(哥伦比亚大学);University of California Irvine(加州大学 Irvine 分校)
Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs
National University of Singapore(新加坡国立大学);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);The Hong Kong University of Science and Technology(香港科技大学)