arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.05952cs.LGcs.AIcs.CL
收藏

推进图表示学习与大型语言模型的融合:技术综合综述

Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniques

Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学);Salesforce Research Asia(Salesforce 亚洲研究院);State Street Technology (Zhejiang) Ltd.(道富科技(浙江)有限公司)

Qiheng Mao, Zemin Liu, Chenghao Liu, Zhuo Li, Jianling Sun

AI总结:

本综述提出新颖分类法,系统剖析LLM与图表示学习融合模型的核心组件与操作技术,并展望未来研究方向。

摘要:

大型语言模型(LLMs)与图表示学习(GRL)的整合标志着分析复杂数据结构的一次重大演进。这种协作利用LLMs的复杂语言能力来提升图模型的上下文理解与适应性,从而拓宽了GRL的范围与潜力。尽管有越来越多的研究致力于将LLMs整合到图领域,但缺乏一份深入分析这些模型内部核心组件与操作的全面综述。我们的综述通过提出一种新颖的分类法填补了这一空白,该分类法从新颖的技术视角将这些模型分解为主要组件与操作技术。我们进一步将近期文献细分为两大主要组件,包括知识提取器与组织器,以及两种操作技术,包括整合与训练策略,从而阐明有效的模型设计与训练策略。此外,我们识别并探索了这一新兴但尚未充分探索领域中的潜在未来研究方向,提出了持续进步的路径。

英文摘要:

The integration of Large Language Models (LLMs) with Graph Representation Learning (GRL) marks a significant evolution in analyzing complex data structures. This collaboration harnesses the sophisticated linguistic capabilities of LLMs to improve the contextual understanding and adaptability of graph models, thereby broadening the scope and potential of GRL. Despite a growing body of research dedicated to integrating LLMs into the graph domain, a comprehensive review that deeply analyzes the core components and operations within these models is notably lacking. Our survey fills this gap by proposing a novel taxonomy that breaks down these models into primary components and operation techniques from a novel technical perspective. We further dissect recent literature into two primary components including knowledge extractors and organizers, and two operation techniques including integration and training stratigies, shedding light on effective model design and training strategies. Additionally, we identify and explore potential future research avenues in this nascent yet underexplored field, proposing paths for continued progress.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑