arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.14928cs.LGcs.AIcs.CLcs.SI
收藏

大语言模型时代的图机器学习

Graph Machine Learning in the Era of Large Language Models (LLMs)

The Hong Kong Polytechnic University(香港理工大学);Michigan State University(密歇根州立大学);North Carolina State University(北卡罗来纳州立大学);Baidu Inc(百度公司)

Shijie Wang, Jiani Huang, Zhikai Chen, Yu Song, Wenzhuo Tang, Haitao Mao, Wenqi Fan, Hui Liu, Xiaorui Liu, Dawei Yin, Qing Li

AI总结:

本文综述了大语言模型如何增强图机器学习的泛化、迁移和少样本学习能力,以及图如何提升大语言模型的推理和可解释性。

摘要:

图在表示社交网络、知识图谱和分子发现等各个领域的复杂关系中扮演着重要角色。随着深度学习的出现,图神经网络(GNN)已成为图机器学习(Graph ML)的基石,促进了图的表示和处理。最近,大语言模型(LLM)在语言任务中展现出前所未有的能力,并被广泛应用于计算机视觉和推荐系统等各种应用中。这一显著成功也引起了将LLM应用于图领域的兴趣。越来越多的努力致力于探索LLM在提升图机器学习的泛化性、迁移性和少样本学习能力方面的潜力。同时,图,尤其是知识图谱,富含可靠的事实知识,可用于增强LLM的推理能力,并可能缓解其局限性,如幻觉和缺乏可解释性。鉴于这一研究方向的快速进展,有必要对LLM时代图机器学习的最新进展进行系统综述,为研究人员和从业者提供深入理解。因此,在本综述中,我们首先回顾了图机器学习的最新发展。然后,我们探讨了如何利用LLM来增强图特征的质量,减轻对标注数据的依赖,并解决图异质性和分布外(OOD)泛化等挑战。之后,我们深入探讨了图如何增强LLM,突出了它们增强LLM预训练和推理的能力。此外,我们调查了各种应用,并讨论了这一有前景领域的潜在未来方向。

英文摘要:

Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep learning, Graph Neural Networks (GNNs) have emerged as a cornerstone in Graph Machine Learning (Graph ML), facilitating the representation and processing of graphs. Recently, LLMs have demonstrated unprecedented capabilities in language tasks and are widely adopted in a variety of applications such as computer vision and recommender systems. This remarkable success has also attracted interest in applying LLMs to the graph domain. Increasing efforts have been made to explore the potential of LLMs in advancing Graph ML's generalization, transferability, and few-shot learning ability. Meanwhile, graphs, especially knowledge graphs, are rich in reliable factual knowledge, which can be utilized to enhance the reasoning capabilities of LLMs and potentially alleviate their limitations such as hallucinations and the lack of explainability. Given the rapid progress of this research direction, a systematic review summarizing the latest advancements for Graph ML in the era of LLMs is necessary to provide an in-depth understanding to researchers and practitioners. Therefore, in this survey, we first review the recent developments in Graph ML. We then explore how LLMs can be utilized to enhance the quality of graph features, alleviate the reliance on labeled data, and address challenges such as graph Heterophily and out-of-distribution (OOD) generalization. Afterward, we delve into how graphs can enhance LLMs, highlighting their abilities to enhance LLM pre-training and inference. Furthermore, we investigate various applications and discuss the potential future directions in this promising field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑