arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.01121cs.LGcs.AIcs.SI
收藏

OpenGraph:迈向开放图基础模型

OpenGraph: Towards Open Graph Foundation Models

University of Hong Kong(香港大学)

Lianghao Xia, Ben Kao, Chao Huang

AI总结:

针对图神经网络难以泛化到异质未知图数据的问题,提出图基础模型OpenGraph,结合LLM数据增广、统一图分词器和可扩展图Transformer,实现了多场景下优异的零样本图学习性能。

摘要:

图学习已在推荐系统、社交网络分析等多个领域成为核心技术。图神经网络(GNNs)作为编码结构信息、提升链接预测、节点分类等任务性能的前沿技术,已展现出巨大潜力。但核心挑战依然存在:难以泛化到具有不同属性的未见过的图数据。针对这一问题,本文提出一种新型图基础模型OpenGraph。该方法攻克了多项技术难点:第一,利用大语言模型(LLM)增强数据增广,解决真实场景下的数据稀缺问题;第二,提出统一图分词器,使模型能有效泛化到多样图数据,即便训练中未见过相关属性也能适配;第三,研发可扩展图Transformer,在全局拓扑语境中捕获节点级依赖关系。大量实验验证了该框架的有效性:通过适配新图特征、理解多样图数据,OpenGraph在多种设置下实现了卓越的零样本图学习性能。模型实现已发布于https://github.com/HKUDS/OpenGraph。

英文摘要:

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving performance in tasks like link prediction and node classification. However, a key challenge remains: the difficulty of generalizing to unseen graph data with different properties. In this work, we propose a novel graph foundation model, called OpenGraph, to address this challenge. Our approach tackles several technical obstacles. Firstly, we enhance data augmentation using a large language model (LLM) to overcome data scarcity in real-world scenarios. Secondly, we introduce a unified graph tokenizer that enables the model to generalize effectively to diverse graph data, even when encountering unseen properties during training. Thirdly, our developed scalable graph transformer captures node-wise dependencies within the global topological context. Extensive experiments validate the effectiveness of our framework. By adapting OpenGraph to new graph characteristics and comprehending diverse graphs, our approach achieves remarkable zero-shot graph learning performance across various settings. We release the model implementation at https://github.com/HKUDS/OpenGraph.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑