arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.19941cs.LG
收藏

从结构视角提升图基础模型

Boosting Graph Foundation Model from Structural Perspective

School of Data Science and Engineering, East China Normal University, Shanghai 200062, China(数据科学与工程学院,东华大学,上海200062,中国)

Yao Cheng, Yige Zhao, Jianxiang Yu, Xiang Li

AI总结:

针对图基础模型忽视跨领域结构差异的问题,提出BooG,通过构建虚拟超级节点统一结构特征,并设计对比学习预训练目标,在多种任务上取得优越性能。

摘要:

图基础模型因其强大的泛化能力而受到广泛关注。尽管现有方法借助语言模型学习跨领域的统一语义表示,但它们忽略了来自不同领域的图数据所特有的结构特征。为解决这一问题,本文从结构视角提升图基础模型,提出了BooG模型。该模型构建虚拟超级节点,以统一不同领域图数据的结构特征。具体而言,超级节点融合锚节点和类别标签的信息,其中每个锚节点捕获待分类的节点或图实例的信息。我们不再使用原始图结构,而是通过虚拟边将超级节点连接到其邻域内的所有节点。这种新结构在统一跨领域结构特征的同时,实现了有效的信息聚合。此外,我们提出了一种基于对比学习的新型预训练目标,该目标能够为图数据学习更具表达力的表示,并有效泛化到不同领域和下游任务。在多种数据集和任务上的实验结果表明,BooG具有优越的性能。我们在此提供代码和数据:https://anonymous.4open.science/r/BooG-EE42/。

英文摘要:

Graph foundation models have recently attracted significant attention due to its strong generalizability. Although existing methods resort to language models to learn unified semantic representations across domains, they disregard the unique structural characteristics of graphs from different domains. To address the problem, in this paper, we boost graph foundation model from structural perspective and propose BooG. The model constructs virtual super nodes to unify structural characteristics of graph data from different domains. Specifically, the super nodes fuse the information of anchor nodes and class labels, where each anchor node captures the information of a node or a graph instance to be classified. Instead of using the raw graph structure, we connect super nodes to all nodes within their neighborhood by virtual edges. This new structure allows for effective information aggregation while unifying cross-domain structural characteristics. Additionally, we propose a novel pre-training objective based on contrastive learning, which learns more expressive representations for graph data and generalizes effectively to different domains and downstream tasks. Experimental results on various datasets and tasks demonstrate the superior performance of BooG. We provide our code and data here: https://anonymous.4open.science/r/BooG-EE42/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑