arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.21067cs.LG
收藏

图基础模型中的分布外泛化

Out-of-Distribution Generalization in Graph Foundation Models

Tsinghua University(清华大学)

Haoyang Li, Haibo Chen, Xin Wang, Wenwu Zhu

AI总结:

本文综述了图基础模型中分布外泛化的最新进展,讨论了分布偏移带来的挑战,并总结了相关方法和未来研究方向。

摘要:

图是一种在社交网络、分子系统和知识图谱等领域中表示关系信息的基本数据结构。然而,图学习模型在应用于超出其训练分布的场景时往往泛化能力有限。在实践中,分布偏移可能源于图结构、领域语义、可用模态或任务定义的变化。为解决这些挑战,图基础模型(GFMs)近期涌现,旨在通过在多样化的图和任务上进行大规模预训练来学习通用表示。在本文的综述中,我们从分布外泛化(OOD)的角度回顾了GFMs的最新进展。我们首先讨论了图学习中分布偏移带来的主要挑战,并概述了一个统一的问题设定。然后,我们根据现有方法是否设计为在固定任务规范下运行,或支持在异质任务定义上进行泛化,对现有方法进行了组织,并总结了相应的OOD处理策略和预训练目标。最后,我们回顾了常见的评估协议,并讨论了未来研究的开放方向。据我们所知,本文是首个针对GFMs中分布外泛化的综述。

英文摘要:

Graphs are a fundamental data structure for representing relational information in domains such as social networks, molecular systems, and knowledge graphs. However, graph learning models often suffer from limited generalization when applied beyond their training distributions. In practice, distribution shifts may arise from changes in graph structure, domain semantics, available modalities, or task formulations. To address these challenges, graph foundation models (GFMs) have recently emerged, aiming to learn general-purpose representations through large-scale pretraining across diverse graphs and tasks. In this survey, we review recent progress on GFMs from the perspective of out-of-distribution (OOD) generalization. We first discuss the main challenges posed by distribution shifts in graph learning and outline a unified problem setting. We then organize existing approaches based on whether they are designed to operate under a fixed task specification or to support generalization across heterogeneous task formulations, and summarize the corresponding OOD handling strategies and pretraining objectives. Finally, we review common evaluation protocols and discuss open directions for future research. To the best of our knowledge, this paper is the first survey for OOD generalization in GFMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑