Graphs are a fundamental data structure for representing relational information in domains such as social networks, molecular systems, and knowledge graphs. However, graph learning models often suffer from limited generalization when applied beyond their training distributions. In practice, distribution shifts may arise from changes in graph structure, domain semantics, available modalities, or task formulations. To address these challenges, graph foundation models (GFMs) have recently emerged, aiming to learn general-purpose representations through large-scale pretraining across diverse graphs and tasks. In this survey, we review recent progress on GFMs from the perspective of out-of-distribution (OOD) generalization. We first discuss the main challenges posed by distribution shifts in graph learning and outline a unified problem setting. We then organize existing approaches based on whether they are designed to operate under a fixed task specification or to support generalization across heterogeneous task formulations, and summarize the corresponding OOD handling strategies and pretraining objectives. Finally, we review common evaluation protocols and discuss open directions for future research. To the best of our knowledge, this paper is the first survey for OOD generalization in GFMs.
Foundation Model's Embedded Representations May Detect Distribution Shift
Pacific Northwest National Laboratory(太平洋西北国家实验室);Stony Brook University(石溪大学);University of Washington(华盛顿大学);University of Texas, El Paso(德克萨斯大学埃尔帕索分校)
Efficient Generalization via Multimodal Co-Training under Data Scarcity and Distribution Shift
Department of Electrical and Computer Engineering(电气与计算机工程系);Florida Institute for National Security (FINS)(佛罗里达国家安全研究所);Applied Artificial Intelligence Group(应用人工智能小组);University of Florida(佛罗里达大学)
Bridging Domain Expertise and Generalization for Performance Estimation
School of Computer Science and Engineering, Sun Yat-sen University, China(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部人工智能与先进计算重点实验室);Shenzhen Loop Area Institute, China(深圳环湖院);Alibaba Cloud(阿里云)
Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift
Department of Mathematics, Rhodes University, South Africa(数学系,罗德斯大学,南非);National Institute for Theoretical and computational Sciences (NITheCS), Stellenbosch, 7600, South Africa(理论与计算科学国家研究所(NITheCS),斯泰伦博斯,7600,南非);Interdisciplinary Research Program in Public Health, University of Burundi, Burundi(公共卫生跨学科研究计划,布恩迪大学,布恩迪);Universite Clermont Auvergne, Clermont Auvergne INP, CNRS, Institut Pascal, Clermont–Ferrand, France(克莱蒙特-奥弗涅大学,克莱蒙特-奥弗涅INP,CNRS,帕西尔研究所,克莱蒙特-费尔南,法国);Department of International Public Health, Liverpool School of Tropical Medicine, Liverpool, UK(国际公共卫生系,利物浦热带医学学校,利物浦,英国);College of Health Solutions, Arizona State University, Phoenix, USA(健康解决方案学院,亚利桑那州立大学,凤凰城,美国);Department of Statistics, University of Pretoria, Pretoria, South Africa(统计系,普里特oria大学,普里特oria,南非)
SCALAR: Quantifying Structural Hallucination, Consistency, and Reasoning Gaps in Materials Foundation Models
Texas A\&M University, College Station, TX, USA(德克萨斯A&M大学);Ankara University, Ankara, Turkey(安卡拉大学);Texas A\&M University at Qatar, Doha, Qatar(德克萨斯A&M大学多哈分校);Hamad Bin Khalifa University, Doha, Qatar(哈马德·本·卡西姆大学)
Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models
Technical University of Munich(慕尼黑工业大学);Hong Kong Baptist University(香港浸会大学);Aalto University(阿尔托大学);University of Oulu(奥卢大学);University of Bonn(波恩大学);EPFL(洛桑联邦理工学院)
Generalization Can Emerge in Tabular Foundation Models From a Single Table
University of Toronto(多伦多大学);Polytechnique Montréal(蒙特利尔大学);Mila – Quebec AI Institute(魁北克人工智能研究所);Layer 6 AI(Layer 6 AI公司);Prior Labs(Prior实验室);ELLIS Institute(ELLIS研究所);Tübingen University of Freiburg(弗赖堡大学)
Understanding the Surprising Generalization Properties of Tabular Foundation Models
Polytechnique Montréal(蒙特利尔理工学院);Mila – Quebec AI Institute(米拉-魁北克人工智能研究所);Chandar Research Lab(钱达尔研究实验室);University of Toronto(多伦多大学);Layer 6 AI(第六层人工智能公司);Prior Labs(普里奥实验室);ELLIS Institute Tübingen(埃利斯研究所图宾根分部);University of Freiburg(弗赖堡大学);Cohere(科here公司)
Theoretical Foundation of Flow-Based Time Series Generation: Provable Approximation, Generalization, and Efficiency
South China University of Technology(华南理工大学);The Simons Institute for the Theory of Computing at the UC, Berkeley(加州大学伯克利分校西蒙斯理论计算研究所);Sun Yat-sen University(中山大学)
本文针对基于流的时间序列生成缺乏理论解释的问题,建立涵盖逼近、泛化与效率的理论框架,证明 DiT 任意误差拟合、多项式正则化泛化界及采样快速收敛。
GenRL: Multimodal-foundation world models for generalization in embodied agents
IDLab, Ghent University(IDLab,根特大学);VERSES AI Research Lab(VERSES AI研究实验室);Mila, University of Montreal(米拉研究所,蒙特利尔大学);ServiceNow Research(ServiceNow研究院)
Learning to Factorize and Adapt: A Versatile Approach Toward Universal Spatio-Temporal Foundation Models
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Peking University(北京大学);Huawei 2012 Laboratories(华为2012实验室);East China Normal University(华东师范大学)
Towards General Purpose Medical AI: Continual Learning Medical Foundation Model
Beijing University of Posts and Telecommunications(北京邮电大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);West China Hospital, Sichuan University(四川大学华西医院);Shanghai Jiao Tong University(上海交通大学);Sichuan University Pittsburgh Institute(四川大学匹兹堡学院)
The language of time: a language model perspective on time-series foundation models
College of Computer Science and Artificial Intelligence, Fudan University(计算机科学与人工智能学院,复旦大学);Shanghai Key Laboratory of Data Science(上海数据科学重点实验室);ZCTech;School of Mathematics and Statistics, Beijing Institute of Technology(数学与统计学学院,北京理工大学)
OpenECG: Benchmarking ECG Foundation Models with Public 1.2 Million Records
The First Affiliated Hospital, Jiangxi Medical College, Nanchang University(南昌大学江西医学院第一附属医院);Nanchang University(南昌大学);Georgia Institution of Technology(佐治亚理工学院)
Stress-Testing Multimodal Foundation Models for Crystallographic Reasoning
Dept. of Electrical and Computer Engineering, Texas A&M University(电气与计算机工程系,德克萨斯A&M大学);College of Science and Engineering, Hamad Bin Khalifa University(科学与工程学院,哈马德·本·卡西姆大学);Dept. of Electrical and Computer Engineering, Texas A&M University at Qatar(电气与计算机工程系,德克萨斯A&M大学(卡塔尔));Dept. of Prosthetics and Orthotics, Ankara University(假肢与矫形系,安卡拉大学)
HeterCSI: Channel-Adaptive Heterogeneous CSI Pretraining Framework for Generalized Wireless Foundation Models
National Engineering Research Center for Mobile Network Technologies, Beijing University of Posts and Telecommunications(中国移动网络技术国家工程研究中心,北京邮电大学);Department of Broadband Communication, Pengcheng Laboratory(宽带通信系,鹏城实验室);Key Laboratory of Ethnic Language Intelligent Analysis and Security Governance of MOE, Minzu University of China(民族语言智能分析与安全治理重点实验室,中央民族大学);China Telecom Corporation Limited Gansu Branch(中国电信集团甘肃分公司)
Unleashing the Power of Meta-tuning for Few-shot Generalization Through Sparse Interpolated Experts
City University of Hong Kong(香港城市大学);Korea Advanced Institute of Science and Technology(韩国科学技术院);University of Oxford(牛津大学);Harvard University(哈佛大学);Nanyang Technological University(南洋理工大学)
Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation
The Hong Kong University of Science and Technology(香港科技大学);Southern Medical University(南方医科大学);Guangdong Provincial Key Laboratory of Molecular Tumor Pathology(广东省分子肿瘤病理学重点实验室);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital(山东第一医科大学第一附属医院暨山东省千佛山医院);Sun Yat-sen University(中山大学);The Chinese University of Hong Kong(香港中文大学)