arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.09437cs.LGcs.AI
收藏

基于扩散的脑图基础模型预训练

Diffusion-Guided Pretraining for Brain Graph Foundation Models

Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA, USA(电气与计算机工程系,莱维大学);Department of Computer Science and Engineering, Lehigh University, Bethlehem, PA, USA(计算机科学与工程系,莱维大学);Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA(精神病学与行为科学系,斯坦福大学医学院)

Xinxu Wei, Rong Zhou, Lifang He, Yu Zhang

AI总结:

本文提出基于扩散的预训练框架,通过结构感知的掩码策略和拓扑感知的图级读出,提升脑图表示的鲁棒性和有效性。

摘要:

随着对脑信号基础模型的兴趣增长,基于图的预训练已成为从连接组数据中学习可迁移表示的有希望的范式。然而,现有的对比学习和掩码自动编码方法通常依赖于简单的随机删除或掩码进行增强,这在脑图和超图中并不合适,因为它会破坏具有语义意义的连接模式。此外,常用的图级读出和重建方案无法捕捉全局结构信息,限制了所学表示的鲁棒性。在本文中,我们提出了一种统一的基于扩散的预训练框架,以解决这两个局限性。首先,扩散被设计用来指导结构感知的删除和掩码策略,在保持脑图语义的同时维持有效的预训练多样性。其次,扩散通过允许图嵌入和掩码节点从全局相关区域聚合信息,实现了拓扑感知的图级读出和节点级全局重建。在多个神经影像数据集中进行的广泛实验,涉及超过25,000名受试者和60,000次扫描,涵盖了各种心理疾病和脑图集,展示了持续的性能提升。

英文摘要:

With the growing interest in foundation models for brain signals, graph-based pretraining has emerged as a promising paradigm for learning transferable representations from connectome data. However, existing contrastive and masked autoencoder methods typically rely on naive random dropping or masking for augmentation, which is ill-suited for brain graphs and hypergraphs as it disrupts semantically meaningful connectivity patterns. Moreover, commonly used graph-level readout and reconstruction schemes fail to capture global structural information, limiting the robustness of learned representations. In this work, we propose a unified diffusion-based pretraining framework that addresses both limitations. First, diffusion is designed to guide structure-aware dropping and masking strategies, preserving brain graph semantics while maintaining effective pretraining diversity. Second, diffusion enables topology-aware graph-level readout and node-level global reconstruction by allowing graph embeddings and masked nodes to aggregate information from globally related regions. Extensive experiments across multiple neuroimaging datasets with over 25,000 subjects and 60,000 scans involving various mental disorders and brain atlases demonstrate consistent performance improvements.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑