arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.09475cs.LG
收藏

FIMP:面向图神经网络的基础模型信息传递

FIMP: Foundation Model-Informed Message Passing for Graph Neural Networks

Yale University(耶鲁大学);Brown University(布朗大学);New York University(纽约大学);MIT(麻省理工学院);ETH Zurich(苏黎世联邦理工学院);Idaho State University(爱达荷州立大学);University of Massachusetts Boston(马萨诸塞大学波士顿分校);Baylor College of Medicine(贝勒医学院);EPFL(洛桑联邦理工学院);University of Southern California(南加州大学)
Syed Asad Rizvi, Nazreen Pallikkavaliyaveetil, David Zhang, Zhuoyang Lyu, Nhi Nguyen, Haoran Lyu, Benjamin Christensen, Josue Ortega Caro, Antonio H. O. Fonseca… 展开作者

Syed Asad Rizvi, Nazreen Pallikkavaliyaveetil, David Zhang, Zhuoyang Lyu, Nhi Nguyen, Haoran Lyu, Benjamin Christensen, Josue Ortega Caro, Antonio H. O. Fonseca, Emanuele Zappala, Maryam Bagherian, Christopher Averill, Chadi G. Abdallah, Amin Karbasi, Rex Ying, Maria Brbic, Rahul Madhav Dhodapkar, David van Dijk

AI总结:

本文提出FIMP框架,将预训练非文本基础模型的自注意力层重新用于图上的跨节点消息传递,并在图像网络和生物数据上验证其优于强基线。

摘要:

基础模型依赖在海量数据上的预训练,已在众多领域取得显著成功。图结构数据通常不具备与非结构化数据相同的规模,这使得图基础模型的开发具有挑战性。在本工作中,我们提出了基础模型信息传递(FIMP),这是一种图神经网络(GNN)消息传递框架,在图任务中利用预训练的非文本基础模型。我们表明,基础模型的自注意力层可以有效地重新用于图,以执行基于跨节点注意力的消息传递。我们的模型在一个真实世界图像网络数据集和两个生物学应用(单细胞RNA测序数据和fMRI脑活动记录)上进行了评估,涵盖微调和零样本两种设置。FIMP优于强基线,表明它能够在图任务中有效利用最先进的基础模型。

英文摘要:

Foundation models have achieved remarkable success across many domains, relying on pretraining over vast amounts of data. Graph-structured data often lacks the same scale as unstructured data, making the development of graph foundation models challenging. In this work, we propose Foundation-Informed Message Passing (FIMP), a Graph Neural Network (GNN) message-passing framework that leverages pretrained non-textual foundation models in graph-based tasks. We show that the self-attention layers of foundation models can effectively be repurposed on graphs to perform cross-node attention-based message-passing. Our model is evaluated on a real-world image network dataset and two biological applications (single-cell RNA sequencing data and fMRI brain activity recordings) in both finetuned and zero-shot settings. FIMP outperforms strong baselines, demonstrating that it can effectively leverage state-of-the-art foundation models in graph tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑