arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.04863cs.LGq-bio.BM
收藏

OneProt:迈向多模态蛋白质基础模型

OneProt: Towards Multi-Modal Protein Foundation Models

PriorLabs;Helmholtz AI(亥姆霍兹人工智能);Technical University of Munich(慕尼黑工业大学);Munich Data Science Institute(慕尼黑数据科学研究所);Munich Center for Machine Learning(慕尼黑机器学习中心);Institute of Bio- and Geosciences (IBG-4: Bioinformatics)(生物与地球科学研究所(IBG-4:生物信息学));Institute for Pharmaceutical and Medicinal Chemistry(药物与医药化学研究所);Helmholtz Munich(慕尼黑亥姆霍兹中心)
Klemens Flöge, Srisruthi Udayakumar, Johanna Sommer, Marie Piraud, Stefan Kesselheim, Vincent Fortuin, Stephan Günneman, Karel J van der Weg, Holger Gohlke, Eri… 展开作者

Klemens Flöge, Srisruthi Udayakumar, Johanna Sommer, Marie Piraud, Stefan Kesselheim, Vincent Fortuin, Stephan Günneman, Karel J van der Weg, Holger Gohlke, Erinc Merdivan, Alina Bazarova

AI总结:

提出多模态蛋白质基础模型 OneProt,基于 ImageBind 对齐结构、序列、文本与结合位点编码器,在检索和下游任务中验证有效性并突出结合位点模态价值。

摘要:

人工智能的最新进展使多模态系统能够建模并转换多样化的信息空间。在文本和视觉之外,我们提出 OneProt,这是一种面向蛋白质的多模态 AI,整合了结构、序列、文本和结合位点数据。借助 ImageBind 框架,OneProt 通过轻量级微调方案对齐蛋白质模态编码器的潜在空间,该方案聚焦于与序列数据的成对对齐,而不要求完全匹配。这一新方法结合了图神经网络与 Transformer 架构。它在检索任务中表现出强劲性能,并通过涵盖酶功能预测和结合位点分析的广泛下游基线,展示了多模态系统在蛋白质机器学习中的有效性。此外,OneProt 能够将表征信息从专用编码器迁移到序列编码器,增强区分进化相关与不相关序列的能力,并呈现出进化相关蛋白质在潜在空间中沿相似方向对齐的表征特性。我们还广泛研究了模态消融,以识别对预测性能贡献最大的编码器,强调了结合位点编码器的重要性,该编码器此前未被类似模型使用。本工作拓展了多模态蛋白质模型的视野,为药物发现、生物催化反应规划和蛋白质工程中的变革性应用铺平了道路。

英文摘要:

Recent advances in Artificial Intelligence have enabled multi-modal systems to model and translate diverse information spaces. Extending beyond text and vision, we introduce OneProt, a multi-modal AI for proteins that integrates structural, sequence, text, and binding site data. Using the ImageBind framework, OneProt aligns the latent spaces of protein modality encoders in a lightweight fine-tuning scheme that focuses on pairwise alignment with sequence data rather than requiring full matches. This novel approach comprises a mix of Graph Neural Networks and transformer architectures. It demonstrates strong performance in retrieval tasks and showcases the efficacy of multi-modal systems in Protein Machine Learning through a broad spectrum of downstream baselines, including enzyme function prediction and binding site analysis. Furthermore, OneProt enables the transfer of representational information from specialized encoders to the sequence encoder, enhancing capabilities for distinguishing evolutionarily related and unrelated sequences and exhibiting representational properties where evolutionarily related proteins align in similar directions within the latent space. In addition, we extensively investigate modality ablations to identify the encoders that contribute most to predictive performance, highlighting the significance of the binding site encoder, which has not been used in similar models previously. This work expands the horizons of multi-modal protein models, paving the way for transformative applications in drug discovery, biocatalytic reaction planning, and protein engineering.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑