arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.09841cs.LGq-bio.BM
收藏

利用结构化与非结构化知识学习多视图分子表示

Learning Multi-view Molecular Representations with Structured and Unstructured Knowledge

Institute of AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));Pharmolix Inc.(Pharmolix公司)

Yizhen Luo, Kai Yang, Massimo Hong, Xing Yi Liu, Zikun Nie, Hao Zhou, Zaiqing Nie

AI总结:

本文提出 MV-Mol 分子表示学习模型,融合化学结构、生物医学文本与知识图谱,通过文本提示、融合架构和两阶段预训练提升分子性质预测及多模态理解性能。

摘要:

利用表示学习方法捕捉分子知识,在化学和生命科学等广泛科学领域具有巨大潜力。一种有效且可泛化的分子表示,应能从不同视图和视角捕捉共识性与互补性的分子专业知识。然而,现有工作在学习多视图分子表示方面存在不足,原因在于显式整合视图信息以及处理来自异构来源的分子知识面临挑战。为解决这些问题,我们提出 MV-Mol,这是一种分子表示学习模型,可从化学结构、生物医学文本中的非结构化知识以及知识图谱中的结构化知识中获取多视图分子专业知识。我们利用文本提示对视图信息建模,并设计融合架构以提取基于视图的分子表示。我们开发了两阶段预训练流程,以利用质量和数量各不相同的异构数据。通过大量实验,我们表明 MV-Mol 提供了改进的表示,可显著惠及分子性质预测。此外,MV-Mol 在分子结构与文本的多模态理解方面展现出最先进性能。代码和数据可在 https://github.com/PharMolix/OpenBioMed 获取。

英文摘要:

Capturing molecular knowledge with representation learning approaches holds significant potential in vast scientific fields such as chemistry and life science. An effective and generalizable molecular representation is expected to capture the consensus and complementary molecular expertise from diverse views and perspectives. However, existing works fall short in learning multi-view molecular representations, due to challenges in explicitly incorporating view information and handling molecular knowledge from heterogeneous sources. To address these issues, we present MV-Mol, a molecular representation learning model that harvests multi-view molecular expertise from chemical structures, unstructured knowledge from biomedical texts, and structured knowledge from knowledge graphs. We utilize text prompts to model view information and design a fusion architecture to extract view-based molecular representations. We develop a two-stage pre-training procedure, exploiting heterogeneous data of varying quality and quantity. Through extensive experiments, we show that MV-Mol provides improved representations that substantially benefit molecular property prediction. Additionally, MV-Mol exhibits state-of-the-art performance in multi-modal comprehension of molecular structures and texts. Code and data are available at https://github.com/PharMolix/OpenBioMed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑