3D-MolT5: Leveraging Discrete Structural Information for Molecule-Text Modeling
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Computer Science, Wuhan University(武汉大学计算机学院);Huazhong University of Science and Technology(华中科技大学);University of Science and Technology of China(中国科学技术大学);Shanghai AI Laboratory(上海人工智能实验室)
The integration of molecular and natural language representations has emerged as a focal point in molecular science, with recent advancements in Language Models (LMs) demonstrating significant potential for comprehensive modeling of both domains. However, existing approaches face notable limitations, particularly in their neglect of three-dimensional (3D) information, which is crucial for understanding molecular structures and functions. While some efforts have been made to incorporate 3D molecular information into LMs using external structure encoding modules, significant difficulties remain, such as insufficient interaction across modalities in pre-training and challenges in modality alignment. To address the limitations, we propose \textbf{3D-MolT5}, a unified framework designed to model molecule in both sequence and 3D structure spaces. The key innovation of our approach lies in mapping fine-grained 3D substructure representations into a specialized 3D token vocabulary. This methodology facilitates the seamless integration of sequence and structure representations in a tokenized format, enabling 3D-MolT5 to encode molecular sequences, molecular structures, and text sequences within a unified architecture. Leveraging this tokenized input strategy, we build a foundation model that unifies the sequence and structure data formats. We then conduct joint pre-training with multi-task objectives to enhance the model's comprehension of these diverse modalities within a shared representation space. Thus, our approach significantly improves cross-modal interaction and alignment, addressing key challenges in previous work. Further instruction tuning demonstrated that our 3D-MolT5 has strong generalization ability and surpasses existing methods with superior performance in multiple downstream tasks. Our code is available at https://github.com/QizhiPei/3D-MolT5.
Structure-R1: Dynamically Leveraging Structural Knowledge in LLM Reasoning through Reinforcement Learning
Washington University in St. Louis(华盛顿大学圣路易斯分校);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Purdue University(普渡大学);University of Notre Dame(诺特丹大学)
MolHop: Scaffold-Hopping Molecular Design with Agentic Reinforcement Learning
State Key Laboratory of Physical Chemistry of Solid Surface, College of Chemistry and Chemical Engineering, Xiamen University(厦门大学化学化工学院固体表面物理化学国家重点实验室);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能研究院)
Structuralist Approach to AI Literary Criticism: Leveraging Greimas Semiotic Square for Large Language Models
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);School of Engineering and Technology, Central Queensland University(中央昆士兰大学工程与技术学院)
Multi-view deep learning based molecule design and structural optimization accelerates the SARS-CoV-2 inhibitor discovery
School of Software, Shandong University(山东大学软件学院);Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University(山东大学-南洋理工大学人工智能联合研究中心(C-FAIR));College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)
SIU: A Million-Scale Structural Small Molecule-Protein Interaction Dataset for Unbiased Bioactivity Prediction
Peking University(北京大学);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院);School of Life Sciences, Tsinghua University(清华大学生命科学学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
Clustering Bioactive Molecules in 3D Chemical Space with Unsupervised Deep Learning
National University of Singapore(新加坡国立大学);Tsinghua University(清华大学);Shenzhen Kivita Innovative Drug Discovery Institute(深圳科维塔创新药物发现研究院);Zhejiang University(浙江大学);China Pharmaceutical University(中国药科大学);Shanghai Kudai Network Technology Co., Ltd.(上海酷袋网络科技有限公司)
PEMP: Leveraging Physics Properties to Enhance Molecular Property Prediction
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR))
FSscore: A Machine Learning-based Synthetic Feasibility Score Leveraging Human Expertise
EPFL(洛桑联邦理工学院);Laboratory of Artificial Chemical Intelligence (LIAC)(人工化学智能实验室(LIAC));Laboratory of Protein Design and Immunoengineering (LPDI)(蛋白质设计与免疫工程实验室(LPDI))
MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Design
George Mason University(乔治梅森大学);Georgia Institute of Technology(佐治亚理工学院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Mila - Université de Montréal(米拉 - 蒙特利尔大学)