MolDA:通过大规模语言扩散模型实现分子理解与生成
MolDA: Molecular Understanding and Generation via Large Language Diffusion Model
AI总结:
MolDA通过大规模语言扩散模型替代传统自回归架构,解决分子生成中非局部约束和结构误差问题,实现分子生成、描述和性质预测的全局一致性与化学有效性。
摘要:
大规模语言模型(LLMs)已显著推动分子发现,但现有多模态分子架构本质上依赖自回归(AR)架构。这种严格的左到右归纳偏差在生成化学上有效分子时效果不佳,因为它难以考虑非局部全局约束(例如环闭合)且在序列生成过程中经常积累结构误差。为了解决这些限制,我们提出了MolDA(具有掩码扩散的分子语言模型),一种新的多模态框架,用离散的大规模语言扩散模型替代传统AR架构。MolDA使用混合图编码器提取全面的结构表示,捕获局部和全局拓扑,并通过Q-Former将它们对齐到语言标记空间。此外,我们专门针对掩码扩散数学地重新公式化分子结构偏好优化。通过双向迭代去噪,MolDA确保在分子生成、描述和性质预测中实现全局结构一致性、化学有效性和稳健推理。
英文摘要:
Large Language Models (LLMs) have significantly advanced molecular discovery, but existing multimodal molecular architectures fundamentally rely on autoregressive (AR) backbones. This strict left-to-right inductive bias is sub-optimal for generating chemically valid molecules, as it struggles to account for non-local global constraints (e.g., ring closures) and often accumulates structural errors during sequential generation. To address these limitations, we propose MolDA (Molecular language model with masked Diffusion with mAsking), a novel multimodal framework that replaces the conventional AR backbone with a discrete Large Language Diffusion Model. MolDA extracts comprehensive structural representations using a hybrid graph encoder, which captures both local and global topologies, and aligns them into the language token space via a Q-Former. Furthermore, we mathematically reformulate Molecular Structure Preference Optimization specifically for the masked diffusion. Through bidirectional iterative denoising, MolDA ensures global structural coherence, chemical validity, and robust reasoning across molecule generation, captioning, and property prediction.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。