从化学反应知识中进行上下文分子表示学习
Contextual Molecule Representation Learning from Chemical Reaction Knowledge
AI总结：
本文提出自监督框架REMO，利用170万个已知化学反应作为上下文预训练图/Transformer编码器，通过掩码反应中心重建和反应中心识别任务学习分子表示，在多个下游任务中超越现有单分子掩码建模基线，并首次在活性悬崖基准上超过指纹方法。
摘要：
近年来，自监督学习已成为利用大量无标签数据进行表示学习的强大工具，并在多个领域得到广泛应用。然而，当应用于分子表示学习（MRL）时，诸如掩码子单元重建等主流技术往往效果不佳，原因在于分子内原子可能组合的自由度很高，给掩码-重建范式带来了难以克服的复杂性。为应对这一挑战，我们提出了REMO，一个利用常见化学中明确定义的原子组合规则的自监督学习框架。具体而言，REMO在文献中的170万个已知化学反应上对图/Transformer编码器进行预训练。我们提出了两个预训练目标：掩码反应中心重建（MRCR）和反应中心识别（RCI）。REMO通过利用化学反应中潜在的共享模式作为预训练的上下文，为MRL提供了一种新颖的解决方案，从而有效推断出常见化学知识的有意义表示。这种上下文表示随后可用于以最少的微调支持多种下游分子任务，例如亲和力预测和药物-药物相互作用预测。在MoleculeACE、ACNet、药物-药物相互作用（DDI）和反应类型分类上的大量实验结果表明，在所有测试的下游任务中，REMO均优于当前MRL中使用的单分子掩码建模标准基线。值得注意的是，REMO是首个在活性悬崖基准上超越基于指纹方法的深度学习模型。
英文摘要：
In recent years, self-supervised learning has emerged as a powerful tool to harness abundant unlabelled data for representation learning and has been broadly adopted in diverse areas. However, when applied to molecular representation learning (MRL), prevailing techniques such as masked sub-unit reconstruction often fall short, due to the high degree of freedom in the possible combinations of atoms within molecules, which brings insurmountable complexity to the masking-reconstruction paradigm. To tackle this challenge, we introduce REMO, a self-supervised learning framework that takes advantage of well-defined atom-combination rules in common chemistry. Specifically, REMO pre-trains graph/Transformer encoders on 1.7 million known chemical reactions in the literature. We propose two pre-training objectives: Masked Reaction Centre Reconstruction (MRCR) and Reaction Centre Identification (RCI). REMO offers a novel solution to MRL by exploiting the underlying shared patterns in chemical reactions as \textit{context} for pre-training, which effectively infers meaningful representations of common chemistry knowledge. Such contextual representations can then be utilized to support diverse downstream molecular tasks with minimum finetuning, such as affinity prediction and drug-drug interaction prediction. Extensive experimental results on MoleculeACE, ACNet, drug-drug interaction (DDI), and reaction type classification show that across all tested downstream tasks, REMO outperforms the standard baseline of single-molecule masked modeling used in current MRL. Remarkably, REMO is the pioneering deep learning model surpassing fingerprint-based methods in activity cliff benchmarks.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
