使用Transformers超越化学一维知识
Beyond Chemical 1D knowledge using Transformers
摘要:
在本文中,我们评估了最近的transformer-CNN模型的效率,以预测目标的性质的基础上增强立体化学SMILES。我们选择了一个著名的Cliff活性数据集以及一个偶极子矩数据集,并比较了三种表示的R/S立体化学在SMILES的效果。所考虑的表示是没有立体化学的SMILES(noChiSMI)、经典的相对立体化学编码(RelChiSMI)和具有绝对立体化学编码的替代版本(AbsChiSMI)。在SMILES表示中包含R/S允许简化基于SMILES表示的相应信息的分配,但在回归或分类任务上并不总是显示出优势。有趣的是,当SMILES中不存在立体化学信息时,我们没有看到Transformer-CNN模型的性能下降。此外,这些模型显示出更高或类似的性能相比,基于3D结构的模型。这些观察结果是3D化学任务的NLP建模的重要一步。一个开放的挑战仍然是Transformer-CNN是否可以有效地从SMILES输入中嵌入3D知识,以及更好的表示是否可以进一步提高这种方法的准确性。
英文摘要:
In the present paper we evaluated efficiency of the recent Transformer-CNN models to predict target properties based on the augmented stereochemical SMILES. We selected a well-known Cliff activity dataset as well as a Dipole moment dataset and compared the effect of three representations for R/S stereochemistry in SMILES. The considered representations were SMILES without stereochemistry (noChiSMI), classical relative stereochemistry encoding (RelChiSMI) and an alternative version with absolute stereochemistry encoding (AbsChiSMI). The inclusion of R/S in SMILES representation allowed simplify the assignment of the respective information based on SMILES representation, but did not always show advantages on regression or classification tasks. Interestingly, we did not see degradation of the performance of Transformer-CNN models when the stereochemical information was not present in SMILES. Moreover, these models showed higher or similar performance compared to descriptor-based models based on 3D structures. These observations are an important step in NLP modeling of 3D chemical tasks. An open challenge remains whether Transformer-CNN can efficiently embed 3D knowledge from SMILES input and whether a better representation could further increase the accuracy of this approach.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。