arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.01426physics.chem-phcond-mat.mtrl-scics.LG
收藏

MolTRES:改进用于分子性质预测的化学语言表示学习

MolTRES: Improving Chemical Language Representation Learning for Molecular Property Prediction

BK21 FOUR R&E Center for Artificial Intelligence, Korea University(韩国大学BK21 FOUR人工智能研究教育中心);Korea University(韩国大学)

Jun-Hyung Park, Yeachan Kim, Mingyu Lee, Hyuntae Park, SangKeun Lee

AI总结:

提出 MolTRES 化学语言表示学习框架,通过生成器-判别器训练和外部材料文献知识嵌入缓解过拟合与过早收敛,并在分子性质预测任务上超过现有最先进模型。

摘要:

由于药物和材料设计等领域中监督数据的可用性有限,化学表示学习越来越受到关注。这种兴趣尤其延伸到化学语言表示学习,其涉及在 SMILES 序列——分子的文本描述符——上预训练 Transformers。尽管其在分子性质预测中取得了成功,但由于过早收敛,当前实践往往导致过拟合和可扩展性受限。在本文中,我们引入了一种名为 MolTRES 的新型化学语言表示学习框架,以解决这些问题。MolTRES 结合了生成器-判别器训练,使模型能够从需要结构理解的、更具挑战性的样本中学习。此外,我们通过整合外部材料嵌入,迁移科学文献中的知识,从而丰富分子表示。实验结果表明,我们的模型在常用的分子性质预测任务上优于现有的最先进模型。

英文摘要:

Chemical representation learning has gained increasing interest due to the limited availability of supervised data in fields such as drug and materials design. This interest particularly extends to chemical language representation learning, which involves pre-training Transformers on SMILES sequences -- textual descriptors of molecules. Despite its success in molecular property prediction, current practices often lead to overfitting and limited scalability due to early convergence. In this paper, we introduce a novel chemical language representation learning framework, called MolTRES, to address these issues. MolTRES incorporates generator-discriminator training, allowing the model to learn from more challenging examples that require structural understanding. In addition, we enrich molecular representations by transferring knowledge from scientific literature by integrating external materials embedding. Experimental results show that our model outperforms existing state-of-the-art models on popular molecular property prediction tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑