arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2010.11272cs.LG
收藏

基于SMILES表示的自注意力多任务学习预测化学性质

Predicting Chemical Properties using Self-Attention Multi-task Learning based on SMILES Representation

Korea Institute of Science and Technology Europe(韩国科学技术院欧洲分院);Forschungsgesellschaft mbH(研究公司);Korea Institute of Science and Technology(韩国科学技术院)

Sangrak Lim, Yong Oh Lee

摘要:

在化合物性质的计算预测中,使用编码为低维向量的分子描述符和指纹。选择合适的分子描述符和指纹是重要的和具有挑战性的,因为这些模型的性能高度依赖于描述符。为了克服这一挑战,自然语言处理模型,利用简化的分子输入行输入系统作为输入进行了研究,和几个transformer-variant模型取得了优越的结果时,与传统的方法相比。在这项研究中,我们探讨了transformer-variant模型的结构差异,并提出了一个新的基于自注意力的模型。自注意力模块的表示学习性能在多任务学习环境中使用不平衡的化学数据集进行评估。实验结果表明,我们的模型在几个基准数据集上取得了有竞争力的结果。我们实验的源代码可在https://github.com/arwhirang/sa-mtl上获得,数据集可从同一URL获得。

英文摘要:

In the computational prediction of chemical compound properties, molecular descriptors and fingerprints encoded to low dimensional vectors are used. The selection of proper molecular descriptors and fingerprints is both important and challenging as the performance of such models is highly dependent on descriptors. To overcome this challenge, natural language processing models that utilize simplified molecular input line-entry system as input were studied, and several transformer-variant models achieved superior results when compared with conventional methods. In this study, we explored the structural differences of the transformer-variant model and proposed a new self-attention based model. The representation learning performance of the self-attention module was evaluated in a multi-task learning environment using imbalanced chemical datasets. The experiment results showed that our model achieved competitive outcomes on several benchmark datasets. The source code of our experiment is available at https://github.com/arwhirang/sa-mtl and the dataset is available from the same URL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑