arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.16307physics.chem-phcs.LGq-bio.BM
收藏

编码器-解码器模型在学习过程中对化学结构识别的探究

Investigation of chemical structure recognition by encoder-decoder models in learning progress

Graduate School of Pharmaceutical Sciences, The University of Tokyo(东京大学药学研究科)

Shumpei Nemoto, Tadahaya Mizuno, Hiroyuki Kusuhara

AI总结:

本文通过构建不同学习进度的编码器-解码器模型,发现子结构学习较早而结构恢复耗时且不充分学习会高估结构大小,揭示了现有评估方法对SMILES描述符生成模型不够敏感的问题。

摘要:

使用以SMILES为输入的编码器-解码器(ED)模型潜在表示来生成描述符的方法,由于描述符的连续性和可恢复为结构的特性而具有实用价值。然而,目前尚不清楚在ED模型的学习过程中结构是如何被识别的。在本工作中,我们创建了处于不同学习进度的ED模型,并探究了结构信息与学习进度之间的关系。我们通过监测下游任务的准确率以及使用基于子结构的描述符计算的输入-输出子结构相似度,表明化合物子结构在ED模型中被较早地学习到,这提示现有的基于下游任务准确率的评估方法可能不够敏感,难以评估以SMILES作为描述符生成方法的ED模型的性能。另一方面,我们发现结构恢复非常耗时,尤其是学习不充分时会导致模型估计出比实际更大的结构。由此可以推断,确定结构的终点对模型而言是一项困难的任务。据我们所知,这是首个将ED模型对SMILES的学习进度与广泛化学物质的结构联系起来的研究。

英文摘要:

Descriptor generation methods using latent representations of encoder$-$decoder (ED) models with SMILES as input are useful because of the continuity of descriptor and restorability to the structure. However, it is not clear how the structure is recognized in the learning progress of ED models. In this work, we created ED models of various learning progress and investigated the relationship between structural information and learning progress. We showed that compound substructures were learned early in ED models by monitoring the accuracy of downstream tasks and input$-$output substructure similarity using substructure$-$based descriptors, which suggests that existing evaluation methods based on the accuracy of downstream tasks may not be sensitive enough to evaluate the performance of ED models with SMILES as descriptor generation methods. On the other hand, we showed that structure restoration was time$-$consuming, and in particular, insufficient learning led to the estimation of a larger structure than the actual one. It can be inferred that determining the endpoint of the structure is a difficult task for the model. To our knowledge, this is the first study to link the learning progress of SMILES by ED model to chemical structures for a wide range of chemicals.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑