arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.07657cs.LGcs.CEq-bio.BM
收藏

大语言模型对药物分子结构片段级理解的实证证据

Empirical Evidence for the Fragment level Understanding on Drug Molecular Structure of LLMs

Tsinghua University(清华大学);Microsoft Research AI4Science(微软研究院AI4Science)

Xiuyuan Hu, Guoqing Liu, Yang Zhao, Hao Zhang

AI总结:

本文通过预训练并微调基于SMILES的transformer模型,实证发现语言模型能从分子片段角度理解化学结构,且微调所得结构知识体现在生成的高频SMILES子串中。

摘要:

AI驱动的药物发现近年来一直是研究热点,基于SMILES的语言模型在药物分子设计中的应用日益广泛。然而,尚无工作探索语言模型是否以及如何从一维序列中理解化学空间结构。在本工作中,我们在化学语言上预训练了一个transformer模型,并针对药物设计目标对其进行微调,同时研究了高频SMILES子串与分子片段之间的对应关系。结果表明,语言模型能够从分子片段的角度理解化学结构,并且通过微调学到的结构知识反映在模型生成的高频SMILES子串中。

英文摘要:

AI for drug discovery has been a research hotspot in recent years, and SMILES-based language models has been increasingly applied in drug molecular design. However, no work has explored whether and how language models understand the chemical spatial structure from 1D sequences. In this work, we pre-train a transformer model on chemical language and fine-tune it toward drug design objectives, and investigate the correspondence between high-frequency SMILES substrings and molecular fragments. The results indicate that language models can understand chemical structures from the perspective of molecular fragments, and the structural knowledge learned through fine-tuning is reflected in the high-frequency SMILES substrings generated by the model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑