arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.03363q-bio.BMcs.CLcs.LGstat.ML

提升药物发现中的活性预测模型理解人类语言的能力

Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Language

Johannes Kepler University(约翰内斯·开普勒大学);IARAI

Philipp Seidl, Andreu Vall, Sepp Hochreiter, Günter Klambauer

AI总结:

针对现有活性预测模型需针对新任务微调、科学语言模型零样本/少样本活性预测质量不足的问题,提出含化学与自然语言独立模块、采用对比预训练的CLAMP方法,提升药物发现场景下少样本、零样本活性预测性能。

摘要:

活性与性质预测模型是药物发现和材料科学领域的核心工具,但目前这类模型必须针对新任务进行训练或微调。若无需训练或微调,科学语言模型可凭借其宣称的零样本和少样本能力,应用于此类低数据量任务。然而,这类模型在活性预测方面的预测质量仍有不足。在本研究中,我们构想了一种新型活性预测模型,该模型能够在推理阶段通过理解描述任务的文本信息,适配新的预测任务。为此,我们提出了一种全新架构,包含分别处理化学输入与自然语言输入的独立模块,并设计了基于大型生化数据库数据的对比预训练目标。在大量实验中,我们证明所提方法CLAMP在药物发现领域的少样本学习基准和零样本问题上均取得了更优的预测性能。我们将该方法的性能提升归因于模块化架构和所设计的预训练目标。

英文摘要:

Activity and property prediction models are the central workhorses in drug discovery and materials sciences, but currently they have to be trained or fine-tuned for new tasks. Without training or fine-tuning, scientific language models could be used for such low-data tasks through their announced zero- and few-shot capabilities. However, their predictive quality at activity prediction is lacking. In this work, we envision a novel type of activity prediction model that is able to adapt to new prediction tasks at inference time, via understanding textual information describing the task. To this end, we propose a new architecture with separate modules for chemical and natural language inputs, and a contrastive pre-training objective on data from large biochemical databases. In extensive experiments, we show that our method CLAMP yields improved predictive performance on few-shot learning benchmarks and zero-shot problems in drug discovery. We attribute the advances of our method to the modularized architecture and to our pre-training objective.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑