抗真菌与抗细菌领域间迁移学习的共生消息传递模型
Symbiotic Message Passing Model for Transfer Learning between Anti-Fungal and Anti-Bacterial Domains
AI总结:
本文提出共生消息传递神经网络(SMPNN),通过在来自不同领域的图神经网络之间建立新的消息传递通道来融合模型,实现从抗细菌活性到抗真菌活性的迁移学习,实验表明其性能优于标准迁移学习方法且更稳定。
摘要:
机器学习,尤其是表示学习,有潜力通过筛选数十亿种化合物来促进药物发现。例如,一种成功的方法是将分子表示为图并利用图神经网络(GNN)。然而,这些方法仍然需要数千种化合物的实验测量来构建合适的训练集。虽然在某些领域获取实验数据较为容易,但在其他领域可能更为有限。例如,在细菌上测试化合物比进行体内实验更容易。因此,一个关键问题是如何利用来自大型可用数据集的信息以及同时测量两个领域的小型化合物子集,来预测化合物对第二个实验上较难获得的领域的影响。当前用于药物发现的迁移学习方法,包括预训练模块的训练或元学习,取得的成功有限。在这项工作中,我们开发了一种新方法,名为共生消息传递神经网络(SMPNN),用于合并来自不同领域的图神经网络模型。通过在它们之间路由新的消息传递通道,我们的方法解决了不同领域之间的一些潜在冲突,以及由较大数据集引起的隐式约束。通过收集公共数据并进行额外的高通量实验,我们通过从抗细菌活性预测抗真菌活性来证明我们方法的优势。我们将我们的方法与标准迁移学习方法进行比较,并表明SMPNN提供了更好且波动更小的性能。我们的方法是通用的,可用于促进任意两个领域之间的信息传递,例如不同生物体、不同细胞器或不同环境之间。
英文摘要:
Machine learning, and representation learning in particular, has the potential to facilitate drug discovery by screening billions of compounds. For example, a successful approach is representing the molecules as a graph and utilizing graph neural networks (GNN). Yet, these approaches still require experimental measurements of thousands of compounds to construct a proper training set. While in some domains it is easier to acquire experimental data, in others it might be more limited. For example, it is easier to test the compounds on bacteria than perform in-vivo experiments. Thus, a key question is how to utilize information from a large available dataset together with a small subset of compounds where both domains are measured to predict compounds' effect on the second, experimentally less available domain. Current transfer learning approaches for drug discovery, including training of pre-trained modules or meta-learning, have limited success. In this work, we develop a novel method, named Symbiotic Message Passing Neural Network (SMPNN), for merging graph-neural-network models from different domains. Using routing new message passing lanes between them, our approach resolves some of the potential conflicts between the different domains, and implicit constraints induced by the larger datasets. By collecting public data and performing additional high-throughput experiments, we demonstrate the advantage of our approach by predicting anti-fungal activity from anti-bacterial activity. We compare our method to the standard transfer learning approach and show that SMPNN provided better and less variable performances. Our approach is general and can be used to facilitate information transfer between any two domains such as different organisms, different organelles, or different environments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。