arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2302.00615cs.LG
收藏

用于AI驱动科学发现的GFlowNets

GFlowNets for AI-Driven Scientific Discovery

Mila Quebec AI Institute(米拉魁北克人工智能研究所);McGill University(麦吉尔大学);IVADO(IVADO数据价值研究所)

Moksh Jain, Tristan Deleu, Jason Hartford, Cheng-Hao Liu, Alex Hernandez-Garcia, Yoshua Bengio

AI总结:

本文提出概率机器学习框架GFlowNets,通过学习从非归一化奖励分布中采样以生成多样候选者,并提供贝叶斯后验估计来驱动实验设计,从而高效探索极大搜索空间,助力AI驱动的科学与材料发现。

摘要:

解决人类面临的最紧迫问题,如气候危机和全球大流行病的威胁,需要加快科学发现的步伐。虽然传统上科学在很大程度上依赖试错甚至偶然性,但过去几十年来数据驱动的科学发现激增。然而,为了真正利用大规模数据集和高通量实验装置,机器学习方法需要进一步改进并更好地整合到科学发现流程中。在这种背景下,当前机器学习方法面临的一个关键挑战是对极大搜索空间的高效探索,这需要估计可约简(认知)不确定性并生成一系列多样且信息丰富的实验来执行。这促使了一种名为GFlowNets的新概率机器学习框架的出现,该框架可应用于实验科学循环的建模、假设生成和实验设计阶段。GFlowNets学习从由对应于非归一化概率的奖励函数间接给出的分布中进行采样,从而能够采样多样且高奖励的候选者。GFlowNets还可用于形成高效的、摊销的贝叶斯后验估计器,用于以已获取的实验数据为条件的因果模型。拥有这样的后验模型可以提供认知不确定性和信息增益的估计器,从而驱动实验设计策略。总而言之,我们将在此论证GFlowNets可以成为AI驱动科学发现的有价值工具,特别是在我们能够获得廉价但不准确的测量结果或昂贵但准确的测量结果的极大候选空间场景中。这是药物和材料发现背景下的常见设置,我们在整篇论文中将其作为示例。

英文摘要:

Tackling the most pressing problems for humanity, such as the climate crisis and the threat of global pandemics, requires accelerating the pace of scientific discovery. While science has traditionally relied on trial and error and even serendipity to a large extent, the last few decades have seen a surge of data-driven scientific discoveries. However, in order to truly leverage large-scale data sets and high-throughput experimental setups, machine learning methods will need to be further improved and better integrated in the scientific discovery pipeline. A key challenge for current machine learning methods in this context is the efficient exploration of very large search spaces, which requires techniques for estimating reducible (epistemic) uncertainty and generating sets of diverse and informative experiments to perform. This motivated a new probabilistic machine learning framework called GFlowNets, which can be applied in the modeling, hypotheses generation and experimental design stages of the experimental science loop. GFlowNets learn to sample from a distribution given indirectly by a reward function corresponding to an unnormalized probability, which enables sampling diverse, high-reward candidates. GFlowNets can also be used to form efficient and amortized Bayesian posterior estimators for causal models conditioned on the already acquired experimental data. Having such posterior models can then provide estimators of epistemic uncertainty and information gain that can drive an experimental design policy. Altogether, here we will argue that GFlowNets can become a valuable tool for AI-driven scientific discovery, especially in scenarios of very large candidate spaces where we have access to cheap but inaccurate measurements or to expensive but accurate measurements. This is a common setting in the context of drug and material discovery, which we use as examples throughout the paper.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑