arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.20294cs.LGcs.AIphysics.chem-ph
收藏

用于化学任务的贝叶斯流网络框架

A Bayesian Flow Network Framework for Chemistry Tasks

Hiroshima University(广岛大学)

Nianze Tao, Minori Abe

AI总结:

本文提出基于贝叶斯流网络的语言模型ChemBFN,通过新精度调度降低重建损失以提升分子生成质量,并支持条件生成及下游任务微调,实现最先进性能,为构建一体化单一模块模型开辟了道路。

摘要:

在这项工作中,我们介绍了ChemBFN,这是一种基于处理离散数据的贝叶斯流网络来完成化学任务的语言模型。我们提出了一种新的精度调度,通过显著降低重建损失来提高采样质量。我们提供了证据,表明我们的方法适合生成具有满意多样性的分子,即使在使用较少的采样步骤时也是如此。一种无分类器引导方法被改编用于条件生成。还值得指出的是,在生成训练之后,我们的模型可以在回归和分类任务上进行微调,并具有最先进的性能,这开启了以单一模块风格构建一体化模型的大门。我们的模型已在 https://github.com/Augus1999/bayesian-flow-network-for-chemistry 开源。

英文摘要:

In this work, we introduce ChemBFN, a language model that handles chemistry tasks based on Bayesian flow networks working on discrete data. A new accuracy schedule is proposed to improve the sampling quality by significantly reducing the reconstruction loss. We show evidence that our method is appropriate for generating molecules with satisfied diversity even when a smaller number of sampling steps is used. A classifier-free guidance method is adapted for conditional generation. It is also worthwhile to point out that after generative training, our model can be fine-tuned on regression and classification tasks with the state-of-the-art performance, which opens the gate of building all-in-one models in a single module style. Our model has been open sourced at https://github.com/Augus1999/bayesian-flow-network-for-chemistry.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑