arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.00568cs.LGcs.AI
收藏

基于能量的GFlowNets一致性训练离散联合分布建模

Consistent Training via Energy-Based GFlowNets for Modeling Discrete Joint Distributions

Mila(米拉研究所);Université de Montréal(蒙特利尔大学);IBM Thomas J Watson Research Center(IBM托马斯·J·沃森研究中心)

Chanakya Ekbote, Moksh Jain, Payel Das, Yoshua Bengio

摘要:

生成流网络(GFlowNets)已经证明了在给定奖励函数$R(x)$的情况下生成不同离散对象$x$的显著性能改进,该奖励函数指示对象的效用,并且通过监督学习独立于GFlowNet进行训练以预测给定$x$的期望属性$y$。我们假设,这可能会导致在训练$R$和训练GFlowNet中的归纳优化偏差之间的不兼容,可能导致更差的样本和对分布变化的缓慢适应。在这项工作中,我们建立在最近与GFlowNets联合学习基于能量的模型的基础上,并将其扩展到学习多个变量的联合,我们称之为基于能量的联合GFlowNets(JEBGFNs),例如肽序列及其抗菌活性。基于能量的模型的联合学习用作GFlowNet的奖励,可以解决不兼容的问题,因为奖励函数$R$和GFlowNet采样器都是联合训练的。我们发现,这种联合训练或联合基于能量的制剂导致产生抗微生物肽的显著改善。由于训练序列来自进化或人工选择高抗生素活性,因此推测序列分布中存在某种结构,揭示了有关抗生素活性的信息。这导致了对它们的联合生成建模相对于纯判别建模的优势。我们还评估了JEBGFN在主动学习环境中发现抗菌肽。

英文摘要:

Generative Flow Networks (GFlowNets) have demonstrated significant performance improvements for generating diverse discrete objects $x$ given a reward function $R(x)$, indicating the utility of the object and trained independently from the GFlowNet by supervised learning to predict a desirable property $y$ given $x$. We hypothesize that this can lead to incompatibility between the inductive optimization biases in training $R$ and in training the GFlowNet, potentially leading to worse samples and slow adaptation to changes in the distribution. In this work, we build upon recent work on jointly learning energy-based models with GFlowNets and extend it to learn the joint over multiple variables, which we call Joint Energy-Based GFlowNets (JEBGFNs), such as peptide sequences and their antimicrobial activity. Joint learning of the energy-based model, used as a reward for the GFlowNet, can resolve the issues of incompatibility since both the reward function $R$ and the GFlowNet sampler are trained jointly. We find that this joint training or joint energy-based formulation leads to significant improvements in generating anti-microbial peptides. As the training sequences arose out of evolutionary or artificial selection for high antibiotic activity, there is presumably some structure in the distribution of sequences that reveals information about the antibiotic activity. This results in an advantage to modeling their joint generatively vs. pure discriminative modeling. We also evaluate JEBGFN in an active learning setting for discovering anti-microbial peptides.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑