arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.05309cs.LG
收藏

生成流网络的泛化行为研究

Investigating Generalization Behaviours of Generative Flow Networks

University of Toronto(多伦多大学);Vector Institute(矢量研究所);Valence Labs(valence实验室)

Lazar Atanackovic, Emmanuel Bengio

AI总结:

本研究针对生成流网络(GFNs)的泛化行为展开实证分析,通过构建新的基于图的基准环境,验证了GFNs近似函数的隐式结构可促进泛化,同时发现其对离线/离策略训练敏感但隐式学习的奖励对训练分布变化鲁棒。

摘要:

生成流网络(Generative Flow Networks, GFNs)是一种在离散空间上学习非归一化概率质量函数的生成框架。自提出以来,GFNs已被证明在训练期间离散空间大部分未被访问的应用场景中,对学习生成模型十分有用。这启发部分研究者假设:当GFNs与深度神经网络(DNNs)结合时,具有良好的泛化特性。本研究通过实验验证GFNs泛化的部分假设机制。为此,我们引入了一个新的基于图的基准环境,该环境可轻松调整奖励难度,能精确计算p(x),还能构建未见过的测试集以量化泛化性能。利用该环境,我们系统测试了GFNs泛化的假设机制,并提出了一组总结研究结果的实证观察。具体而言,我们发现(并证实)GFNs学习近似的函数具有促进泛化的隐式底层结构;但意外且与现有认知略有矛盾的是,GFNs对离线和离策略训练敏感,不过其隐式学习的奖励对训练分布的变化具有鲁棒性。

英文摘要:

Generative Flow Networks (GFlowNets, GFNs) are a generative framework for learning unnormalized probability mass functions over discrete spaces. Since their inception, GFlowNets have proven to be useful for learning generative models in applications where the majority of the discrete space is unvisited during training. This has inspired some to hypothesize that GFlowNets, when paired with deep neural networks (DNNs), have favorable generalization properties. In this work, we empirically verify some of the hypothesized mechanisms of generalization of GFlowNets. We accomplish this by introducing a novel graph-based benchmark environment where reward difficulty can be easily varied, $p(x)$ can be computed exactly, and an unseen test set can be constructed to quantify generalization performance. Using this graph-based environment, we are able to systematically test the hypothesized mechanisms of generalization of GFlowNets and put forth a set of empirical observations that summarize our findings. In particular, we find (and confirm) that the functions that GFlowNets learn to approximate have an implicit underlying structure which facilitate generalization. Surprisingly -- and somewhat contradictory to existing knowledge -- we also find that GFlowNets are sensitive to being trained offline and off-policy. However, the reward implicitly learned by GFlowNets is robust to changes in the training distribution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑