arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.19366cs.LGstat.ML

基于单个生成流网络的图结构与参数的联合贝叶斯推断

Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Network

Tristan Deleu, Mizu Nishikawa-Toomey, Jithendaraa Subramanian, Esmeralda S. Whitammer, Laurent Charlin, Yoshua Bengio

AI总结:

本文提出名为JSP-GFN的方法,用单个生成流网络联合推断贝叶斯网络的图结构与参数,该方法在模拟和真实数据上的表现优于现有方法,可准确近似联合后验分布。

摘要:

生成流网络(GFlowNets)是一类针对离散和结构化样本空间的生成模型,此前已被应用于在给定观测数据集的条件下推断贝叶斯网络有向无环图(DAG)的边际后验分布问题。基于该框架扩展至非离散样本空间的最新进展,本文提出用单个GFlowNet来近似贝叶斯网络结构及其条件概率分布参数的联合后验分布。该GFlowNet的采样策略遵循两阶段过程:首先依次生成DAG的每条边,待完整结构确定后再选取对应参数。由于参数被纳入后验分布,这为贝叶斯网络的局部概率模型提供了更高灵活性,使本文方法甚至适用于由神经网络参数化的非线性模型。实验结果表明,本文提出的名为JSP-GFN的方法可准确近似联合后验分布,在模拟数据和真实数据上的表现均优于现有方法。

英文摘要:

Generative Flow Networks (GFlowNets), a class of generative models over discrete and structured sample spaces, have been previously applied to the problem of inferring the marginal posterior distribution over the directed acyclic graph (DAG) of a Bayesian Network, given a dataset of observations. Based on recent advances extending this framework to non-discrete sample spaces, we propose in this paper to approximate the joint posterior over not only the structure of a Bayesian Network, but also the parameters of its conditional probability distributions. We use a single GFlowNet whose sampling policy follows a two-phase process: the DAG is first generated sequentially one edge at a time, and then the corresponding parameters are picked once the full structure is known. Since the parameters are included in the posterior distribution, this leaves more flexibility for the local probability models of the Bayesian Network, making our approach applicable even to non-linear models parametrized by neural networks. We show that our method, called JSP-GFN, offers an accurate approximation of the joint posterior, while comparing favorably against existing methods on both simulated and real data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑