arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.00599cs.LGstat.CO
收藏

基于自适应随机邻域信息MCMC的结构学习

Structure Learning with Adaptive Random Neighborhood Informed MCMC

The Alan Turing Institute(艾伦·图灵研究所);University College London(伦敦大学学院)

Alberto Caron, Xitong Liang, Samuel Livingstone, Jim Griffin

AI总结:

本文提出PARNI-DAG采样器,结合自适应随机邻域提议和基于骨架图的预调优,实现观测数据下DAG结构的高效全贝叶斯后验采样,在高维高相关场景中具有更好的混合性能和准确性。

摘要:

本文提出了一种新颖的MCMC采样器PARNI-DAG,用于在观测数据下以全贝叶斯方法解决结构学习问题。在因果充分性假设下,该算法允许直接从有向无环图(DAG)的后验分布中进行近似采样。PARNI-DAG通过局部信息的自适应随机邻域提议来高效采样DAG,从而获得更好的混合性能。此外,为确保节点数量增加时具有更好的可扩展性,我们将PARNI-DAG与采样器参数的预调优过程相结合,该过程利用通过某些基于约束或基于评分的算法得到的骨架图。得益于这些新特性,PARNI-DAG能快速收敛到高概率区域,并且在高维设置中节点间存在高相关性时更不容易陷入局部模态。在介绍PARNI-DAG的技术创新之后,我们通过多种实验实证展示了其在学习DAG结构方面的混合效率和准确性。

英文摘要:

In this paper, we introduce a novel MCMC sampler, PARNI-DAG, for a fully-Bayesian approach to the problem of structure learning under observational data. Under the assumption of causal sufficiency, the algorithm allows for approximate sampling directly from the posterior distribution on Directed Acyclic Graphs (DAGs). PARNI-DAG performs efficient sampling of DAGs via locally informed, adaptive random neighborhood proposal that results in better mixing properties. In addition, to ensure better scalability with the number of nodes, we couple PARNI-DAG with a pre-tuning procedure of the sampler's parameters that exploits a skeleton graph derived through some constraint-based or scoring-based algorithms. Thanks to these novel features, PARNI-DAG quickly converges to high-probability regions and is less likely to get stuck in local modes in the presence of high correlation between nodes in high-dimensional settings. After introducing the technical novelties in PARNI-DAG, we empirically demonstrate its mixing efficiency and accuracy in learning DAG structures on a variety of experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑