Stochastic simulation algorithms such as likelihood weighting often give fast, accurate approximations to posterior probabilities in probabilistic networks, and are the methods of choice for very large networks. Unfortunately, the special characteristics of dynamic probabilistic networks (DPNs), which are used to represent stochastic temporal processes, mean that standard simulation algorithms perform very poorly. In essence, the simulation trials diverge further and further from reality as the process is observed over time. In this paper, we present simulation algorithms that use the evidence observed at each time step to push the set of trials back towards reality. The first algorithm, "evidence reversal" (ER) restructures each time slice of the DPN so that the evidence nodes for the slice become ancestors of the state variables. The second algorithm, called "survival of the fittest" sampling (SOF), "repopulates" the set of trials at each time step using a stochastic reproduction rate weighted by the likelihood of the evidence according to each trial. We compare the performance of each algorithm with likelihood weighting on the original network, and also investigate the benefits of combining the ER and SOF methods. The ER/SOF combination appears to maintain bounded error independent of the number of time steps in the simulation.
Tufts University(塔夫茨大学);University of Toronto(多伦多大学)
提升概率推理(Poole,2003)和提升随机规划的符号动态规划(Boutilier et al,2001)是在随机系统中使用抽象的算法努力的同时引入的。多年来,这些想法演变成两个不同的研究路线,每一个都有丰富的文献支持。提升概率推理侧重于在有限域假设下对基于模板的图形模型进行有效的算术运算,而符号动态规划侧重于在丰富的量化逻辑动作模型和开放域推理中支持顺序决策。鉴于它们的共同动机,但不同的重点,这两条研究路线产生了高度互补的创新。在本章中,我们的目标是通过从概率推理的角度概述提升的随机规划来帮助缩小这两个研究领域之间的差距,并显示出与本书其他章节的密切联系。这也使我们能够将广义提升推理定义为一种范式,它统一了这些领域,并阐明了未来研究的开放问题,这些问题可以使提升推理和随机规划受益。
Stochastic Diffusion: A Diffusion Probabilistic Model for Stochastic Time Series Forecasting
School of Computing and Information Systems, The University of Melbourne(计算与信息系统学院,墨尔本大学);Department of Surgery (Otolaryngology), The University of Melbourne(外科部门(耳鼻喉科),墨尔本大学);School of Mathematics and Statistics, The University of Melbourne(数学与统计学学院,墨尔本大学)
Encapsulating models and approximate inference programs in probabilistic modules
Computer Science & Artificial Intelligence Laboratory(计算机科学与人工智能实验室);Massachusetts Institute of Technology(麻省理工学院);Department of Brain & Cognitive Sciences(脑与认知科学系)
Equivariant Neural Simulators for Stochastic Spatiotemporal Dynamics
Data and Artificial Intelligence Cluster, Eindhoven University of Technology(埃因霍温理工大学数据与人工智能集群);Swiss Plasma Center, École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院瑞士等离子体中心)
Neuronal Stochastic Attention Circuit (NSAC) for Probabilistic Representation Learning
Department of Automation, University of Science \& Technology of China, Hefei, China;Institute of Artificial Intelligence, Hefei Comprehensive National Science Center
CMOS + stochastic nanomagnets: heterogeneous computers for probabilistic inference and learning
University of California Santa Barbara(加州大学圣巴巴拉分校);Tohoku University(东北大学);Research Institute of Electrical Communication, Tohoku University(东北大学电气通信研究所);Graduate School of Engineering, Tohoku University(东北大学工学研究科)