The monitoring and control of any dynamic system depends crucially on the ability to reason about its current status and its future trajectory. In the case of a stochastic system, these tasks typically involve the use of a belief state- a probability distribution over the state of the process at a given point in time. Unfortunately, the state spaces of complex processes are very large, making an explicit representation of a belief state intractable. Even in dynamic Bayesian networks (DBNs), where the process itself can be represented compactly, the representation of the belief state is intractable. We investigate the idea of maintaining a compact approximation to the true belief state, and analyze the conditions under which the errors due to the approximations taken over the lifetime of the process do not accumulate to make our answers completely irrelevant. We show that the error in a belief state contracts exponentially as the process evolves. Thus, even with multiple approximations, the error in our process remains bounded indefinitely. We show how the additional structure of a DBN can be used to design our approximation scheme, improving its performance significantly. We demonstrate the applicability of our ideas in the context of a monitoring task, showing that orders of magnitude faster inference can be achieved with only a small degradation in accuracy.
Tractable Representation Learning with Probabilistic Circuits
Technische Universität Darmstadt(达姆施塔特工业大学);University of Texas, Dallas(德克萨斯大学达拉斯分校);University of Edinburgh(爱丁堡大学);Universität Bremen(不来梅大学);University of Texas at Dallas(德克萨斯大学达拉斯分校)
A Tractable Inference Algorithm for Diagnosing Multiple Diseases
我们研究了一个诊断多种疾病的概率模型。在该模型中,疾病和发现被表示为二元变量。此外,疾病是边缘独立的,特征在给定疾病实例的情况下是有条件独立的,并且疾病通过嘈杂的OR门相互作用以产生发现。一种算法,用于计算后验概率的每种疾病,给出了一组观察到的结果,称为quickscore。该算法的时间复杂度为O(nm-2 m+),其中n为疾病数,m+为阳性发现数,m-为阴性发现数。虽然quickscore i 5的时间复杂度与阳性发现的数量成指数关系,但该算法在实践中是有用的,因为观察到的阳性发现的数量通常远小于所考虑的疾病的数量。快速评分应用于快速医疗参考(QMR)的概率版本的性能结果。
Tractable Inference in Credal Sentential Decision Diagrams
Istituto Dalle Molle di Studi per l’Intelligenza Artificiale(达勒·莫勒人工智能研究所);Institute of Mathematics and Statistics, University of São Paulo(圣保罗大学数学与统计研究所)
Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院)
Demystifying LLM-as-a-Judge: Analytically Tractable Model for Inference-Time Scaling
John A. Paulson School of Engineering And Applied Sciences, Harvard University(哈佛大学约翰·A·保罗森工程与应用科学学院);Center for Brain Science, Harvard University(哈佛大学脑科学中心);Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University(哈佛大学自然与人工智能研究学院)
Hybrid Probabilistic Inference with Logical Constraints: Tractability and Message Passing
University of California, LA(加利福尼亚大学洛杉矶分校);AMSS(数学与系统科学研究院);Chinese Academy of Sciences(中国科学院);DISI(信息工程与计算机科学系);University of Trento(特伦托大学)
加权模型集成(Weighted Model Integration,简称WMM)是一个非常吸引人的概率推理框架:它允许通过可满足性模理论(Satisfiability Modulo Theories,简称SMT)的语言来表达真实世界混合场景的复杂依赖关系,其中变量在本质上是异构的(包括连续和离散);以及计算具有任意复杂逻辑约束的概率查询。最近的工作表明,在某些假设下,可简化的模型集成(MI)问题,从而有效地允许混合概率推理的体积计算。在本文中,我们介绍了一种新的制定MI通过消息传递计划,允许有效地计算的边际密度和统计矩的所有变量在线性时间。因此,当任意丰富的MI查询符合问题结构时,我们能够摊销推理,这里表示为与SMT公式相关联的原始图。此外,我们从理论上跟踪的易处理边界的确切MI。事实上,我们证明,在原始图的结构要求,使我们的MI算法易于处理-边界的直径和树宽-边界不仅是足够的,但通过MI易于推理的必要条件。
Tufts University(塔夫茨大学);University of Toronto(多伦多大学)
提升概率推理(Poole,2003)和提升随机规划的符号动态规划(Boutilier et al,2001)是在随机系统中使用抽象的算法努力的同时引入的。多年来,这些想法演变成两个不同的研究路线,每一个都有丰富的文献支持。提升概率推理侧重于在有限域假设下对基于模板的图形模型进行有效的算术运算,而符号动态规划侧重于在丰富的量化逻辑动作模型和开放域推理中支持顺序决策。鉴于它们的共同动机,但不同的重点,这两条研究路线产生了高度互补的创新。在本章中,我们的目标是通过从概率推理的角度概述提升的随机规划来帮助缩小这两个研究领域之间的差距,并显示出与本书其他章节的密切联系。这也使我们能够将广义提升推理定义为一种范式,它统一了这些领域,并阐明了未来研究的开放问题,这些问题可以使提升推理和随机规划受益。
Probabilistic Circuits That Know What They Don't Know
TU Darmstadt(达姆施塔特工业大学);Hessian Center for AI (hessian.AI)(黑森人工智能中心);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Centre for Cognitive Science TU Darmstadt(达姆施塔特工业大学认知科学中心)
Spintronics based Stochastic Computing for Efficient Bayesian Inference System
Fert Beijing Research Institute, BDBC, School of Electronic and Information Engineering(费尔北京研究院,大数据科学与脑机智能高精尖创新中心,电子信息工程学院);Fert Beijing Research Institute, BDBC, School of Computer Science and Engineering(费尔北京研究院,大数据科学与脑机智能高精尖创新中心,计算机科学与工程学院);Department of Electrical and Computer Engineering, Duke University(杜克大学电气与计算机工程系);Beihang University(北京航空航天大学)