arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.01375cs.LGcs.AI
收藏

贝叶斯逆问题邂逅流匹配:基于Transformer的高效灵活推断

Bayesian Inverse Problems Meet Flow Matching: Efficient and Flexible Inference via Transformers

Skolkovo Institute of Science and Technology(斯克洛夫学院科学与技术研究所);Sberbank(储蓄银行);AI4S Center(AI4S中心);Artificial Intelligence Research Institute(人工智能研究 institute)

Daniil Sherki, Ivan Oseledets, Ekaterina Muravleva

AI总结:

针对传统采样方法求解贝叶斯逆问题成本高的问题,提出融合条件流匹配与Transformer的框架,直接学习条件概率轨迹,在三类任务上实现低至1.5%的参数恢复误差,CPU上推断速度最高提升2000倍。

摘要:

传统采样方法计算成本高昂,贝叶斯逆问题的高效求解仍是一大挑战。本文提出一种将条件流匹配(Conditional Flow Matching, CFM)与基于Transformer的架构相结合的新型框架,可从复杂后验分布中实现快速灵活的采样。该方法直接从数据中学习条件概率轨迹,借助CFM绕过迭代仿真的特性,以及Transformer处理任意数量观测值的能力。研究将该框架应用于三类问题以验证有效性:简单非线性模型、疾病动力学框架、二维达西流偏微分方程。主要结果表明,参数恢复的相对误差低至1.5%,在CPU上的推断时间与马尔可夫链蒙特卡洛方法相比最多缩短2000倍。该框架通过从学习到的条件分布中采样,可助力快速求解贝叶斯问题。

英文摘要:

The efficient resolution of Bayesian inverse problems remains challenging due to the high computational cost of traditional sampling methods. In this paper, we propose a novel framework that integrates Conditional Flow Matching (CFM) with a transformer-based architecture to enable fast and flexible sampling from complex posterior distributions. The proposed methodology involves the direct learning of conditional probability trajectories from the data, leveraging CFM's ability to bypass iterative simulation and transformers' capacity to process arbitrary numbers of observations. The efficacy of the proposed framework is demonstrated through its application to three problems: a simple nonlinear model, a disease dynamics framework, and a two-dimensional Darcy flow Partial Differential Equation. The primary outcomes demonstrate that the relative errors in parameters recovery are as low as 1.5%, and that the inference time is reduced by up to 2000 times on CPU in comparison with the Monte Carlo Markov Chain. This framework facilitates the expeditious resolution of Bayesian problems through the utilisation of sampling from the learned conditional distribution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑