arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.04544math.NAcs.NAmath.OCstat.CO
收藏

基于近似原始对偶不动点的非光滑凸势能 Langevin 算法

Approximate Primal-Dual Fixed-Point based Langevin Algorithms for Non-smooth Convex Potentials

Ziruo Cai, Jinglai Li, Xiaoqun Zhang

AI总结:

针对贝叶斯推断中非光滑后验分布采样难题,提出一种近似原始对偶不动点算法来近似求解每次迭代中的近邻子问题,在保证理论分析的同时大幅降低了计算成本。

摘要:

Langevin 算法常用于在贝叶斯推断中采样后验分布。然而,在许多实际问题中,后验分布通常包含不可微成分,给标准 Langevin 算法带来了挑战,因为它们需要在每次迭代中评估能量函数的梯度。为此,一种常用的补救措施是利用近邻算子,结果就是需要在每次迭代中求解一个近邻子问题。常规做法是精确求解这些子问题,这可能会极其昂贵,因为子问题需要在每次迭代中被求解。我们提出了一种近似原始对偶不动点算法来求解该子问题,它仅寻求子问题的近似解,从而大幅降低了计算成本。我们对所提出的方法进行了理论分析,并通过数值示例展示了其性能。

英文摘要:

The Langevin algorithms are frequently used to sample the posterior distributions in Bayesian inference. In many practical problems, however, the posterior distributions often consist of non-differentiable components, posing challenges for the standard Langevin algorithms, as they require to evaluate the gradient of the energy function in each iteration. To this end, a popular remedy is to utilize the proximity operator, and as a result one needs to solve a proximity subproblem in each iteration. The conventional practice is to solve the subproblems accurately, which can be exceedingly expensive, as the subproblem needs to be solved in each iteration. We propose an approximate primal-dual fixed-point algorithm for solving the subproblem, which only seeks an approximate solution of the subproblem and therefore reduces the computational cost considerably. We provide theoretical analysis of the proposed method and also demonstrate its performance with numerical examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑