arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.02703math.NAcs.NAmath.STstat.TH
收藏

多保真度 No-U-Turn 采样

Multi-fidelity No-U-Turn Sampling

Kislaya Ravi, Tobias Neckel, Hans-Joachim Bungartz

AI总结:

本文提出多保真度 No-U-Turn 采样方法,通过构建多保真度高斯过程代理模型近似目标密度函数的导数,将主要计算分配给廉价模型以降低计算代价,并利用最高保真度模型进行 Metropolis Hastings 接受/拒绝,实验表明该方法优于现有方法。

摘要:

马尔可夫链蒙特卡洛(MCMC)方法在高度相关或高维目标密度函数上通常需要大量迭代才能收敛。哈密顿蒙特卡洛(HMC)或 No-U-Turn 采样(NUTS)等方法利用密度函数的一阶导数来解决上述问题。然而,对于计算代价高昂的模型,导数的计算构成了一个瓶颈。我们提出首先构建一个多保真度高斯过程(GP)代理模型。该多保真度代理模型的基本构建模块是一个由近似误差递减、计算代价递增的模型组成的层次结构。然后,利用生成的多保真度代理模型来近似导数。大部分计算被分配给廉价模型,从而降低整体计算代价。多保真度方法的导数被用于探索目标密度函数并生成提议。我们使用最高保真度模型,依据 Metropolis Hastings 准则接受或拒绝提议,从而确保所提方法相对于最高保真度密度函数具有遍历性。我们将所提方法应用于三个测试案例,其中包括一些众所周知的基准,以与现有方法进行比较,并表明多保真度 No-U-turn 采样优于其他方法。

英文摘要:

Markov Chain Monte Carlo (MCMC) methods often take many iterations to converge for highly correlated or high-dimensional target density functions. Methods such as Hamiltonian Monte Carlo (HMC) or No-U-Turn Sampling (NUTS) use the first-order derivative of the density function to tackle the aforementioned issues. However, the calculation of the derivative represents a bottleneck for computationally expensive models. We propose to first build a multi-fidelity Gaussian Process (GP) surrogate. The building block of the multi-fidelity surrogate is a hierarchy of models of decreasing approximation error and increasing computational cost. Then the generated multi-fidelity surrogate is used to approximate the derivative. The majority of the computation is assigned to the cheap models thereby reducing the overall computational cost. The derivative of the multi-fidelity method is used to explore the target density function and generate proposals. We select or reject the proposals using the Metropolis Hasting criterion using the highest fidelity model which ensures that the proposed method is ergodic with respect to the highest fidelity density function. We apply the proposed method to three test cases including some well-known benchmarks to compare it with existing methods and show that multi-fidelity No-U-turn sampling outperforms other methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑