arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.03038math.STstat.COstat.MEstat.TH
收藏

偏斜 Bernstein-von Mises 定理与偏斜众数近似

Skewed Bernstein-von Mises theorem and skew-modal approximations

Daniele Durante, Francesco Pozza, Botond Szabo

AI总结:

本文提出基于三阶 Laplace 方法的偏斜对称分布族闭式后验近似,其全变差收敛速率比经典 Bernstein-von Mises 定理至少提高一个数量级,并给出实用的偏斜众数近似及实验验证。

摘要:

在贝叶斯统计中,当目标后验分布难以处理时,通常采用高斯近似以简化推断。尽管这类近似可由 Bernstein-von Mises 型结果在渐近意义上加以证明,但在实际中,预期的高斯行为可能无法很好地刻画后验分布的形状,从而影响近似精度。基于这些考虑,我们推导出一类改进的后验分布闭式近似,该近似源于对三阶 Laplace 方法的一种新处理,可在一类易于处理的偏斜对称分布族中得到近似。在允许模型设定错误和非独立同分布情形的一般假设下,证明该近似族与目标后验之间的全变差距离的收敛速率比经典 Bernstein-von Mises 定理所建立的速率至少提高一个数量级。将该结果专门用于正则参数模型的情形表明,对于多项式有界的后验泛函,同样可以获得近似精度的相同改进。与其他高阶近似不同,我们的结果证明,有可能推导出闭式且有效的密度,这些密度在实际中预期能够为目标后验的高斯近似提供一种更精确但同样易于处理的替代方案,同时继承其极限频率性质。我们通过为联合后验和边际后验发展一种实用的偏斜众数近似来强化上述论证,该近似通过将未知模型参数替换为相应的 MAP 估计,达到与其理论对应物相同的理论保证。实证研究证实,我们的理论结果与实际中观察到的显著性能高度吻合,即使在有限的、可能很小的样本情形下也是如此。

英文摘要:

Gaussian approximations are routinely employed in Bayesian statistics to ease inference when the target posterior is intractable. Although these approximations are asymptotically justified by Bernstein-von Mises type results, in practice the expected Gaussian behavior may poorly represent the shape of the posterior, thus affecting approximation accuracy. Motivated by these considerations, we derive an improved class of closed-form approximations of posterior distributions which arise from a new treatment of a third-order version of the Laplace method yielding approximations in a tractable family of skew-symmetric distributions. Under general assumptions which account for misspecified models and non-i.i.d. settings, this family of approximations is shown to have a total variation distance from the target posterior whose rate of convergence improves by at least one order of magnitude the one established by the classical Bernstein-von Mises theorem. Specializing this result to the case of regular parametric models shows that the same improvement in approximation accuracy can be also derived for polynomially bounded posterior functionals. Unlike other higher-order approximations, our results prove that it is possible to derive closed-form and valid densities which are expected to provide, in practice, a more accurate, yet similarly-tractable, alternative to Gaussian approximations of the target posterior, while inheriting its limiting frequentist properties. We strengthen such arguments by developing a practical skew-modal approximation for both joint and marginal posteriors that achieves the same theoretical guarantees of its theoretical counterpart by replacing the unknown model parameters with the corresponding MAP estimate. Empirical studies confirm that our theoretical results closely match the remarkable performance observed in practice, even in finite, possibly small, sample regimes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑