拉普拉斯近似的概率诊断方法:引言与实验
A probabilistic diagnostic for Laplace approximations: Introduction and experimentation
AI总结:
针对拉普拉斯近似的有效性依赖函数真实形状的问题,提出基于概率数值框架的非渐近诊断检验方法,以少量计算验证其假设可行性,并探讨了优化方法与高维挑战。
摘要:
许多模型需要计算高维函数的积分,例如为了获取边际似然。这类积分可能难以解析求解,或数值计算的成本过高。对此我们可以使用拉普拉斯近似(Laplace approximation, LA)。当函数与正态密度成比例时,LA是精确的,因此其有效性取决于函数的真实形状。本文提出利用概率数值框架开发一种针对LA及其底层形状假设的诊断方法,将函数及其积分建模为高斯过程,并通过以有限个函数值为条件设计出一种“检验”。该检验完全是非渐近的,并非旨在完全替代数值积分,而是仅用于以最少的计算量检验LA所依赖假设的可行性。我们讨论了优化和设计该检验的方法,将其应用于已知的样本函数,并指出了高维场景下的挑战。
英文摘要:
Many models require integrals of high-dimensional functions: for instance, to obtain marginal likelihoods. Such integrals may be intractable, or too expensive to compute numerically. Instead, we can use the Laplace approximation (LA). The LA is exact if the function is proportional to a normal density; its effectiveness therefore depends on the function's true shape. Here, we propose the use of the probabilistic numerical framework to develop a diagnostic for the LA and its underlying shape assumptions, modelling the function and its integral as a Gaussian process and devising a "test" by conditioning on a finite number of function values. The test is decidedly non-asymptotic and is not intended as a full substitute for numerical integration - rather, it is simply intended to test the feasibility of the assumptions underpinning the LA with as minimal computation. We discuss approaches to optimize and design the test, apply it to known sample functions, and highlight the challenges of high dimensions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。