arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1607.07203stat.ME
收藏

微分方程模型的Laplace近似后验推断

Laplace based approximate posterior inference for differential equation models

Sarat C. Dass, Jaeyong Lee, Kyoungjae Lee, Jonghun Park

摘要:

常微分方程可以说是描述现实世界中物理和生物过程的最流行和最有用的数学工具。通常,这些物理和生物过程被观察到有误差,在这种情况下,对这些数据进行建模的最自然的方法是通过回归,其中平均函数由常微分方程定义,据信可以提供对潜在过程的理解。这些基于回归的动态模型被称为微分方程模型。微分方程模型的参数推断带来了计算上的挑战,主要是由于大多数微分方程的解析解是不可用的。本文提出一种求微分方程模型参数后验分布的近似方法。近似分两步完成。在第一步中,微分方程的解是近似的一般一步法,这是一种数值方法的常微分方程,包括欧拉和龙格库塔程序;在第二步中,多余的参数被边缘化使用拉普拉斯近似。建议拉普拉斯近似后提供了一个计算快速的替代完整的贝叶斯计算方案(如马尔可夫链蒙特卡罗),并产生更准确和稳定的估计比流行的平滑方法(称为配置方法)的基础上频率程序。作为该方法的理论支持,我们证明了Laplace近似后验在一定条件下收敛于实际后验,并分析了数值误差阶与其拉普拉斯近似之间的关系.该方法进行了测试模拟数据集,并与其他现有的方法进行了比较。

英文摘要:

Ordinary differential equations are arguably the most popular and useful mathematical tool for describing physical and biological processes in the real world. Often, these physical and biological processes are observed with errors, in which case the most natural way to model such data is via regression where the mean function is defined by an ordinary differential equation believed to provide an understanding of the underlying process. These regression based dynamical models are called differential equation models. Parameter inference from differential equation models poses computational challenges mainly due to the fact that analytic solutions to most differential equations are not available. In this paper, we propose an approximation method for obtaining the posterior distribution of parameters in differential equation models. The approximation is done in two steps. In the first step, the solution of a differential equation is approximated by the general one-step method which is a class of numerical methods for ordinary differential equations including the Euler and the Runge-Kutta procedures; in the second step, nuisance parameters are marginalized using Laplace approximation. The proposed Laplace approximated posterior gives a computationally fast alternative to the full Bayesian computational scheme (such as Markov Chain Monte Carlo) and produces more accurate and stable estimators than the popular smoothing methods (called collocation methods) based on frequentist procedures. For a theoretical support of the proposed method, we prove that the Laplace approximated posterior converges to the actual posterior under certain conditions and analyze the relation between the order of numerical error and its Laplace approximation. The proposed method is tested on simulated data sets and compared with the other existing methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑