Differential Equation (DE) is a commonly used modeling method in various scientific subjects such as finance and biology. The parameters in DE models often have interesting scientific interpretations, but their values are often unknown and need to be estimated from the measurements of the DE. In this work, we propose a Bayesian inference framework to solve the problem of estimating the parameters of the DE model, from the given noisy and scarce observations of the solution only. A key issue in this problem is to robustly estimate the derivatives of a function from noisy observations of only the function values at given location points, under the assumption of a physical model in the form of differential equation governing the function and its derivatives. To address the key issue, we use the Gaussian Process Regression with Constraint (GPRC) method which jointly model the solution, the derivatives, and the parametric differential equation, to estimate the solution and its derivatives. For nonlinear differential equations, a Picard-iteration-like approximation of linearization method is used so that the GPRC can be still iteratively applicable. A new potential which combines the data and equation information, is proposed and used in the likelihood for our inference. With numerical examples, we illustrate that the proposed method has competitive performance against existing approaches for estimating the unknown parameters in DEs.
Bayesian bandwidth estimation for a nonparametric functional regression model with mixed types of regressors and unknown error density
在误差密度未知的框架下,研究了具有函数值、连续实值和离散值回归变量的非参数函数回归模型的带宽估计问题.从Shang(2013,Computational Statistics & Data Analysis)的最近工作扩展,我们通过残差的核密度估计来近似未知误差密度,其中回归函数由允许混合类型回归变量的函数Nadaraya-Watson估计器估计。在核形式误差密度下,推导了带宽参数的核似然和后验密度,提出了一种同时估计带宽的贝叶斯带宽估计方法。仿真研究表明,所提出的贝叶斯方法的回归函数和误差密度的估计精度。以食品质量控制中的光谱数据集为例,我们应用贝叶斯方法来选择具有混合类型回归变量的非参数函数回归模型中的最佳带宽。
Bayesian bandwidth estimation and semi-metric selection for a functional partial linear model with unknown error density
This study examines the optimal selections of bandwidth and semi-metric for a functional partial linear model . Our proposed method begins by estimating the unknown error density using a kernel density estimator of residuals, where the regression function , consisting of parametric and nonparametric components, can be estimated by functional principal component and functional Nadayara-Watson estimators. The estimation accuracy of the regression function and error density crucially depends on the optimal estimations of bandwidth and semi-metric. A Bayesian method is utilized to simultaneously e…
Department of Statistical Science Duke University, Durham, NC(统计科学系杜克大学);Department of Mathematical Sciences The University of Texas at Dallas, Richardson, TX(数学科学系德克萨斯大学达拉斯分校)