We study the problem of estimating the coefficients of a diffusion (X_t,t\geq 0); the estimation is based on discrete data X_{nΔ},n=0,1,...,N. The sampling frequency Δ^{-1} is constant, and asymptotics are taken as the number N of observations tends to infinity. We prove that the problem of estimating both the diffusion coefficient (the volatility) and the drift in a nonparametric setting is ill-posed: the minimax rates of convergence for Sobolev constraints and squared-error loss coincide with that of a, respectively, first- and second-order linear inverse problem. To ensure ergodicity and limit technical difficulties we restrict ourselves to scalar diffusions living on a compact interval with reflecting boundary conditions. Our approach is based on the spectral analysis of the associated Markov semigroup. A rate-optimal estimation of the coefficients is obtained via the nonparametric estimation of an eigenvalue-eigenfunction pair of the transition operator of the discrete time Markov chain (X_{nΔ},n=0,1,...,N) in a suitable Sobolev norm, together with an estimation of its invariant density.
We study the nonparametric estimators of the infinitesimal coefficients of the second-order jump-diffusion models. Under the mild conditions, we obtain the weak consistency and the asymptotic normalities of the estimators.
In this paper, we consider the robust adaptive non parametric estimation problem for the drift coefficient in diffusion processes. An adaptive model selection procedure, based on the improved weighted least square estimates, is proposed. Sharp oracle inequalities for the robust risk have been obtained.
We propose a nonparametric estimation for a class of fractional stochastic differential equations (FSDE) with random effects. We precisely consider general linear fractional stochastic differential equations with drift depending on random effects and non-random diffusion. We build ordinary kernel estimators and histogram estimators and study their Lp-risk (p =1 or 2), when H>1/2. Asymptotic results are evaluated as both T = T(N) and N tend to infinity.
Consider a scalar reflected diffusion $(X_t:t\geq 0)$, where the unknown drift function $b$ is modelled nonparametrically. We show that in the low frequency sampling case, when the sample consists of $(X_0,X_Δ,...,X_{nΔ})$ for some fixed sampling distance $Δ>0$, the model satisfies the local asymptotic normality (LAN) property, assuming that $b$ satisfies some mild regularity assumptions. This is established by using the connections of diffusion processes to elliptic and parabolic PDEs. The key tools will be regularity estimates from the theory of parabolic PDEs as well as a detailed analysis …
We study the nonparametric estimation for the intensity of Poisson random measure in jump-diffusion CIR model based on the low frequency observations. This is given in terms of the minimization of norms on a nonempty, closed and convex subset of some special Hilbert space. We establish the measurability of the estimator and derive its consistency and asymptotic risk bound.
We consider the problem of nonparametric estimation of the drift of a continuously observed one-dimensional diffusion with periodic drift. Motivated by computational considerations, van der Meulen e.a. (2014) defined a prior on the drift as a randomly truncated and randomly scaled Faber-Schauder series expansion with Gaussian coefficients. We study the behaviour of the posterior obtained from the prior from a frequentist asymptotic point of view. If the true data generating drift is smooth, it is proved that the posterior is adaptive with posterior contraction rates for the $L_2$-norm that are…
We consider a one-dimensional diffusion process $(X_t)$ which is observed at $n+1$ discrete times with regular sampling interval $Δ$. Assuming that $(X_t)$ is strictly stationary, we propose nonparametric estimators of the drift and diffusion coefficients obtained by a penalized least squares approach. Our estimators belong to a finite-dimensional function space whose dimension is selected by a data-driven method. We provide non-asymptotic risk bounds for the estimators. When the sampling interval tends to zero while the number of observations and the length of the observation time interval te…
This paper discusses the local linear smoothing to estimate the unknown first and second infinitesimal moments in second-order jump-diffusion model based on Gamma asymmetric kernels. Under the mild conditions, we obtain the weak consistency and the asymptotic normality of these estimators for both interior and boundary design points. Besides the standard properties of the local linear estimation such as simple bias representation and boundary bias correction, the local linear smoothing using Gamma asymmetric kernels possess some extra advantages such as variable bandwidth, variance reduction a…
Nonparametric estimation for semilinear SPDEs, namely stochastic reaction-diffusion equations in one space dimension, is studied. We consider observations of the solution field on a discrete grid in time and space with infill asymptotics in both coordinates. Firstly, we derive a nonparametric estimator for the reaction function of the underlying equation. The estimate is chosen from a finite-dimensional function space based on a least squares criterion. Oracle inequalities provide conditions for the estimator to achieve the usual nonparametric rate of convergence. Adaptivity is provided via mo…
Consider discrete time observations (X_{\ellδ})_{1\leq \ell \leq n+1}$ of the process $X$ satisfying $dX_t= \sqrt{V_t} dB_t$, with $V_t$ a one-dimensional positive diffusion process independent of the Brownian motion $B$. For both the drift and the diffusion coefficient of the unobserved diffusion $V$, we propose nonparametric least square estimators, and provide bounds for theirrisk. Estimators are chosen among a collection of functions belonging to a finite dimensional space whose dimension is selected by a data driven procedure. Implementation on simulated data illustrates how the method wo…
The nonparametric volatility estimation problem of a scalar diffusion process observed at equidistant time points is addressed. Using the spectral representation of the volatility in terms of the invariant density and an eigenpair of the infinitesimal generator the first known estimator that attains the minimax optimal convergence rates for both high and low-frequency observations is constructed. The proofs are based on a posteriori error bounds for generalized eigenvalue problems as well as the path properties of scalar diffusions and stochastic analysis. The finite sample performance is illu…
Let $v$ be a vector field in a bounded open set $G\subset {\mathbb {R}}^d$. Suppose that $v$ is observed with a random noise at random points $X_i, i=1,...,n,$ that are independent and uniformly distributed in $G.$ The problem is to estimate the integral curve of the differential equation \[\frac{dx(t)}{dt}=v(x(t)),\qquad t\geq 0,x(0)=x_0\in G,\] starting at a given point $x(0)=x_0\in G$ and to develop statistical tests for the hypothesis that the integral curve reaches a specified set $Γ\subset G.$ We develop an estimation procedure based on a Nadaraya--Watson type kernel regression estimator…
We consider two kinds of stochastic volatility models. Both kinds of models contain a stationary volatility process, the density of which, at a fixed instant in time, we aim to estimate. We discuss discrete time models where for instance a log price process is modeled as the product of a volatility process and i.i.d. noise. We also consider samples of certain continuous time diffusion processes. The sampled time instants will be be equidistant with vanishing distance. A Fourier type deconvolution kernel density estimator based on the logarithm of the squared processes is proposed to estimate t…
We study nonparametric estimation of the diffusion coefficient from discrete data, when the observations are blurred by additional noise. Such issues have been developed over the last 10 years in several application fields and in particular in high frequency financial data modelling, however mainly from a parametric and semiparametric point of view. This paper addresses the nonparametric estimation of the path of the (possibly stochastic) diffusion coefficient in a relatively general setting. By developing pre-averaging techniques combined with wavelet thresholding, we construct adaptive estim…
A broad class of smooth, possibly data-adaptive nonparametric copula estimators that contains empirical Bernstein copulas introduced by Sancetta and Satchell (and thus the empirical beta copula proposed by Segers, Sibuya and Tsukahara) is studied. Within this class, a subclass of estimators that depend on a scalar parameter determining the amount of marginal smoothing and a functional parameter controlling the shape of the smoothing region is specifically considered. Empirical investigations of the influence of these parameters suggest to focus on two particular data-adaptive smooth copula est…
In this paper, we present the double smoothed nonparametric approach for infinitesimal conditional volatility of jump-diffusion model based on high frequency data. Under certain minimal conditions, we obtain the strong consistency and asymptotic normality for the estimator as the time span $T \rightarrow \infty$ and the sample interval $Δ_{n} \rightarrow 0.$ The procedure and asymptotic behavior can be applied for both null Harris recurrent and positive Harris recurrent processes.
We consider a nonparametric goodness of fit test problem for the drift coefficient of one-dimensional small diffusions. Our test is based on discrete observation of the processes, and the diffusion coefficient is a nuisance function which is estimated in our testing procedure. We prove that the limit distribution of our test is the supremum of the standard Brownian motion, and thus our test is asymptotically distribution free. We also show that our test is consistent under any fixed alternatives.
Conditional Diffusion for Nonparametric Instrumental Variable Quantile Regression
Institute of Data Science and Statistics, Shanghai University of Finance and Economics（上海财经大学数据科学与统计研究院）；School of Mathematics and Statistics, Wuhan University（武汉大学数学与统计学院）；School of Artificial Intelligence, Wuhan University（武汉大学人工智能学院）
Risk comparison theorems and application to deep learning of diffusion coefficients
Laboratoire de Mathématiques et Modélisation d’Evry, CNRS, Univ Evry, Université Evry Paris-Saclay（埃夫里数学与建模实验室）；Graduate School of Mathematical Sciences, University of Tokyo（东京大学大学院数理科学研究科）；The Institute of Statistical Mathematics（统计数学研究所）
High angular resolution diffusion imaging data is the observed characteristic function for the local diffusion of water molecules in tissue. This data is used to infer structural information in brain imaging. Nonparametric scalar measures are proposed to summarize such data, and to locally characterize spatial features of the diffusion probability density function (PDF), relying on the geometry of the characteristic function. Summary statistics are defined so that their distributions are, to first-order, both independent of nuisance parameters and also analytically tractable. The dominant dire…
We consider the problem of estimating the slope parameter in functional linear regression, where scalar responses Y1,...,Yn are modeled in dependence of second order stationary random functions X1,...,Xn. An orthogonal series estimator of the functional slope parameter with additional thresholding in the Fourier domain is proposed and its performance is measured with respect to a wide range of weighted risks covering as examples the mean squared prediction error and the mean integrated squared error for derivative estimation. In this paper the minimax optimal rate of convergence of the estimat…
We consider a system of $N$ interacting particles, governed by transport and diffusion, that converges in a mean-field limit to the solution of a McKean-Vlasov equation. From the observation of a trajectory of the system over a fixed time horizon, we investigate nonparametric estimation of the solution of the associated nonlinear Fokker-Planck equation, together with the drift term that controls the interactions, in a large population limit $N \rightarrow \infty$. We build data-driven kernel estimators and establish oracle inequalities, following Lepski's principle. Our results are based on a …
We consider a binary branching process structured by a stochastic trait that evolves according to a diffusion process that triggers the branching events, in the spirit of Kimmel's model of cell division with parasite infection. Based on the observation of the trait at birth of the first n generations of the process, we construct nonparametric estimator of the transition of the associated bifurcating chain and study the parametric estimation of the branching rate. In the limit, as n tends to infinity, we obtain asymptotic efficiency in the parametric case and minimax optimality in the nonparame…
We consider the question of estimating the drift and the invariant density for a large class of scalar ergodic diffusion processes, based on continuous observations, in $\sup$-norm loss. The unknown drift $b$ is supposed to belong to a nonparametric class of smooth functions of unknown order. We suggest an adaptive approach which allows to construct drift estimators attaining minimax optimal $\sup$-norm rates of convergence. In addition, we prove a Donsker theorem for the classical kernel estimator of the invariant density and establish its semiparametric efficiency. Finally, we combine both r…
In this paper, robust nonparametric estimators, instead of local linear estimators, are adapted for infinitesimal coefficients associated with integrated jump-diffusion models to avoid the impact of outliers on accuracy. Furthermore, consider the complexity of iteration of the solution for local M-estimator, we propose the one-step local M-estimators to release the computation burden. Under appropriate regularity conditions, we prove that one-step local M-estimators and the fully iterative M-estimators have the same performance in consistency and asymptotic normality. Through simulation, our m…
Semiparametric single-index assumptions are convenient and widely used dimen\-sion reduction approaches that represent a compromise between the parametric and fully nonparametric models for regressions or conditional laws. In a mean regression setup, the SIM assumption means that the conditional expectation of the response given the vector of covariates is the same as the conditional expectation of the response given a scalar projection of the covariate vector. In a conditional distribution modeling, under the SIM assumption the conditional law of a response given the covariate vector coincide…
Southwestern University of Finance and Economics（西南财经大学）；Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院）；Wuhan University（武汉大学）
We consider the problem of constructing honest confidence intervals (CIs) for a scalar parameter of interest, such as the regression discontinuity parameter, in nonparametric regression based on kernel or local polynomial estimators. To ensure that our CIs are honest, we use critical values that take into account the possible bias of the estimator upon which the CIs are based. We show that this approach leads to CIs that are more efficient than conventional CIs that achieve coverage by undersmoothing or subtracting an estimate of the bias. We give sharp efficiency bounds of using different ker…
We study Bayes procedures for the problem of nonparametric drift estimation for one-dimensional, ergodic diffusion models from discrete-time, low-frequency data. We give conditions for posterior consistency and verify these conditions for concrete priors, including priors based on wavelet expansions.
The estimation of surface integrals on the boundary of an unknown body is a challenge for nonparametric methods in statistics, with powerful applications to physics and image analysis, among other fields. Provided that one can determine whether random shots hit the body, Cuevas et al. [Ann. Statist. 35 (2007) 1031--1051] estimate the boundary measure (the boundary length for planar sets and the surface area for 3-dimensional objects) via the consideration of shots at a box containing the body. The statistics considered by these authors, as well as those in subsequent papers, are based on the e…
Suppose that particles are randomly distributed in $\bR^d$, and they are subject to identical stochastic motion independently of each other. The Smoluchowski process describes fluctuations of the number of particles in an observation region over time. This paper studies properties of the Smoluchowski processes and considers related statistical problems. In the first part of the paper we revisit probabilistic properties of the Smoluchowski process in a unified and principled way: explicit formulas for generating functionals and moments are derived, conditions for stationarity and Gaussian appro…
We tackle the problem of high-dimensional nonparametric density estimation by taking the class of log-concave densities on $\mathbb{R}^p$ and incorporating within it symmetry assumptions, which facilitate scalable estimation algorithms and can mitigate the curse of dimensionality. Our main symmetry assumption is that the super-level sets of the density are $K$-homothetic (i.e. scalar multiples of a convex body $K \subseteq \mathbb{R}^p$). When $K$ is known, we prove that the $K$-homothetic log-concave maximum likelihood estimator based on $n$ independent observations from such a density has a …
We prove a global asymptotic equivalence of experiments in the sense of Le Cam's theory. The experiments are a continuously observed diffusion with nonparametric drift and its Euler scheme. We focus on diffusions with nonconstant-known diffusion coefficient. The asymptotic equivalence is proved by constructing explicit equivalence mappings based on random time changes. The equivalence of the discretized observation of the diffusion and the corresponding Euler scheme experiment is then derived. The impact of these equivalence results is that it justifies the use of the Euler scheme instead of t…
The nonparametric estimation of the volatility and the drift coefficient of a scalar diffusion is studied when the process is observed at random time points. The constructed estimator generalizes the spectral method by Gobet, Hoffmann and Reiß [Ann. Statist. 32 (2006), 2223-2253]. The estimation procedure is optimal in the minimax sense and adaptive with respect to the sampling time distribution and the regularity of the coefficients. The proofs are based on the eigenvalue problem for the generalized transition operator. The finite sample performance is illustrated in a numerical example.
We consider inference in the scalar diffusion model $dX_t=b(X_t)dt+σ(X_t)dW_t$ with discrete data $(X_{jΔ_n})_{0\leq j \leq n}$, $n\to \infty,~Δ_n\to 0$ and periodic coefficients. For $σ$ given, we prove a general theorem detailing conditions under which Bayesian posteriors will contract in $L^2$-distance around the true drift function $b_0$ at the frequentist minimax rate (up to logarithmic factors) over Besov smoothness classes. We exhibit natural nonparametric priors which satisfy our conditions. Our results show that the Bayesian method adapts both to an unknown sampling regime and to unkn…
One of the fundamental assumptions in stochastic control of continuous time processes is that the dynamics of the underlying (diffusion) process is known. This is, however, usually obviously not fulfilled in practice. On the other hand, over the last decades, a rich theory for nonparametric estimation of the drift (and volatility) for continuous time processes has been developed. The aim of this paper is bringing together techniques from stochastic control with methods from statistics for stochastic processes to find a way to both learn the dynamics of the underlying process and control in a r…
kNN estimation in semi-functional partial linear regression with missing responses at random
Universidade da Coruña（拉科鲁尼亚大学）；Centro de Investigación en Tecnologías de la Información y las Comunicaciones (CITIC)（信息与通信技术研究中心）；Universidad Carlos III de Madrid（马德里卡洛斯三世大学）
A truncated sequential procedure is constructed for estimating the drift coefficient at a given state point based on discrete data of ergodic diffusion process. A nonasymptotic upper bound is obtained for a pointwise absolute error risk. The optimal convergence rate and a sharp constant in the bounds are found for the asymptotic pointwise minimax risk. As a consequence, the efficiency is obtained of the proposed sequential procedure.
