This paper obtains asymptotic results for parametric inference using prediction-based estimating functions when the data are high frequency observations of a diffusion process with an infinite time horizon. Specifically, the data are observations of a diffusion process at $n$ equidistant time points $Δ_n i$, and the asymptotic scenario is $Δ_n \to 0$ and $nΔ_n \to \infty$. For a useful and tractable classes of prediction-based estimating functions, existence of a consistent estimator is proved under standard weak regularity conditions on the diffusion process and the estimating function. Asymptotic normality of the estimator is established under the additional rate condition $nΔ_n^3 \to 0$. The prediction-based estimating functions are approximate martingale estimating functions to a smaller order than what has previously been studied, and new non-standard asymptotic theory is needed. A Monte Carlo method for calculating the asymptotic variance of the estimators is proposed.
This paper presents a fast computational method, the Expectation Maximization algorithm, for Maximum Likelihood (ML) estimation in diffusion tensor imaging under the Rice noise model. We further extend the ML framework to the maximum a posterior (MAP) estimation and describe the numerical similarities of both ML and MAP estimators. This novel method is implemented and applied using both synthetic and real data in a wide range of b amplitudes. The comparison with other popular methods are made in accuracy, methodology and computation.
Diffusion processes are widely used for modelling real-world phenomena. Except for select cases however, analytical expressions do not exist for a diffusion process' transitional probabilities. It is proposed that the cumulant truncation procedure can be applied to predict the evolution of the cumulants of the system. These predictions may be subsequently used within the saddlepoint procedure to approximate the transitional probabilities. An approximation to the likelihood of the diffusion system is then easily derived. The method is applicable for a wide-range of diffusion systems - including…
The article considers parameter estimation constructing such as quasi-maximum likelyhood estimation and one step estimation in statistical models generated by solution of stochastic differential equation. It has been developed a software for parameter estimating and has been presented correspondent testing and comparing.
We propose a new statistical observation scheme of diffusion processes named convolutional observation, where it is possible to deal with smoother observation than ordinary diffusion processes by considering convolution of diffusion processes and some kernel functions with respect to time parameter. We discuss the estimation and test theories for the parameter determining the smoothness of the observation, as well as the least-square-type estimation for the parameters in the diffusion coefficient and the drift one of the latent diffusion process. In addition to the theoretical discussion, we a…
We propose an update estimation method for a diffusion parameter from high-frequency dependent data under a nuisance drift element. We ensure the asymptotic equivalence of the estimator to the corresponding quasi-MLE, which has the asymptotic normality and the asymptotic efficiency. We give a simulation example to illustrate the theory.
In this paper, we consider the robust adaptive non parametric estimation problem for the drift coefficient in diffusion processes. An adaptive model selection procedure, based on the improved weighted least square estimates, is proposed. Sharp oracle inequalities for the robust risk have been obtained.
In this article, we consider a jump diffusion process (X_t), with drift function b, diffusion coefficient sigma and jump coefficient xi^{2}. This process is observed at discrete times t=0,Delta,...,nDelta. The sampling interval Delta tends to 0 and nDelta tends to infinity. We assume that (X_t) is ergodic, strictly stationary and exponentially beta-mixing. We use a penalized least-square approach to compute adaptive estimators of the functions sigma^2+xi^2 and sigma^2. We provide bounds for the risks of the two estimators.
We study the nonparametric estimators of the infinitesimal coefficients of the second-order jump-diffusion models. Under the mild conditions, we obtain the weak consistency and the asymptotic normalities of the estimators.
We propose a nonparametric estimation for a class of fractional stochastic differential equations (FSDE) with random effects. We precisely consider general linear fractional stochastic differential equations with drift depending on random effects and non-random diffusion. We build ordinary kernel estimators and histogram estimators and study their Lp-risk (p =1 or 2), when H>1/2. Asymptotic results are evaluated as both T = T(N) and N tend to infinity.
We consider the problem of frequency estimation by observations of the periodic diffusion process possesing ergodic properties in two different situations. The first one corresponds to continuously differentiable with respect to parameter trend coefficient and the second - to discontinuous trend coefficient. It is shown that in the first case the maximum likelihood and bayesian estimators are asymptotically normal with rate $T^{3/2}$ and in the second case these estimators have different limit distributions with the rate $T^2$.
Asymptotic efficiency is proved for the constructed in part 1 procedure, i.e. Pinsker's constant is found in the asymptotic lower bound for the minimax quadratic risk. It is shown that the asymptotic minimax quadratic risk of the constructed procedure coincides with this constant.
In this paper, we present the double smoothed nonparametric approach for infinitesimal conditional volatility of jump-diffusion model based on high frequency data. Under certain minimal conditions, we obtain the strong consistency and asymptotic normality for the estimator as the time span $T \rightarrow \infty$ and the sample interval $Δ_{n} \rightarrow 0.$ The procedure and asymptotic behavior can be applied for both null Harris recurrent and positive Harris recurrent processes.
In this article, we consider a jump diffusion process (X_t)observed at discrete times t=0,Delta,...,nDelta. The sampling interval Delta tends to 0 and nDelta tends to infinity. We assume that (X_t) is ergodic, strictly stationary and exponentially β-mixing. We use a penalized least-square approach to compute two adaptive estimators of the drift function b. We provide bounds for the risks of the two estimators.
We consider structural equation modeling (SEM) with latent variables for diffusion processes based on high-frequency data. We derive the quasi-likelihood estimators for parameters in the SEM. The goodness-of-fit test based on the quasi-likelihood ratio is proposed. Furthermore, the asymptotic properties of our proposed estimators are examined.
We deal with the change point problem in ergodic diffusion processes based on high frequency data. Tonaki et al. (2020, 2021) studied the change point problem for the ergodic diffusion process model. However, the change point problem for the drift parameter when the diffusion parameter changes is still open. Therefore, we consider the change detection and the change point estimation for the drift parameter taking into account that there is a change point in the diffusion parameter. Moreover, we examine the performance of the tests and the estimation with numerical simulations.
We treat the change point problem in ergodic diffusion processes from discrete observations. Tonaki et al. (2020) proposed adaptive tests for detecting changes in the diffusion and drift parameters in ergodic diffusion models. When any changes are detected by this method, the next question to be considered is where the change point is. Therefore, we propose the method to estimate the change point of the parameter for two cases: the case where there is a change in the diffusion parameter, and the case where there is no change in the diffusion parameter but a change in the drift parameter. Furth…
We investigate the moment estimation for an ergodic diffusion process with unknown trend coefficient. We consider nonparametric and parametric estimation. In each case, we present a lower bound for the risk and then construct an asymptotically efficient estimator of the moment type functional or of a parameter which has a one-to-one correspondence to such a functional. Next, we clarify a higher order property of the moment type estimator by the Edgeworth expansion of the distribution function.
We study nonparametric estimation of the diffusion coefficient from discrete data, when the observations are blurred by additional noise. Such issues have been developed over the last 10 years in several application fields and in particular in high frequency financial data modelling, however mainly from a parametric and semiparametric point of view. This paper addresses the nonparametric estimation of the path of the (possibly stochastic) diffusion coefficient in a relatively general setting. By developing pre-averaging techniques combined with wavelet thresholding, we construct adaptive estim…
We research adaptive maximum likelihood-type estimation for an ergodic diffusion process where the observation is contaminated by noise. This methodology leads to the asymptotic independence of the estimators for the variance of observation noise, the diffusion parameter and the drift one of the latent diffusion process. Moreover, it can lessen the computational burden compared to simultaneous maximum likelihood-type estimation. In addition to adaptive estimation, we propose a test to see if noise exists or not, and analyse real data as the example such that data contains observation noise wit…
In this paper,we consider a macro approximation of the flow of a risk reserve, The process is observed at discrete time points. Because we cannot directly observe each jump time and size then we will make use of a technique for identifying the times when jumps larger than a suitably defined threshold occurred. We estimate the jump size and survival probability of our risk process from discrete observations.
This paper proposes a widely applicable method of approximate maximum-likelihood estimation for multivariate diffusion process from discretely sampled data. A closed-form asymptotic expansion for transition density is proposed and accompanied by an algorithm containing only basic and explicit calculations for delivering any arbitrary order of the expansion. The likelihood function is thus approximated explicitly and employed in statistical estimation. The performance of our method is demonstrated by Monte Carlo simulations from implementing several examples, which represent a wide range of com…
This paper introduces a family of recursively defined estimators of the parameters of a diffusion process. We use ideas of stochastic algorithms for the construction of the estimators. Asymptotic consistency of these estimators and asymptotic normality of an appropriate normalization are proved. The results are applied to two examples from the financial literature; viz., Cox-Ingersoll-Ross' model and the constant elasticity of variance (CEV) process illustrate the use of the technique proposed herein.
This paper discusses the local linear smoothing to estimate the unknown first and second infinitesimal moments in second-order jump-diffusion model based on Gamma asymmetric kernels. Under the mild conditions, we obtain the weak consistency and the asymptotic normality of these estimators for both interior and boundary design points. Besides the standard properties of the local linear estimation such as simple bias representation and boundary bias correction, the local linear smoothing using Gamma asymmetric kernels possess some extra advantages such as variable bandwidth, variance reduction a…
The global estimation problem of the drift function is considered for a large class of ergodic diffusion processes. The unknown drift $S(\cdot)$ is supposed to belong to a nonparametric class of smooth functions of order $k\geq1$, but the value of $k$ is not known to the statistician. A fully data-driven procedure of estimating the drift function is proposed, using the estimated risk minimization method. The sharp adaptivity of this procedure is proven up to an optimal constant, when the quality of the estimation is measured by the integrated squared error weighted by the square of the invaria…
We study the problem of estimating the coefficients of a diffusion (X_t,t\geq 0); the estimation is based on discrete data X_{nΔ},n=0,1,...,N. The sampling frequency Δ^{-1} is constant, and asymptotics are taken as the number N of observations tends to infinity. We prove that the problem of estimating both the diffusion coefficient (the volatility) and the drift in a nonparametric setting is ill-posed: the minimax rates of convergence for Sobolev constraints and squared-error loss coincide with that of a, respectively, first- and second-order linear inverse problem. To ensure ergodicity and li…
We study the nonparametric estimation for the intensity of Poisson random measure in jump-diffusion CIR model based on the low frequency observations. This is given in terms of the minimization of norms on a nonempty, closed and convex subset of some special Hilbert space. We establish the measurability of the estimator and derive its consistency and asymptotic risk bound.
A kernel method is proposed to estimate the condensed density of the generalized eigenvalues of pencils of Hankel matrices whose elements have a joint noncentral Gaussian distribution with nonidentical covariance. These pencils arise when the complex exponentials approximation problem is considered in Gaussian noise. Several moments problems can be formulated in this framework and the estimation of the condensed density above is the main critical step for their solution. It is shown that the condensed density satisfies approximately a diffusion equation, which allows to estimate an optimal ban…
We consider the question of estimating the drift and the invariant density for a large class of scalar ergodic diffusion processes, based on continuous observations, in $\sup$-norm loss. The unknown drift $b$ is supposed to belong to a nonparametric class of smooth functions of unknown order. We suggest an adaptive approach which allows to construct drift estimators attaining minimax optimal $\sup$-norm rates of convergence. In addition, we prove a Donsker theorem for the classical kernel estimator of the invariant density and establish its semiparametric efficiency. Finally, we combine both r…
We consider the problem of statistical inference for the effective dynamics of multiscale diffusion processes with (at least) two widely separated characteristic time scales. More precisely, we seek to determine parameters in the effective equation describing the dynamics on the longer diffusive time scale, i.e. in a homogenization framework. We examine the case where both the drift and the diffusion coefficients in the effective dynamics are space-dependent and depend on multiple unknown parameters. It is known that classical estimators, such as Maximum Likelihood and Quadratic Variation of t…
We discuss parametric estimation of a degenerate diffusion system from time-discrete observations. The first component of the degenerate diffusion system has a parameter $θ_1$ in a non-degenerate diffusion coefficient and a parameter $θ_2$ in the drift term. The second component has a drift term parameterized by $θ_3$ and no diffusion term. Asymptotic normality is proved in three different situations for an adaptive estimator for $θ_3$ with some initial estimators for ($θ_1$ , $θ_2$), an adaptive one-step estimator for ($θ_1$ , $θ_2$ , $θ_3$) with some initial estimators for them, and a joint …
We consider the problem of nonparametric estimation of the drift of a continuously observed one-dimensional diffusion with periodic drift. Motivated by computational considerations, van der Meulen e.a. (2014) defined a prior on the drift as a randomly truncated and randomly scaled Faber-Schauder series expansion with Gaussian coefficients. We study the behaviour of the posterior obtained from the prior from a frequentist asymptotic point of view. If the true data generating drift is smooth, it is proved that the posterior is adaptive with posterior contraction rates for the $L_2$-norm that are…
We consider parametric estimation for ergodic diffusion processes with noisy sampled data based on the hybrid method, that is, the multi-step estimation with the initial Bayes type estimators. In order to select proper initial values for optimisation of the quasi likelihood function of ergodic diffusion processes with noisy observations, we construct the initial Bayes type estimator based on the local means of the noisy observations. The asymptotic properties of the initial Bayes type estimators and the hybrid multi-step estimators with the initial Bayes type estimators are shown, and a concre…
We built a model of the daily temperature based on a diffusion process and address to extreme values not taken into account in the literature on this kind of models. We first study, using non parametric tools, the trends on mean and variance. In a second step we estimate a stationary model first non parametrically and then using likelihood methods. Extreme values are taken into account in the estimation of model and to obtain a definitive estimation we use in a specific framework extreme theory for diffusions. A test of suitable model by simulation is done.
Gaussian quasi-likelihood estimation of the parameter $θ$ in the square-root diffusion process is studied under high frequency sampling. Different from the previous study of Overbeck and Rydén(1998) under low-frequency sampling, high-frequency of data provides very simple form of the asymptotic covariance matrix. Through easy-to-compute preliminary contrast functions, a practical two-stage manner without numerical optimization is formulated in order to conduct not only an asymptotically efficient estimation of the drift parameters, but also high-precision estimator of the diffusion parameter. …
We study asymptotic properties of conditional least squares estimators for the drift parameters of two-factor affine diffusions based on continuous time observations. We distinguish three cases: subcritical, critical and supercritical. For all the drift parameters, in the subcritical and supercritical cases, asymptotic normality and asymptotic mixed normality is proved, while in the critical case, non-standard asymptotic behavior is described.
The estimation of the diffusion matrix $Σ$ of a high-dimensional, possibly time-changed Lévy process is studied, based on discrete observations of the process with a fixed distance. A low-rank condition is imposed on $Σ$. Applying a spectral approach, we construct a weighted least-squares estimator with nuclear-norm-penalisation. We prove oracle inequalities and derive convergence rates for the diffusion matrix estimator. The convergence rates show a surprising dependency on the rank of $Σ$ and are optimal in the minimax sense for fixed dimensions. Theoretical results are illustrated by a simu…
A parameter estimation problem for a class of semilinear stochastic evolution equations is considered. Conditions for consistency and asymptotic normality are given in terms of growth and continuity properties of the nonlinear part. Emphasis is put on the case of stochastic reaction-diffusion systems. Robustness results for statistical inference under model uncertainty are provided.
In this paper we give a central limit theorem for the weighted quadratic variations process of a two-parameter Brownian motion. As an application, we show that the discretized quadratic variations $\sum_{i=1}^{[n s]} \sum_{j=1}^{[n t]} | Δ_{i,j} Y |^2$ of a two-parameter diffusion $Y=(Y_{(s,t)})_{(s,t)\in[0,1]^2}$ observed on a regular grid $G_n$ is an asymptotically normal estimator of the quadratic variation of $Y$ as $n$ goes to infinity.
We consider a stochastic process driven by a diffusion and jumps. We devise a technique, which is based on a discrete record of observations, for identifying the times when jumps larger than a suitably defined threshold occurred. The technique allows also jump size estimation. We prove the consistency of a nonparametric estimator of the integrated infinitesimal variance of the process continuous part when the jump component with infinite activity is Levy. Central limit results are proved in the case where the jump component has finite activity. Some simulations illustrate the reliability of th…
For a one dimensional diffusion process $X=\{X(t) ; 0\leq t \leq T \}$, we suppose that $X(t)$ is hidden if it is below some fixed and known threshold $τ$, but otherwise it is visible. This means a partially hidden diffusion process. The problem treated in this paper is to estimate finite dimensional parameter in both drift and diffusion coefficients under a partially hidden diffusion process obtained by a discrete sampling scheme. It is assumed that the sampling occurs at regularly spaced time intervals of length $h_n$ such that $n h_n=T$. The asymptotic is when $h_n\to0$, $T\to\infty$ and $n…
We study the problem of parameter estimation for stochastic differential equations with small noise and fast oscillating parameters. Depending on how fast the intensity of the noise goes to zero relative to the homogenization parameter, we consider three different regimes. For each regime, we construct the maximum likelihood estimator and we study its consistency and asymptotic normality properties. A simulation study for the first order Langevin equation with a two scale potential is also provided.
We consider a nonparametric Bayesian approach to estimate the diffusion coefficient of a stochastic differential equation given discrete time observations over a fixed time interval. As a prior on the diffusion coefficient, we employ a histogram-type prior with piecewise constant realisations on bins forming a partition of the time interval. Specifically, these constants are realizations of independent inverse Gamma distributed randoma variables. We justify our approach by deriving the rate at which the corresponding posterior distribution asymptotically concentrates around the data-generating…
The nonparametric estimation of the volatility and the drift coefficient of a scalar diffusion is studied when the process is observed at random time points. The constructed estimator generalizes the spectral method by Gobet, Hoffmann and Reiß [Ann. Statist. 32 (2006), 2223-2253]. The estimation procedure is optimal in the minimax sense and adaptive with respect to the sampling time distribution and the regularity of the coefficients. The proofs are based on the eigenvalue problem for the generalized transition operator. The finite sample performance is illustrated in a numerical example.
We research adaptive maximum likelihood-type estimation for an ergodic diffusion process where the observation is contaminated by noise. This methodology leads to the asymptotic independence of the estimators for the variance of observation noise, the diffusion parameter and the drift one of the latent diffusion process. Moreover, it can lessen the computational burden compared to simultaneous maximum likelihood-type estimation. In addition to adaptive estimation, we propose a test to see if noise exists or not, and analyse real data as the example such that data contains observation noise wit…
In branching diffusions with immigration (BDI), particles travel on independent diffusion paths in $\mathbb{R}^d$, branch at position-dependent rates and leave offspring -- randomly scattered around the parent's death position -- according to position-dependent laws. We specify a set of conditions which grants ergodicity such that the invariant occupation measure is of finite total mass and admits a continuous Lebesgue density. Under discrete-time observation, BDI configurations being recorded at discrete times $iΔ$ only, $i\in\mathbb{N}_0$, we lose information about particle identities betwee…
The LASSO is a widely used statistical methodology for simultaneous estimation and variable selection. In the last years, many authors analyzed this technique from a theoretical and applied point of view. We introduce and study the adaptive LASSO problem for discretely observed ergodic diffusion processes. We prove oracle properties also deriving the asymptotic distribution of the LASSO estimator. Our theoretical framework is based on the random field approach and it applied to more general families of regular statistical experiments in the sense of Ibragimov-Hasminskii (1981). Furthermore, we…
