We develop a theory of ergodicity for a class of random dynamical systems where the driving noise is not white. The two main tools of our analysis are the strong Feller property and topological irreducibility, introduced in this work for a class of non-Markovian systems. They allow us to obtain a criteria for ergodicity which is similar in nature to the Doob--Khas'minskii theorem. The second part of this article shows how it is possible to apply these results to the case of stochastic differential equations driven by fractional Brownian motion. It follows that under a nondegeneracy condition on the noise, such equations admit a unique adapted stationary solution.
By refining a recent result of Xie and Zhang, we prove the exponential ergodicity under a weighted variation norm for singular SDEs with drift containing a local integrable term and a coercive term. This result is then extended to singular reflecting SDEs as well as singular McKean-Vlasov SDEs with or without reflection. We also present the exponential ergodicity in the relative entropy and (weighted) Wasserstein distances for reflecting McKean-Vlasov SDEs under the dissipative and partially dissipative conditions respectively. The main results are illustrated by non-symmetric singular granula…
In this paper, the weak Harris theorem developed in \cite{HMS11} is illustrated by using a straightforward Wasserstein coupling, which implies the exponential ergodicity of the functional solutions to a range of neutral type SDEs with infinite length of memory. A concrete example is presented to illustrate the main result.
In this paper we show irreducibility and the strong Feller property for transition probabilities of stochastic differential equations with jumps and monotone coefficients. Thus, exponential ergodicity and the spectral gap for the corresponding transition semigroups are obtained.
Under Lyapunov and monotone conditions, the exponential ergodicity in the induced Wasserstein quasi-distance is proved for a class of fully non-dissipative McKean-Vlasov SDEs, which strengthen some recent results established under dissipative conditions in long distance. Moreover, when the SDE is order-preserving, the exponential ergodicity is derived in the Wasserstein distance induced by one-dimensional increasing functions chosen according to the coefficients of the equation.
The aim of this paper is to introduce several new particle representations for \textit{ergodic} McKean-Vlasov SDEs. We construct new algorithms by leveraging recent progress in weak convergence analysis of interacting particle system. We present detailed analysis of errors and associated costs of various estimators, highlighting key differences between long-time simulations of linear (classical SDEs) versus non-linear (Mckean-Vlasov SDEs) process.
In this note we consider autonomous SDEs admitting smooth invariant measures. We present a method in finding (almost everywhere) good bounds for $\sup \{\|X_t\|: t \in [0, T]\}$ for strong solutions $X_{\cdot}$ to such SDEs, which in many cases are optimal bounds. In some situation (especially in one-dimensional SDEs' cases), the discarded measure-zero set can be chosen to be a measure-zero set of the underlying Brownian motion uniform for all initial points $X_0=x$.
We consider SDEs driven by multiplicative pure jump Lévy noises, where Lévy processes are not necessarily comparable to $α$-stable-like processes. By assuming that the SDE has a unique solution, we obtain gradient estimates of the associated semigroup when the drift term is locally Hölder continuous, and we establish the ergodicity of the process both in the $L^1$-Wasserstein distance and the total variation, when the coefficients are dissipative for large distances. The proof is based on a new explicit Markov coupling for SDEs driven by multiplicative pure jump Lévy noises, which is derived f…
We study stochastic differential equations (SDEs) of McKean-Vlasov type with distribution dependent drifts and driven by pure jump Lévy processes. We prove a uniform in time propagation of chaos result, providing quantitative bounds on convergence rate of interacting particle systems with Lévy noise to the corresponding McKean-Vlasov SDE. By applying techniques that combine couplings, appropriately constructed $L^1$-Wasserstein distances and Lyapunov functions, we show exponential convergence of solutions of such SDEs to their stationary distributions. Our methods allow us to obtain results th…
We demonstrate that stochastic differential equations (SDEs) driven by fractional Brownian motion with Hurst parameter H > 1/2 have similar ergodic properties as SDEs driven by standard Brownian motion. The focus in this article is on hypoelliptic systems satisfying Hörmander's condition. We show that such systems satisfy a suitable version of the strong Feller property and we conclude that they admit a unique stationary solution that is physical in the sense that it does not "look into the future". The main technical result required for the analysis is a bound on the moments of the inverse of…
First, we establish an abstract ergodic result on $\mR^d$. Classical ergodic results on $\mR^d$ require that the process is irreducible, we weaken it to some weak form of irreducibility in this article. The main method used in this article is coupling. Then, we apply our abstract ergodic result to stochastic differential equations driven by a Lévy noise and obtain a new result.
The present paper is devoted to the study of the asymptotic behavior of the value functions of both finite and infinite horizon stochastic control problems and to the investigation of their relation with suitable stochastic ergodic control problems. Our methodology is based only on probabilistic techniques, as for instance the so-called randomization of the control method, thus avoiding completely analytical tools from the theory of viscosity solutions. We are then able to treat with the case where the state process takes values in a general (possibly infinite dimensional) real separable Hilbe…
Constructions of numerous approximate sampling algorithms are based on the well-known fact that certain Gibbs measures are stationary distributions of ergodic stochastic differential equations (SDEs) driven by the Brownian motion. However, for some heavy-tailed distributions it can be shown that the associated SDE is not exponentially ergodic and that related sampling algorithms may perform poorly. A natural idea that has recently been explored in the machine learning literature in this context is to make use of stochastic processes with heavy tails instead of the Brownian motion. In this pape…
We show the strong well-posedness of SDEs driven by general multiplicative Lévy noises with Sobolev diffusion and jump coefficients and integrable drift. Moreover, we also study the strong Feller property, irreducibility as well as the exponential ergodicity of the corresponding semigroup when the coefficients are time-independent and singular dissipative. In particular, the large jump is allowed in the equation. To achieve our main results, we present a general approach for treating the SDEs with jumps and singular coefficients so that one just needs to focus on Krylov's {\it apriori} estimat…
In many applications, it is often necessary to sample the mean value of certain quantity with respect to a probability measure μ on the level set of a smooth function $ξ: \mathbb{R}^d\rightarrow \mathbb{R}^k$, $1\le k < d$. A specially interesting case is the so-called conditional probability measure, which is useful in the study of free energy calculation and model reduction of diffusion processes. By Birkhoff's ergodic theorem, one approach to estimate the mean value is to compute the time average along an infinitely long trajectory of an ergodic diffusion process on the level set whose inva…
The paper is dedicated to studying the problem of existence and uniqueness of solutions as well as existence of and exponential convergence to invariant measures for McKean-Vlasov stochastic differential equations with Markovian switching. Since the coefficients are only locally Lipschitz, we need to truncate them both in space and distribution variables simultaneously to get the global existence of solutions under the Lyapunov condition. Furthermore, if the Lyapunov condition is strengthened, we establish the exponential convergence of solutions' distributions to the unique invariant measure …
We study the ergodic properties of a class of controlled stochastic differential equations (SDEs) driven by $α$-stable processes which arise as the limiting equations of multiclass queueing models in the Halfin-Whitt regime that have heavy-tailed arrival processes. When the safety staffing parameter is positive, we show that the SDEs are uniformly ergodic and enjoy a polynomial rate of convergence to the invariant probability measure in total variation, which is uniform over all stationary Markov controls resulting in a locally Lipschitz continuous drift. We also derive a matching lower bound …
In this paper we consider the following SDE with distributional drift $b$: $$ {\rm d} X_t=σ(X_t){\rm d} B_t+b(X_t){\rm d} t,\ X_0=x\in{\mathbb R}^d, $$ where $σ$ is a bounded continuous and uniformly non-degenerate $d\times d$-matrix-valued function, $B$ is a $d$-dimensional standard Brownian motion. Let $α\in(0,\frac{1}{2}]$, $p\in(\frac{d}{1-α},\infty)$ and $β\in[α,1]$, $q\in(\frac{d}β,\infty)$. Assume $\|({\mathbb I}-Δ)^{-α/2}b\|_p+\|(-Δ)^{β/2}σ\|_q<\infty$. We show the existence and uniqueness of martingale solutions to the above SDE, and obtain sharp two-sided and gradient estimates of th…
Let $α\in(0,2)$ and $d\in\mathbb{N}$. Consider the following stochastic differential equation (SDE) driven by $α$-stable process in $\mathbb{R}^d$: $$ dX_t=b(X_t)dt+σ(X_{t-})d L^α_t, \quad X_0=x\in\mathbb{R}^d, $$ where $b:\mathbb{R}^d\to\mathbb{R}^d$ and $σ:\mathbb{R}^d\to\mathbb{R}^d\otimes\mathbb{R}^d$ are locally $γ$-Hölder continuous with $γ\in(0\vee(1-α)^+,1]$, $L^α_t$ is a $d$-dimensional rotationally invariant $α$-stable process. Under some dissipative and non-degenerate assumptions on $b,σ$, we show the $V$-uniformly exponential ergodicity for the semigroup $P_t$ associated with $(X_t…
We study the ergodic properties of a class of multidimensional piecewise Ornstein-Uhlenbeck processes with jumps, which contains the limit of the queueing processes arising in multiclass many-server queues with heavy-tailed arrivals and/or asymptotically negligible service interruptions in the Halfin-Whitt regime as special cases. In these queueing models, the Itô equations have a piecewise linear drift, and are driven by either (1) a Brownian motion and a pure-jump Lévy process, or (2) an anisotropic Lévy process with independent one-dimensional symmetric $α$-stable components, or (3) an anis…
We consider the long-time behavior of an explicit tamed Euler scheme applied to a class of stochastic differential equations driven by additive noise, under a one-sided Lipschitz continuity condition. The setting encompasses drift nonlinearities with polynomial growth. First, we prove that moment bounds for the numerical scheme hold, with at most polynomial dependence with respect to the time horizon. Second, we apply this result to obtain error estimates, in the weak sense, in terms of the time-step size and of the time horizon, to quantify the error to approximate averages with respect to th…
Using elliptic and parabolic regularity results in $L^p$-spaces and generalized Dirichlet form theory, we construct for every starting point weak solutions to SDEs in $\mathbb{R}^d$ up to their explosion times including the following conditions. For arbitrary but fixed $p>d$ the diffusion coefficient $A=(a_{ij})_{1\le i,j\le d}$ is locally uniformly strictly elliptic with functions $a_{ij}\in H^{1,p}_{loc}(\mathbb{R}^d)$ and the drift coefficient $\mathbf{G}=(g_1,\dots, g_d)$ consists of functions $g_i\in L^p_{loc}(\mathbb{R}^d)$. The solution originates by construction from a Hunt process wit…
We study the approximation of the ergodic measure of the following stochastic differential equation (SDE) on $\mathbb{R}^d$: \begin{eqnarray}\label{e:SDEE} d X_t &=& (b_1(X_t)+b_2(X_t)) d t+σ(X_t) d W_t, \end{eqnarray} where $W_t$ is a $d$-dimensional standard Brownian motion, and $b_1: \mathbb{R}^d \mapsto \mathbb{R}^d$, $b_2: \mathbb{R}^d \mapsto \mathbb{R}^d$ and $σ: \mathbb{R}^d \mapsto \mathbb{R}^{d\times d}$ are the functions to be specified in Assumption 2.1 below. In particular, $b_1$ satisfies $b_1\in \mathbb{L}^\infty(\mathbb{R}^d)\cap \mathbb{L}^1(\mathbb{R}^d)$ or $b_1 \in \mathcal…
We consider a special class of mean field SDEs with common noise which depend on the image of the solution (i.e. the conditional distribution given noise). The strong well-posedness is derived under a monotone condition which is weaker than those used in the literature of mean field games, the Feynman-Kac formula is established to solve Schrördinegr type PDEs on $\scr P_2$, and the ergodicity is proved for a class of measure-valued diffusion processes.
In a previous paper, we studied the ergodic properties of an Euler scheme of a stochastic differential equation with a Gaussian additive noise in order to approximate the stationary regime of such equation. We now consider the case of multiplicative noise when the Gaussian process is a fractional Brownian Motion with Hurst parameter H>1/2 and obtain some (functional) convergences properties of some empirical measures of the Euler scheme to the stationary solutions of such SDEs.
We consider differential equations driven by rough paths and study the regularity of the laws and their long time behavior. In particular, we focus on the case when the driving noise is a rough path valued fractional Brownian motion with Hurst parameter $H\in(\frac{1}{3},\frac{1}{2}]$. Our contribution in this work is twofold. First, when the driving vector fields satisfy Hörmander's celebrated "Lie bracket condition," we derive explicit quantitative bounds on the inverse of the Malliavin matrix. En route to this, we provide a novel "deterministic" version of Norris's lemma for differential eq…
In this work, we prove the strong Feller property and the exponential ergodicity of stochastic Burgers equations driven by $α/2$-subordinated cylindrical Brownian motions with $α\in(1,2)$. To prove the results, we truncate the nonlinearity and use the derivative formula for SDEs driven by $α$-stable noises established in Zhang (arXiv:1204.2630v2).
The existence of stationary distributions to distribution dependent stochastic differential equations are investigated by using the ergodicity of the associated decoupled equation and the Schauder fixed point theorem. By using Zvonkin's transformation, we also establish the existence result for equations with singular coefficients. Instead of the uniqueness, the non-uniqueness of stationary distributions are considered for equations with regular coefficients. Concrete examples including McKean-Vlasov stochastic equations with the quadratic interaction and the non-quadratic interaction, and equ…
In this paper, Wang's log-Harnack inequality and exponential ergodicity are derived for two types of distribution dependent SDEs: one is the CKLS model, where the diffusion coefficient is a power function of order $θ$ with $θ\in[\frac{1}{2},1)$; the other one is Vasicek model, where the diffusion coefficient only depends on distribution. Both models in the distribution independent case can be used to characterize the interest rate in mathematical finance.
In this paper we study the existence of densities for strongly degenerate stochastic differential equations (SDEs) whose coefficients depend on time and are not globally Lipschitz. In these models neither local ellipticity nor the strong Hörmander condition is satisfied. In this general setting we show that continuous transition densities indeed exist in all neighborhoods of points where the weak Hörmander condition is satisfied. We also exhibit regions where these densities remain positive. We then apply these results to stochastic Hodgkin-Huxley models with periodic input as a first step tow…
We study the ergodic properties of finite-dimensional systems of SDEs driven by non-degenerate additive fractional Brownian motion with arbitrary Hurst parameter $H\in(0,1)$. A general framework is constructed to make precise the notions of ``invariant measure'' and ``stationary state'' for such a system. We then prove under rather weak dissipativity conditions that such an SDE possesses a unique stationary solution and that the convergence rate of an arbitrary solution towards the stationary one is (at least) algebraic. A lower bound on the exponent is also given.
Generally the convergence rate in exponential ergodicity $λ$ is an upper bound for the convergence rate $κ$ in uniform ergodicity for a Markov process, that is $λ\geqslantκ$. In this paper, we prove that $κ\geqslant \inf \{lambda,1/M_H\}$, where $M_H$ is a uniform bound on the moment of the hitting time to a "compact" set $H$. In the case where $M_H$ can be made arbitrarily small for $H$ large enough, we obtain that $λ=κ$. The general results are applied to Markov chains, diffusion processes and solutions to SDEs driven by symmetric stable processes.
We present the validity of stochastic averaging principle for non-autonomous slow-fast stochastic differential equations (SDEs) whose fast motions admit random periodic solutions. Our investigation is motivated by some problems arising from multi-scale stochastic dynamical systems, where configurations are time dependent due to nonlinearity of the underlying vector fields and the onset of time dependent random invariant sets. Averaging principle with respect to uniform ergodicity of the fast motion is no longer available in this scenario. Lyapunov second method together with synchronous coupli…
In this paper, we consider numerical approximation to periodic measure of a time periodic stochastic differential equations (SDEs) under weakly dissipative condition. For this we first study the existence of the periodic measure $ρ_t$ and the large time behaviour of $\mathcal{U}(t+s,s,x) := \mathbb{E}ϕ(X_{t}^{s,x})-\intϕdρ_t,$ where $X_t^{s,x}$ is the solution of the SDEs and $ϕ$ is a test function being smooth and of polynomial growth at infinity. We prove $\mathcal{U}$ and all its spatial derivatives decay to 0 with exponential rate on time $t$ in the sense of average on initial time $s$. We…
