This paper studies the f-ergodicity and its exponential convergence rate for continuous-time Markov chain. Assume f is square integrable, for reversible Markov chain, it is proved that the exponential convergence of f-ergodicity holds if and only if the spectral gap of the generator is positive. Moreover, the convergence rate is equal to the spectral gap. For irreversible case, the positivity of spectral gap remains a sufficient condition of f-ergodicity. The effectiveness of these results are illustrated by some typical examples.
We obtain explicit criteria for both exponential ergodicity and strong ergodicity for one-dimensional time-changed symmetric stable processes with $α\in(1,2)$. Explicit lower bounds for ergodic convergence rates are given.
In this paper we show irreducibility and the strong Feller property for transition probabilities of stochastic differential equations with jumps and monotone coefficients. Thus, exponential ergodicity and the spectral gap for the corresponding transition semigroups are obtained.
Under Lyapunov and monotone conditions, the exponential ergodicity in the induced Wasserstein quasi-distance is proved for a class of fully non-dissipative McKean-Vlasov SDEs, which strengthen some recent results established under dissipative conditions in long distance. Moreover, when the SDE is order-preserving, the exponential ergodicity is derived in the Wasserstein distance induced by one-dimensional increasing functions chosen according to the coefficients of the equation.
By using the coupling technique, we present sufficient conditions for the exponential ergodicity of general continuous-state nonlinear branching processes in both the $L^1$-Wasserstein distance and the total variation norm, where the drift term is dissipative only for large distance, and either diffusion noise or jump noise is allowed to be vanished. Sufficient conditions for the corresponding strong ergodicity are also established.
Explicit coupling property and gradient estimates are investigated for the linear evolution equations on Hilbert spaces driven by an additive cylindrical Lévy process. The results are efficiently applied to establish the exponential ergodicity for the associated transition semigroups. In particular, our results extend recent developments on related topic for cylindrical symmetric $α$-stable processes.
The Laplace transform of partial sums of the square of a non-centered Gauss-Markov process, conditioning on its starting point, is explicitly computed. The parameters of multiplicative ergodicity are deduced.
In this paper we provide convergence analysis for a class of Brownian queues in tandem by establishing an exponential drift condition. A consequence is the uniform exponential ergodicity for these multidimensional diffusions, including the O'Connell-Yor process. A list of open problems are also presented.
In this paper, we investigate the exponential ergodicity in a Wasserstein-type distance for a damping Hamiltonian dynamics with state-dependent and non-local collisions, which indeed is a special case of piecewise deterministic Markov processes while is very popular in numerous modelling situations including stochastic algorithms. The approach adopted in this work is based on a combination of the refined basic coupling and the refined reflection coupling for non-local operators. In a certain sense, the main result developed in the present paper is a continuation of the counterpart in \cite{BW2…
By refining a recent result of Xie and Zhang, we prove the exponential ergodicity under a weighted variation norm for singular SDEs with drift containing a local integrable term and a coercive term. This result is then extended to singular reflecting SDEs as well as singular McKean-Vlasov SDEs with or without reflection. We also present the exponential ergodicity in the relative entropy and (weighted) Wasserstein distances for reflecting McKean-Vlasov SDEs under the dissipative and partially dissipative conditions respectively. The main results are illustrated by non-symmetric singular granula…
We study ergodic properties of stochastic dissipative systems with additive noise. We show that the system is uniformly exponentially ergodic provided the growth of nonlinearity at infinity is faster than linear. The abstract result is applied to the stochastic reaction diffusion equation in $\mathbb R^d$ with $d\le 3$.
In this work, we study ergodicity of continuous time Markov processes on state space $\mathbb{R}_{\geq 0} := [0,\infty)$ obtained as unique strong solutions to stochastic equations with jumps. Our first main result establishes exponential ergodicity in the Wasserstein distance, provided the stochastic equation satisfies a comparison principle and the drift is dissipative. In particular, it is applicable to continuous-state branching processes with immigration (shorted as CBI processes), possibly with nonlinear branching mechanisms or in Lévy random environments. Our second main result establis…
We prove the convergence at an exponential rate towards the invariant probability measure for a class of solutions of stochastic differential equations with finite delay. This is done, in this non-Markovian setting, using the cluster expansion method, inspired from [4] or [14]. As a consequence, the results hold for small perturbations of ergodic diffusions.
Generally the convergence rate in exponential ergodicity $λ$ is an upper bound for the convergence rate $κ$ in uniform ergodicity for a Markov process, that is $λ\geqslantκ$. In this paper, we prove that $κ\geqslant \inf \{lambda,1/M_H\}$, where $M_H$ is a uniform bound on the moment of the hitting time to a "compact" set $H$. In the case where $M_H$ can be made arbitrarily small for $H$ large enough, we obtain that $λ=κ$. The general results are applied to Markov chains, diffusion processes and solutions to SDEs driven by symmetric stable processes.
In this paper, Wang's log-Harnack inequality and exponential ergodicity are derived for two types of distribution dependent SDEs: one is the CKLS model, where the diffusion coefficient is a power function of order $θ$ with $θ\in[\frac{1}{2},1)$; the other one is Vasicek model, where the diffusion coefficient only depends on distribution. Both models in the distribution independent case can be used to characterize the interest rate in mathematical finance.
This work focuses on a class of regime-switching jump diffusion processes, in which the switching component has countably infinite many states or regimes. The existence and uniqueness of the underlying process are obtained by an interlacing procedure. Then the Feller and strong Feller properties of such processes are derived by the coupling method and an appropriate Radon-Nikodym derivative. Finally the paper studies exponential ergodicity of regime-switching jump-diffusion processes.
We study an affine two-factor model introduced by Barczy et al. (2014). One component of this two-dimensional model is the so-called $α$-root process, which generalizes the well known CIR process. In this paper, we show that this affine two-factor model is exponentially ergodic when $α\in(1,2)$.
In this paper, by invoking the coupling approach, we establish exponential ergodicity under the $L^1 $-Wasserstein distance for two-factor affine processes. The method employed herein is universal in a certain sense so that it is applicable to general two-factor affine processes, which allow that the first component solves a general CIR process, and that there are interactions in the second component, as well as that the Brownian noises are correlated; and even to some models beyond two-factor processes.
By Girsanov's thoerem and using the existing log-Harnack inequality for distribution independent SDEs, the log-Harnack inequality is derived for path-distribution dependent stochastic Hamiltonian systems. As an application, the exponential ergodicity in relative entropy is obtained by combining with transportation cost inequality. In addition, the quantitative propagation of chaos in the sense of Wasserstein distance, which together with the coupling by change of measure implies the quantitative propagation of chaos in total variation norm as well as relative entropy are obtained.
In this paper we study the jump-diffusion CIR process (shorted as JCIR), which is an extension of the classical CIR model. The jumps of the JCIR are introduced with the help of a pure-jump Lévy process $(J_t, t \ge 0)$. Under some suitable conditions on the Lévy measure of $(J_t, t \ge 0)$, we derive a lower bound for the transition densities of the JCIR process. We also find some sufficient condition guaranteeing the existence of a Forster-Lyapunov function for the JCIR process, which allows us to prove its exponential ergodicity.
This paper considers multidimensional jump type stochastic differential equations with super linear growth and non-Lipschitz coefficients. After establishing a sufficient condition for nonexplosion, this paper presents sufficient non-Lipschitz conditions for pathwise uniqueness. The non confluence property for solutions is investigated. Feller and strong Feller properties under non-Lipschitz conditions are investigated via the coupling method. Sufficient conditions for irreducibility and exponential ergodicity are derived. As applications, this paper also studies multidimensional stochastic di…
In this paper we find the transition densities of the basic affine jump-diffusion (BAJD), which is introduced by Duffie and Garleanu [D. Duffie and N. Garleanu, Risk and valuation of collateralized debt obligations, Financial Analysts Journal 57(1) (2001), pp. 41--59] as an extension of the CIR model with jumps. We prove the positive Harris recurrence and exponential ergodicity of the BAJD. Furthermore we prove that the unique invariant probability measure $π$ of the BAJD is absolutely continuous with respect to the Lebesgue measure and we also derive a closed form formula for the density func…
In this paper, we establish the existence, uniqueness and attraction properties of an invariant measure for the real Ginzburg-Landau equation in the presence of a degenerate stochastic forcing acting only in four directions. The main challenge is to establish time asymptotic smoothing properties of the Markovian dynamics corresponding to this system. To achieve this, we propose a condition which only requires four noises
The mild sufficient conditions for exponential ergodicity of a Markov process, defined as the solution to SDE with a jump noise, are given. These conditions include three principal claims: recurrence condition R, topological irreducibility condition S and non-degeneracy condition N, the latter formulated in the terms of a certain random subspace of \Re^m, associated with the initial equation. The examples are given, showing that, in general, none of three principal claims can be removed without losing ergodicity of the process. The key point in the approach, developed in the paper, is that the…
We develop and implement new probabilistic strategy for proving exponential ergodicity for interacting diffusion processes on unbounded lattice. The concept of the solution used is rather weak as we construct the process in infinite dimension as a solution to suitable infinite dimensional martingale problem. However the techniques allow us to consider cases where the generator of the particle is subelliptic operator. In addition we prove exponential convergence in the uniform norm, which appears to be new in this context. As a model case we present situation, where the operator arises from Hei…
We present a novel idea for a coupling of solutions of stochastic differential equations driven by Lévy noise, inspired by some results from the optimal transportation theory. Then we use this coupling to obtain exponential contractivity of the semigroups associated with these solutions with respect to an appropriately chosen Kantorovich distance. As a corollary, we obtain exponential convergence rates in the total variation and standard $L^1$-Wasserstein distances.
Generalization of the Lorden's inequality is an excellent tool for obtaining strong upper bounds for the convergence rate for various complicated stochastic models. This paper demonstrates a method for obtaining such bounds for some generalization of the Markov modulated Poisson process (MMPP). The proposed method can be applied to reliability and queuing theory.
In this paper, we introduce a new class of processes which are diffusions with jumps driven by a multivariate nonlinear Hawkes process. Our goal is to study their long-time behavior. In the case of exponential memory kernels for the underlying Hawkes process we establish conditions for the positive Harris recurrence of the couple (X, Y), where X denotes the diffusion process and Y the piecewise deterministic Markov process (PDMP) defining the stochastic intensity of the driving Hawkes. As a direct consequence of the Harris recurrence, we obtain the ergodic theorem for X. Furthermore, we provid…
In this paper, we address exponential ergodicity for Lévy driven Langevin dynamics with singular potentials, which can be used to model the time evolution of a molecular system consisting of $N$ particles moving in $\R^d$ and subject to discontinuous stochastic forces. In particular, our results are applicable to the singular setups concerned with not only the Lennard-Jones-like interaction potentials but also the Coulomb potentials. In addition to Harris' theorem, the approach is based on novel constructions of proper Lyapunov functions (which are completely different from the setting for Lan…
We study stochastic differential equations (SDEs) of McKean-Vlasov type with distribution dependent drifts and driven by pure jump Lévy processes. We prove a uniform in time propagation of chaos result, providing quantitative bounds on convergence rate of interacting particle systems with Lévy noise to the corresponding McKean-Vlasov SDE. By applying techniques that combine couplings, appropriately constructed $L^1$-Wasserstein distances and Lyapunov functions, we show exponential convergence of solutions of such SDEs to their stationary distributions. Our methods allow us to obtain results th…
This work focuses on a class of stochastic damping Hamiltonian systems with state-dependent switching, where the switching process has a countably infinite state space. After establishing the existence and uniqueness of a global weak solution via the martingale approach under very mild conditions, the paper next proves the strong Feller property for regime-switching stochastic damping Hamiltonian systems by the killing technique together with some resolvent and transition probability identities. The commonly used continuity assumption for the switching rates $q_{kl}(\cdot)$ in the literature i…
One of the key performance measures in queueing systems is the exponential decay rate of the steady-state tail probabilities of the queue lengths. It is known that if a corresponding fluid model is stable and the stochastic primitives have finite moments, then the queue lengths also have finite moments, so that the tail probability \pr(\cdot >s) decays faster than s^{-n} for any n. It is natural to conjecture that the decay rate is in fact exponential. In this paper an example is constructed to demonstrate that this conjecture is false. For a specific stationary policy applied to a network wit…
We consider the generalization of the Pólya urn scheme with possibly infinite many colors as introduced in \cite{Th-Thesis, BaTH2014, BaTh2016, BaTh2017}. For countable many colors, we prove almost sure convergence of the urn configuration under \emph{uniform ergodicity} assumption on the associated Markov chain. The proof uses a stochastic coupling of the sequence of chosen colors with a \emph{branching Markov chain} on a weighted \emph{random recursive tree} as described in \cite{BaTh2017, Sv_2018}. Using this coupling we estimate the covariance between any two selected colors. In particular…
We study convergence to the invariant measure for a class of semilinear stochastic evolution equations driven by Lévy noise, including the case of cylindrical noise. For a certain class of equations we prove the exponential rate of convergence in the norm of total variation. Our general result is applied to a number of specific equations driven by cylindrical symmetric $α$-stable noise and/or cylindrical Wiener noise. We also consider the case of a "singular" Wiener process with unbounded covariance operator. In particular, in the equation with diagonal pure $α$-stable cylindrical noise introd…
This work is devoted to the study of conservative affine processes on the canonical state space $D = $R_+^m \times \R^n$, where $m + n > 0$. We show that each affine process can be obtained as the pathwise unique strong solution to a stochastic equation driven by Brownian motions and Poisson random measures. Then we study the long-time behavior of affine processes, i.e., we show that under first moment condition on the state-dependent and log-moment conditions on the state-independent jump measures, respectively, each subcritical affine process is exponentially ergodic in a suitably chosen Was…
In this work, we prove the strong Feller property and the exponential ergodicity of stochastic Burgers equations driven by $α/2$-subordinated cylindrical Brownian motions with $α\in(1,2)$. To prove the results, we truncate the nonlinearity and use the derivative formula for SDEs driven by $α$-stable noises established in Zhang (arXiv:1204.2630v2).
We establish quantitative bounds for rates of convergence and asymptotic variances for iterated conditional sequential Monte Carlo (i-cSMC) Markov chains and associated particle Gibbs samplers. Our main findings are that the essential boundedness of potential functions associated with the i-cSMC algorithm provide necessary and sufficient conditions for the uniform ergodicity of the i-cSMC Markov chain, as well as quantitative bounds on its (uniformly geometric) rate of convergence. Furthermore, we show that the i-cSMC Markov chain cannot even be geometrically ergodic if this essential boundedn…
We consider a Markovian single-server retrial queueing system with a constant retrial rate. Conditions of null ergodicity and exponential ergodicity for the correspondent process, as well as bounds on the rate of convergence are obtained.
We analyze a system of stochastic differential equations describing the joint motion of a massive (inert) particle in a viscous fluid in the presence of a gravitational field and a Brownian particle impinging on it from below, which transfers momentum proportional to the local time of collisions. We study the long-time fluctuations of the velocity of the inert particle and the gap between the two particles, and we show convergence in total variation to the stationary distribution is exponentially fast. We also produce matching upper and lower bounds on the tails of the stationary distribution …
We develop a general framework for studying ergodicity of order-preserving Markov semigroups. We establish natural and in a certain sense optimal conditions for existence and uniqueness of the invariant measure and exponential convergence of transition probabilities of an order-preserving Markov process. As an application, we show exponential ergodicity and exponentially fast synchronization-by-noise of the stochastic reaction-diffusion equation in the hypoelliptic setting. This refines and complements corresponding results of Hairer, Mattingly (2011).
We study ergodic properties of a class of Markov-modulated general birth-death processes under fast regime switching. The first set of results concerns the ergodic properties of the properly scaled joint Markov process with a parameter that is taken large. Under very weak hypotheses, we show that if the averaged process is exponentially ergodic for large values of the parameter, then the same applies to the original joint Markov process. The second set of results concerns steady-state diffusion approximations, under the assumption that the 'averaged' fluid limit exists. Here, we establish conv…
We obtain the lower bounds for ergodic convergence rates, including spectral gaps and convergence rates in strong ergodicity for time-changed symmetric Lévy processes by using harmonic function and reversible measure. As direct applications, explicit sufficient conditions for exponential and strong ergodicity are given. Some examples are also presented.
In this paper we prove a sharp quantitative version of the Kendall's Theorem. The Kendal Theorem states that under some mild conditions imposed on a probability distribution on positive integers (i.e. probabilistic sequence) one can prove convergence of its renewal sequence. Due to the well-known property - the first entrance last exit decomposition - such results are of interest in the stability theory of time homogeneous Markov chains. In particular the approach may be used to measure rates of convergence of geometrically ergodic Markov chains and consequently implies estimates on convergenc…
