We prove a large deviation principle on path space for a class of discrete time Markov processes whose state space is the intersection of a regular domain $Ł\subset \R^d$ with some lattice of spacing $\e$. Transitions from $x$ to $y$ are allowed if $\e^{-1}(x-y)\in \D$ for some fixed set of vectors $\D$. The transition probabilities $p_\e(t,x,y)$, which themselves depend on $\e$, are allowed to depend on the starting point $x$ and the time $t$ in a sufficiently regular way, except near the boundaries, where some singular behaviour is allowed. The rate function is identified as an action functional which is given as the integral of a Lagrange function. %of time dependent relativistic classical mechanics. Markov processes of this type arise in the study of mean field dynamics of disordered mean field models.
In this paper we are concerned with hitting times of a family of density-dependent Markov chains. A moderate deviation principle of the hitting time is given. The proof of the main theorem relies heavily on moderate deviations of density-dependent Markov chains given in \cite{Xue2021} and upper bounds of large deviations of Markov processes given in \cite{Dupuis1991}. An analogue moderate deviation of the hitting time of the diffusion approximation of the density-dependent Markov chain introduced in \cite{Ethier1986} is also given.
In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated diffusion process and the occupation measure of the Markov chain (which evidently also yields the large deviations principle for each of them separately by applying the contraction principle). The structure of the proof is such that we first prove exponential tightness, and then establish a local large deviations principle (where the latter part is split int…
The density-dependent Markov chain (DDMC) introduced in \cite{Kurtz1978} is a continuous time Markov process applied in fields such as epidemics, chemical reactions and so on. In this paper, we give moderate deviation principles of paths of DDMC under some generally satisfied assumptions. The proofs for the lower and upper bounds of our main result utilize an exponential martingale and a generalized version of Girsanov's theorem. The exponential martingale is defined according to the generator of DDMC.
Consider a sequence of continuous-time Markov chains $(X^{(n)}_t:t\ge 0)$ evolving on a fixed finite state space $V$. Let $I_n$ be the level two large deviations rate functional for $X^{(n)}_t$, as $t\to\infty$. Under a hypothesis on the jump rates, we prove that $I_n$ can be written as $I_n = I^{(0)} \,+\, \sum_{1\le p\le q} (1/θ^{(p)}_n) \, I^{(p)}$ for some rate functionals $I^{(p)}$. The weights $θ^{(p)}_n$ correspond to the time-scales at which the sequence of Markov chains $X^{(n)}_t$ exhibit a metastable behavior, and the zero level sets of the rate functionals $I^{(p)}$ identify the me…
We prove that the long term distribution of the queue length process in an ergodic generalised Jackson network obeys the Large Deviation Principle with a deviation function given by the quasipotential. The latter is related to the unique long term idempotent distribution, which is also a stationary idempotent distribution, of the large deviation limit of the queue length processes. The proof draws on developments in queueing network stability and idempotent probability.
We provide deviation inequalities for properly normalized sums of bifurcating Markov chains on Galton-Watson tree. These processes are extension of bifurcating Markov chains (which was introduced by Guyon to detect cellular aging from cell lineage) in case the index set is a binary Galton-Watson process. As application, we derive deviation inequalities for the least-squares estimator of autoregressive parameters of bifurcating autoregressive processes with missing data. These processes allow, in case of cell division, to take into account the cell's death. The results are obtained under an uni…
In this paper we derive non asymptotic deviation bounds for $$¶_ν(|\frac 1t \int_0^t V(X_s) ds - \int V dμ| \geq R)$$ where $X$ is a $μ$ stationary and ergodic Markov process and $V$ is some $μ$ integrable function. These bounds are obtained under various moments assumptions for $V$, and various regularity assumptions for $μ$. Regularity means here that $μ$ may satisfy various functional inequalities (F-Sobolev, generalized Poincaré etc...).
We consider Markov chains which are polynomially mixing, in a weak sense expressed in terms of the space of functions on which the mixing speed is controlled. In this context, we prove polynomial large and moderate deviations inequalities. These inequalities can be applied in various natural situations coming from probability theory or dynamical systems. Finally, we discuss examples from these various settings showing that our inequalities are sharp.
We study the Hamilton-Jacobi equation f - lambda Hf = h, where H f = e^{-f}Ae^f and where A is an operator that corresponds to a well-posed martingale problem. We identify an operator that gives viscosity solutions to the Hamilton-Jacobi equation, and which can therefore be interpreted as the resolvent of H. The operator is given in terms of optimization problem where the running cost is a path-space relative entropy. Finally, we use the resolvents to give a new proof of the abstract large deviation result of Feng and Kurtz.
We consider a continuous time Markov chain on a countable state space and prove a joint large deviation principle for the empirical measure and the empirical flow, which accounts for the total number of jumps between pairs of states. We give a direct proof using tilting and an indirect one by contraction from the empirical process.
For Markov processes evolving on multiple time-scales a combination of large component scalings and averaging of rapid fluctuations can lead to useful limits for model approximation. A general approach to proving a law of large numbers to a deterministic limit and a central limit theorem around it have already been proven in [16] and [17]. We present here a general approach to proving a large deviation principle in path space for such multi-scale Markov processes. Motivated by models arising in systems biology, we apply these large deviation results to general chemical reaction systems which e…
A large deviations principle is established for the joint law of the empirical measure and the flow measure of a renewal Markov process on a finite graph. We do not assume any bound on the arrival times, allowing heavy tailed distributions. In particular, the rate functional is in general degenerate (it has a nontrivial set of zeros) and not strictly convex. These features show a behavior highly different from what one may guess with a heuristic Donsker-Varadhan analysis of the problem.
We consider a multi-channel communication system under ALOHA and CSMA protocols, resepctively, in continuous time. We derive probabilistic formulas for the most important quantities: the numbers of sending attempts and the number of successfully delivered messages in a given time interval. We derive (1) explicit formulas for the large-time limiting throughput, (2) introduce an explicit and ergodic Markov chain for a deeper probabilistic analysis, and use this to (3) derive exponential asymptotics for rare events for these quantities in the limit of large time, via large-deviation principles.
First, under a geometric ergodicity assumption, we provide some limit theorems and some probability inequalities for the bifurcating Markov chains (BMC). The BMC model was introduced by Guyon to detect cellular aging from cell lineage, and our aim is thus to complete his asymptotic results. The deviation inequalities are then applied to derive first result on the moderate deviation principle (MDP) for a functional of the BMC with a restricted range of speed, but with a function which can be unbounded. Next, under a uniform geometric ergodicity assumption, we provide deviation inequalities for …
We prove pathwise large-deviation principles of switching Markov processes by exploiting the connection to associated Hamilton-Jacobi equations, following Jin Feng's and Thomas Kurtz's method. In the limit that we consider, we show how the large-deviation problem in path-space reduces to a spectral problem of finding principal eigenvalues. The large-deviation rate functions are given in action-integral form. As an application, we demonstrate how macroscopic transport properties of stochastic models of molecular motors can be deduced from an associated principal-eigenvalue problem. The precise …
This paper provides a large deviation principle for Non-Markovian, Brownian motion driven stochastic differential equations with random coefficients. Similar to Gao and Liu \cite{GL}, this extends the corresponding results collected in Freidlin and Wentzell \cite{FreidlinWentzell}. However, we use a different line of argument, adapting the PDE method of Fleming \cite{Fleming} and Evans and Ishii \cite{EvansIshii} to the path-dependent case, by using backward stochastic differential techniques. Similar to the Markovian case, we obtain a characterization of the action function as the unique boun…
Here we propose the Donsker-Varadhan-type compactness conditions and prove the joint large deviation principle for the empirical measure and empirical flow of Markov renewal processes (semi-Markov processes) with a countable state space, generalizing the relevant results for continuous-time Markov chains with a countable state space obtained in [Ann. Inst. H. Poincaré Probab. Statist. 51, 867-900 (2015)] and [Stoch. Proc. Appl. 125, 2786-2819 (2015)], as well as the relevant results for Markov renewal processes with a finite state space obtained in [Adv. Appl. Probab. 48, 648-671 (2016)]. In p…
Our aim is to unify and extend the large deviation upper and lower bounds for the occupation times of a Markov process with $L_2$ semigroups under minimal conditions on the state space and the process trajectories; for example, no strong Markov property is needed. The methods used here apply in both continuous and discrete time. We present the proofs for continuous time only because of the inherent technical difficulties in that situation; the proofs can be adapted for discrete time in a straightforward manner.
The main purpose of this article is to establish moderate deviation principles for additive functionals of bifurcating Markov chains. Bifurcating Markov chains are a class of processes which are indexed by a regular binary tree. They can be seen as the models which represent the evolution of a trait along a population where each individual has two offsprings. Unlike the previous results of Bitseki, Djellout \& Guillin (2014), we consider here the case of functions which depend only on one variable. So, mainly inspired by the recent works of Bitseki \& Delmas (2020) about the central limit theo…
This paper studies the subgeometric convergence of the stationary distribution in taking the infinite-level limit of a finite-level M/G/1-type Markov chain, that is, in letting the upper boundary level go to infinity. This study is performed through the fundamental deviation matrix, which is a block-decomposition-friendly solution for the Poisson equation of the deviation matrix. The fundamental deviation matrix yields a difference formula for the respective stationary distributions of the finite-level chain and the corresponding infinite-level chain. The difference formula plays a crucial rol…
The large deviations principle for the empirical measure for both continuous and discrete time Markov processes is well known. Various expressions are available for the rate function, but these expressions are usually as the solution to a variational problem, and in this sense not explicit. An interesting class of continuous time, reversible processes was identified in the original work of Donsker and Varadhan for which an explicit expression is possible. While this class includes many (reversible) processes of interest, it excludes the case of continuous time pure jump processes, such as a re…
Hawkes process is a class of simple point processes that is self-exciting and has clustering effect. The intensity of this point process depends on its entire past history. It has wide applications in finance, neuroscience and many other fields. In this paper, we study the large deviations for nonlinear Hawkes processes. The large deviations for linear Hawkes processes has been studied by Bordenave and Torrisi. In this paper, we prove first a large deviation principle for a special class of nonlinear Hawkes processes, that is, a Markovian Hawkes process with nonlinear rate and exponential exci…
In this paper, the large deviations on trajectory level for ergodic Markov processes are studied. These processes take values in the non-negative quadrant of the two dimension lattice and are concentrated on step-wise functions. The rates of jumps towards the axes (jump down) depend on the position of the process -- the higher the position, the greater the rate. The rates of jumps going in the same direction as the axes (jump up) are constants. Therefore the processes are ergodic. The large deviations are studied under equal scalings of both space and time. The scaled versions of the processes…
We provide a large deviations analysis of deadlock phenomena occurring in distributed systems sharing common resources. In our model transition probabilities of resource allocation and deallocation are time and space dependent. The process is driven by an ergodic Markov chain and is reflected on the boundary of the d-dimensional cube. In the large resource limit, we prove Freidlin-Wentzell estimates, we study the asymptotic of the deadlock time and we show that the quasi-potential is a viscosity solution of a Hamilton-Jacobi equation with a Neumann boundary condition. We give a complete analys…
In this paper we consider two related stochastic models. The first one is a branching system consisting of particles moving according to a Markov family in R^d and undergoing subcritical branching with a constant rate of V>0. New particles immigrate to the system according to a homogeneous space time Poisson random field. The second model is the superprocess corresponding to the branching particle system. We study rescaled occupation time process and the process of its fluctuations with very mild assumptions on the Markov family. In the general setting a functional central limit theorem as wel…
In this paper, we present new Poisson-type deviation inequalities for continuous-time Markov chains whose Wasserstein curvature or $Γ$-curvature is bounded below. Although these two curvatures are equivalent for Brownian motion on Riemannian manifolds, they are not comparable in discrete settings and yield different deviation bounds. In the case of birth--death processes, we provide some conditions on the transition rates of the associated generator for such curvatures to be bounded below and we extend the deviation inequalities established [Ané, C. and Ledoux, M. On logarithmic Sobolev inequa…
For ${1/2}<α<1$, we propose the MDP analysis for family $$ S^α_n=\frac{1}{n^α}\sum_{i=1}^nH(X_{i-1}), n\ge 1, $$ where $(X_n)_{n\ge 0}$ be a homogeneous ergodic Markov chain, $X_n\in \mathbb{R}^d$, when the spectrum of operator $P_x$ is continuous. The vector-valued function $H$ is not assumed to be bounded but the Lipschitz continuity of $H$ is required. The main helpful tools in our approach are Poisson's equation and Stochastic Exponential; the first enables to replace the original family by $\frac{1}{n^α}M_n$ with a martingale $M_n$ while the second to avoid the direct Laplace transform an…
For ${1/2}<α<1$, we propose the MDP analysis for family $$ S^α_n=\frac{1}{n^α}\sum_{i=1}^nH(X_{i-1}), n\ge 1, $$ where $(X_n)_{n\ge 0}$ be a homogeneous ergodic Markov chain, $X_n\in \mathbb{R}^d$, when the spectrum of operator $P_x$ is continuous. The vector-valued function $H$ is not assumed to be bounded but the Lipschitz continuity of $H$ is required. The main helpful tools in our approach are Poisson equation and Stochastic Exponential; the first enables to replace the original family by $\frac{1}{n^α}M_n$ with a martingale $M_n$ while the second to avoid the direct Laplace transform anal…
Large deviations related to Dynkin--Lamperti arcsine laws for last visit times of Markov processes
Faculty of Arts and Sciences, Kyoto Institute of Technology（京都工艺纤维大学艺术与科学学院）；Department of Mathematics, Graduate School of Science, The University of Osaka（大阪大学理学研究科数学系）；Department of Systems Innovation, Graduate School of Engineering Science, The University of Osaka（大阪大学工学研究科系统创新系）
Large deviation results are given for a class of perturbed nonhomogeneous Markov chains on finite state space which formally includes some stochastic optimization algorithms. Specifically, let {P_n} be a sequence of transition matrices on a finite state space which converge to a limit transition matrix P. Let {X_n} be the associated nonhomogeneous Markov chain where P_n controls movement from time n-1 to n. The main statements are a large deviation principle and bounds for additive functionals of the nonhomogeneous process under some regularity conditions. In particular, when P is reducible, t…
Hawkes process is a class of simple point processes that is self-exciting and has clustering effect. The intensity of this point process depends on its entire past history. It has wide applications in finance, insurance, neuroscience, social networks, criminology, seismology, and many other fields. In this paper, we study linear Hawkes process with an exponential kernel in the asymptotic regime where the initial intensity of the Hawkes process is large. We establish large deviations for Hawkes processes in this regime as well as the regime when both the initial intensity and the time are large…
We prove that moderate deviations for empirical measures for countable nonhomogeneous Markov chains hold under the assumption of uniform convergence of transition probability matrices for countable nonhomogeneous Markov chains in Cesàro sense.
For a Markov process associated with a diffusion type Dirichlet form an upper bound is shown for the law of the finite dimensional distributions of the process. Under some more assumptions on the underlaying space this is also shown for the law of the Markov process itself. In the last section we want to give an application to the Wasserstein diffusion.
Our purpose is to prove central limit theorem for countable nonhomogeneous Markov chain under the condition of uniform convergence of transition probability matrices for countable nonhomogeneous Markov chain in Cesàro sense. Furthermore, we obtain a corresponding moderate deviation theorem for countable nonhomogeneous Markov chain by Gärtner-Ellis theorem and exponential equivalent method.
We establish the large deviation principle for a topological Markov shift over infinite alphabet which satisfies strong combinatorial assumptions called ``finite irreducibility'' or ``finite primitiveness''. More precisely, we assume the existence of a Gibbs state for a potential $ϕ$ in the sense of Bowen, and prove the level-2 Large Deviation Principles for the distribution of empirical means under the Gibbs state, as well as that of weighted periodic points and iterated pre-images. The rate function is written with the pressure and the free energy associated with the potential $ϕ$.
We prove the large deviation principle for the trajectory of a broad class of mean field interacting Markov jump processes via a general analytic approach based on viscosity solutions. Examples include generalized Ehrenfest models as well as Curie-Weiss spin flip dynamics with singular jump rates. The main step in the proof of the large deviation principle, which is of independent interest, is the proof of the comparison principle for an associated collection of Hamilton-Jacobi equations. Additionally, we show that the large deviation principle provides a general method to identify a Lyapunov …
We compute the Hamiltonian and Lagrangian associated to the large deviations of the trajectory of the empirical distribution for independent Markov processes, and of the empirical measure for translation invariant interacting Markov processes. We treat both the case of jump processes (continuous-time Markov chains and interacting particle systems) as well as diffusion processes. For diffusion processes, the Lagrangian is a quadratic form of the deviation of the trajectory from the Kolmogorov forward equation. In all cases, the Lagrangian can be interpreted as a relative entropy or relative ent…
The paper deals with a family of jump Markov process defined in a medium with a periodic or locally periodic microstructure. We assume that the generator of the process is a zero order convolution type operator with rapidly oscillating locally periodic coefficient and, under natural ellipticity and localization conditions, show that the family satisfies the large deviation principle in the path space equipped with Skorokhod topology. The corresponding rate function is defined in terms of a family of auxiliary periodic spectral problems.
The essential spectral radius of a sub-Markovian process is defined as the infimum of the spectral radiuses of all local perturbations of the process. When the family of rescaled processes satisfies sample path large deviation principle, the spectral radius and the essential spectral radius are expressed in terms of the rate function. The paper is motivated by applications to reflected diffusions and jump Markov processes describing stochastic networks for which the sample path large deviation principle has been established and the rate function has been identified while essential spectral rad…
Many networking-related settings can be modeled by Markov-modulated infinite-server systems. In such models, the customers' arrival rates and service rates are modulated by a Markovian background process, additionally, there are infinitely many servers (and consequently the resulting model is often used as a proxy for the corresponding many-server model). The Markov-modulated infinite-server model hardly allows any explicit analysis, apart from results in terms of systems of (ordinary or partial) differential equations for the underlying probability generating functions, and recursions to obta…
We investigate the transportation cost-information inequalities for bifurcating Markov chains which are a class of processes indexed by binary tree. These processes provide models for cell growth when each individual in one generation gives birth to two offsprings in the next one. Transportation cost inequalities provide useful concentra-tion inequalities. We also study deviation inequalities for the empiri-cal means under relaxed assumptions on the Wasserstein contraction of the Markov kernels. Applications to bifurcating non linear autore-gressive processes are considered: deviation inequali…
As an important tool characterizing the long time behavior of Markov processes, the Donsker-Varadhan LDP (large deviation principle) does not directly apply to distribution dependent SDEs/SPDEs since the solutions are non-Markovian. We establish this type LDP for several different models of distribution dependent SDEs/SPDEs which may also with memories, by comparing the original equations with the corresponding distribution independent ones. As preparations, the existence, uniqueness and exponential convergence are also investigated for path-distribution dependent SPDEs which should be interes…
We consider a class of Markov processes with resettings, where at random times, the Markov processes are restarted from a predetermined point or a region. These processes are frequently applied in physics, chemistry, biology, economics, and in population dynamics. In this paper we establish the local large deviation principle (LLDP) for the Wiener processes with random resettings, where the resettings occur at the arrival time of a Poisson process. Here, at each resetting time, a new resetting point is selected at random, according to a conditional distribution.
The work treats systems combining slow and fast motions depending on each other where fast motions are perturbations of families of either dynamical systems or Markov processes with freezed slow variable. In the first case we consider hyperbolic dynamical systems and in the second case we deal with random evolutions which are combinations of diffusions and continuous time Markov chains. We study first large deviations of the slow motion from the averaged one and then use these results together with some Markov property type arguments in order to describe very long time behavior of the slow mot…
In this short note we consider semi-Markov processes satisfying the condition of direction-time independence (Markov renewal processes). We derive large deviation principles and fluctuation theorems for the empirical current and the empirical currents along cycles. Our derivation is based on the joint LDP for the empirical measure and flow recently proved in \cite{MZ}.
In the framework of Harnack type Dirichlet forms, we prove a large deviation principle for the asymptotics of reversible Markov processes with rate function given by the energy of the paths.
The purpose of this paper is to ensure the conditions of Gärtner-Ellis Theorem for evaluations of the empirical measure. We show that up-to-date conditions for ensuring the convergence to a quasi-stationary distribution can be applied efficiently. By this mean, we are able to prove Large Deviation results even with a conditioning that the process is not extinct at the end of the evaluation. The domain on which these Large Deviation results apply is implicitly given by the range of penalization for which one can prove the above-mentioned results of quasi-stationarity. We propose a way to relate…
We prove a large-deviation principle (LDP) for the sample paths of jump Markov processes in the small noise limit when, possibly, all the jump rates vanish uniformly, but slowly enough, in a region of the state space. We further discuss the optimality of our assumptions on the decay of the jump rates. As a direct application of this work we relax the assumptions needed for the application of LDPs to, e.g., Chemical Reaction Network dynamics, where vanishing reaction rates arise naturally particularly the context of mass action kinetics.
We recover the Donsker-Varadhan large deviations principle (LDP) for the empirical measure of a continuous time Markov chain on a countable (finite or infinite) state space from the joint LDP for the empirical measure and the empirical flow proved in [2].
This paper is devoted to the problem of sample path large deviations for the Markov processes on R_+^N having a constant but different transition mechanism on each boundary set {x:x_i=0 for i\notinΛ, x_i>0 for i\inΛ}. The global sample path large deviation principle and an integral representation of the rate function are derived from local large deviation estimates. Our results complete the proof of Dupuis and Ellis of the sample path large deviation principle for Markov processes describing a general class of queueing networks.
We obtain large deviations theorems for nonconventional sums with underlying process being a Markov process satisfying the Doeblin condition or a dynamical system such as subshift of finite type or hyperbolic or expanding transformation.
