In this paper we establish a large deviation principle for the entropy production rate of possible non-stationary, centered stable Gauss-Markov chains, verifying the Gallavotti-Cohen symmetry. We reach this goal by developing a large deviation theory for quasi-Toeplitz quadratic functionals of multivariate centered stable Gauss-Markov chains, which differ from a perfect Toeplitz form by the addition of quadratic boundary terms.
In this short note we consider semi-Markov processes satisfying the condition of direction-time independence (Markov renewal processes). We derive large deviation principles and fluctuation theorems for the empirical current and the empirical currents along cycles. Our derivation is based on the joint LDP for the empirical measure and flow recently proved in \cite{MZ}.
We recover the Donsker-Varadhan large deviations principle (LDP) for the empirical measure of a continuous time Markov chain on a countable (finite or infinite) state space from the joint LDP for the empirical measure and the empirical flow proved in [2].
We consider an irreducible continuous time Markov chain on a finite state space and with time periodic jump rates and prove the joint large deviation principle for the empirical measure and flow and the joint large deviation principle for the empirical measure and current. By contraction we get the large deviation principle of three types of entropy production flow. We derive some Gallavotti-Cohen duality relations and discuss some applications.
We consider a continuous time Markov chain on a countable state space. We prove a joint large deviation principle (LDP) of the empirical measure and current in the limit of large time interval. The proof is based on results on the joint large deviations of the empirical measure and flow obtained in \cite{BFG}. By improving such results we also show, under additional assumptions, that the LDP holds with the strong L^1 topology on the space of currents. We deduce a general version of the Gallavotti-Cohen (GC) symmetry for the current field and show that it implies the so-called fluctuation theor…
We study the large deviations principle for one dimensional, continuous, homogeneous, strong Markov processes that do not necessarily behave locally as a Wiener process. Any strong Markov process $X_{t}$ in $\mathbb{R}$ that is continuous with probability one, under some minimal regularity conditions, is governed by a generalized elliptic operator $D_{v}D_{u}$, where $v$ and $u$ are two strictly increasing functions, $v$ is right continuous and $u$ is continuous. In this paper, we study large deviations principle for Markov processes whose infinitesimal generator is $εD_{v}D_{u}$ where $0<ε\ll…
Given a finite typed rooted tree $T$ with $n$ vertices, the {\em empirical subtree measure} is the uniform measure on the $n$ typed subtrees of $T$ formed by taking all descendants of a single vertex. We prove a large deviation principle in $n$, with explicit rate function, for the empirical subtree measures of multitype Galton-Watson trees conditioned to have exactly $n$ vertices. In the process, we extend the notions of shift-invariance and specific relative entropy--as typically understood for Markov fields on deterministic graphs such as $\mathbb Z^d$--to Markov fields on random trees. We …
In this paper we are concerned with hitting times of a family of density-dependent Markov chains. A moderate deviation principle of the hitting time is given. The proof of the main theorem relies heavily on moderate deviations of density-dependent Markov chains given in \cite{Xue2021} and upper bounds of large deviations of Markov processes given in \cite{Dupuis1991}. An analogue moderate deviation of the hitting time of the diffusion approximation of the density-dependent Markov chain introduced in \cite{Ethier1986} is also given.
We consider Piecewise Deterministic Markov Processes (PDMPs) with a finite set of discrete states. In the regime of fast jumps between discrete states, we prove a law of large number and a large deviation principle. In the regime of fast and slow jumps, we analyze a coarse-grained process associated to the original one and prove its convergence to a new PDMP with effective force fields and jump rates. In all the above cases, the continuous variables evolve slowly according to ODEs. Finally, we discuss some applications related to the mechanochemical cycle of macromolecules, including strained-…
Let $({\mathcal{T}}_{*t})$ be a predual quantum Markov semigroup acting on the full 2 x 2 matrix algebra and having an absorbing pure state. We prove that for any initial state $ω$, the net of orthogonal measures representing the net of states $({\mathcal{T}}_{*t}(ω))$ satisfies a large deviation principle in the pure state space, with a rate function given in terms of the generator, and which does not depend on $ω$. This implies that $({\mathcal{T}}_{*t}(ω))$ is faithful for all $t$ large enough. Examples arising in weak coupling limit are studied.
We prove the large deviation principle for the trajectory of a broad class of mean field interacting Markov jump processes via a general analytic approach based on viscosity solutions. Examples include generalized Ehrenfest models as well as Curie-Weiss spin flip dynamics with singular jump rates. The main step in the proof of the large deviation principle, which is of independent interest, is the proof of the comparison principle for an associated collection of Hamilton-Jacobi equations. Additionally, we show that the large deviation principle provides a general method to identify a Lyapunov …
We prove that moderate deviations for empirical measures for countable nonhomogeneous Markov chains hold under the assumption of uniform convergence of transition probability matrices for countable nonhomogeneous Markov chains in Cesàro sense.
In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated diffusion process and the occupation measure of the Markov chain (which evidently also yields the large deviations principle for each of them separately by applying the contraction principle). The structure of the proof is such that we first prove exponential tightness, and then establish a local large deviations principle (where the latter part is split int…
We consider discrete-time Markov chains and study large deviations of the pair empirical occupation measure, which is useful to compute fluctuations of pure-additive and jump-type observables. We provide an exact expression for the finite-time moment generating function, which is split in cycles and paths contributions, and scaled cumulant generating function of the pair empirical occupation measure via a graph-combinatorial approach. The expression obtained allows us to give a physical interpretation of interaction and entropic terms, and of the Lagrange multipliers, and may serve as a starti…
Our purpose is to prove central limit theorem for countable nonhomogeneous Markov chain under the condition of uniform convergence of transition probability matrices for countable nonhomogeneous Markov chain in Cesàro sense. Furthermore, we obtain a corresponding moderate deviation theorem for countable nonhomogeneous Markov chain by Gärtner-Ellis theorem and exponential equivalent method.
The density-dependent Markov chain (DDMC) introduced in \cite{Kurtz1978} is a continuous time Markov process applied in fields such as epidemics, chemical reactions and so on. In this paper, we give moderate deviation principles of paths of DDMC under some generally satisfied assumptions. The proofs for the lower and upper bounds of our main result utilize an exponential martingale and a generalized version of Girsanov's theorem. The exponential martingale is defined according to the generator of DDMC.
Consider a sequence of continuous-time Markov chains $(X^{(n)}_t:t\ge 0)$ evolving on a fixed finite state space $V$. Let $I_n$ be the level two large deviations rate functional for $X^{(n)}_t$, as $t\to\infty$. Under a hypothesis on the jump rates, we prove that $I_n$ can be written as $I_n = I^{(0)} \,+\, \sum_{1\le p\le q} (1/θ^{(p)}_n) \, I^{(p)}$ for some rate functionals $I^{(p)}$. The weights $θ^{(p)}_n$ correspond to the time-scales at which the sequence of Markov chains $X^{(n)}_t$ exhibit a metastable behavior, and the zero level sets of the rate functionals $I^{(p)}$ identify the me…
We prove that the long term distribution of the queue length process in an ergodic generalised Jackson network obeys the Large Deviation Principle with a deviation function given by the quasipotential. The latter is related to the unique long term idempotent distribution, which is also a stationary idempotent distribution, of the large deviation limit of the queue length processes. The proof draws on developments in queueing network stability and idempotent probability.
Level 2.5 large deviations and uncertainty relations for non-Markov self-interacting dynamics
School of Physics and Astronomy, University of Nottingham（诺丁汉大学物理与天文学院）；Centre for the Mathematics and Theoretical Physics of Quantum Non-Equilibrium Systems, University of Nottingham（诺丁汉大学量子非平衡系统数学与理论物理中心）；Department of Statistics and Operations Research, University of North Carolina, Chapel Hill（北卡罗来纳大学教堂山分校统计与运筹学系）
We provide deviation inequalities for properly normalized sums of bifurcating Markov chains on Galton-Watson tree. These processes are extension of bifurcating Markov chains (which was introduced by Guyon to detect cellular aging from cell lineage) in case the index set is a binary Galton-Watson process. As application, we derive deviation inequalities for the least-squares estimator of autoregressive parameters of bifurcating autoregressive processes with missing data. These processes allow, in case of cell division, to take into account the cell's death. The results are obtained under an uni…
In this paper we derive non asymptotic deviation bounds for $$¶_ν(|\frac 1t \int_0^t V(X_s) ds - \int V dμ| \geq R)$$ where $X$ is a $μ$ stationary and ergodic Markov process and $V$ is some $μ$ integrable function. These bounds are obtained under various moments assumptions for $V$, and various regularity assumptions for $μ$. Regularity means here that $μ$ may satisfy various functional inequalities (F-Sobolev, generalized Poincaré etc...).
We consider Markov chains which are polynomially mixing, in a weak sense expressed in terms of the space of functions on which the mixing speed is controlled. In this context, we prove polynomial large and moderate deviations inequalities. These inequalities can be applied in various natural situations coming from probability theory or dynamical systems. Finally, we discuss examples from these various settings showing that our inequalities are sharp.
We study the Hamilton-Jacobi equation f - lambda Hf = h, where H f = e^{-f}Ae^f and where A is an operator that corresponds to a well-posed martingale problem. We identify an operator that gives viscosity solutions to the Hamilton-Jacobi equation, and which can therefore be interpreted as the resolvent of H. The operator is given in terms of optimization problem where the running cost is a path-space relative entropy. Finally, we use the resolvents to give a new proof of the abstract large deviation result of Feng and Kurtz.
We consider a continuous time Markov chain on a countable state space and prove a joint large deviation principle for the empirical measure and the empirical flow, which accounts for the total number of jumps between pairs of states. We give a direct proof using tilting and an indirect one by contraction from the empirical process.
We study a class of dissipative PDE's perturbed by a bounded random kick force. It is assumed that the random force is non-degenerate, so that the Markov process obtained by the restriction of solutions to integer times has a unique stationary measure. The main result of the paper is a large deviation principle for occupation measures of the Markov process in question. The proof is based on Kifer's large deviation criterion, a Lyapunov-Schmidt type reduction, and an abstract result on large-time asymptotic for generalised Markov semigroups.
Motivated by the occurrence in rate functions of time-dependent large-deviation principles, we study a class of non-negative functions $\mathscr L$ that induce a flow, given by $\mathscr L(ρ_t,\dotρ_t)=0$. We derive necessary and sufficient conditions for the unique existence of a generalized gradient structure for the induced flow, as well as explicit formulas for the corresponding driving entropy and dissipation functional. In particular, we show how these conditions can be given a probabilistic interpretation when $\mathscr L$ is associated to the large deviations of a microscopic particle …
For Markov processes evolving on multiple time-scales a combination of large component scalings and averaging of rapid fluctuations can lead to useful limits for model approximation. A general approach to proving a law of large numbers to a deterministic limit and a central limit theorem around it have already been proven in [16] and [17]. We present here a general approach to proving a large deviation principle in path space for such multi-scale Markov processes. Motivated by models arising in systems biology, we apply these large deviation results to general chemical reaction systems which e…
A large deviations principle is established for the joint law of the empirical measure and the flow measure of a renewal Markov process on a finite graph. We do not assume any bound on the arrival times, allowing heavy tailed distributions. In particular, the rate functional is in general degenerate (it has a nontrivial set of zeros) and not strictly convex. These features show a behavior highly different from what one may guess with a heuristic Donsker-Varadhan analysis of the problem.
We establish the large deviation principle for a topological Markov shift over infinite alphabet which satisfies strong combinatorial assumptions called ``finite irreducibility'' or ``finite primitiveness''. More precisely, we assume the existence of a Gibbs state for a potential $ϕ$ in the sense of Bowen, and prove the level-2 Large Deviation Principles for the distribution of empirical means under the Gibbs state, as well as that of weighted periodic points and iterated pre-images. The rate function is written with the pressure and the free energy associated with the potential $ϕ$.
First, under a geometric ergodicity assumption, we provide some limit theorems and some probability inequalities for the bifurcating Markov chains (BMC). The BMC model was introduced by Guyon to detect cellular aging from cell lineage, and our aim is thus to complete his asymptotic results. The deviation inequalities are then applied to derive first result on the moderate deviation principle (MDP) for a functional of the BMC with a restricted range of speed, but with a function which can be unbounded. Next, under a uniform geometric ergodicity assumption, we provide deviation inequalities for …
The paper deals with a family of jump Markov process defined in a medium with a periodic or locally periodic microstructure. We assume that the generator of the process is a zero order convolution type operator with rapidly oscillating locally periodic coefficient and, under natural ellipticity and localization conditions, show that the family satisfies the large deviation principle in the path space equipped with Skorokhod topology. The corresponding rate function is defined in terms of a family of auxiliary periodic spectral problems.
We prove pathwise large-deviation principles of switching Markov processes by exploiting the connection to associated Hamilton-Jacobi equations, following Jin Feng's and Thomas Kurtz's method. In the limit that we consider, we show how the large-deviation problem in path-space reduces to a spectral problem of finding principal eigenvalues. The large-deviation rate functions are given in action-integral form. As an application, we demonstrate how macroscopic transport properties of stochastic models of molecular motors can be deduced from an associated principal-eigenvalue problem. The precise …
The essential spectral radius of a sub-Markovian process is defined as the infimum of the spectral radiuses of all local perturbations of the process. When the family of rescaled processes satisfies sample path large deviation principle, the spectral radius and the essential spectral radius are expressed in terms of the rate function. The paper is motivated by applications to reflected diffusions and jump Markov processes describing stochastic networks for which the sample path large deviation principle has been established and the rate function has been identified while essential spectral rad…
The work treats systems combining slow and fast motions depending on each other where fast motions are perturbations of families of either dynamical systems or Markov processes with freezed slow variable. In the first case we consider hyperbolic dynamical systems and in the second case we deal with random evolutions which are combinations of diffusions and continuous time Markov chains. We study first large deviations of the slow motion from the averaged one and then use these results together with some Markov property type arguments in order to describe very long time behavior of the slow mot…
Here we propose the Donsker-Varadhan-type compactness conditions and prove the joint large deviation principle for the empirical measure and empirical flow of Markov renewal processes (semi-Markov processes) with a countable state space, generalizing the relevant results for continuous-time Markov chains with a countable state space obtained in [Ann. Inst. H. Poincaré Probab. Statist. 51, 867-900 (2015)] and [Stoch. Proc. Appl. 125, 2786-2819 (2015)], as well as the relevant results for Markov renewal processes with a finite state space obtained in [Adv. Appl. Probab. 48, 648-671 (2016)]. In p…
Bitseki and Delmas (2021) have studied recently the central limit theorem for kernel estimator of invariant density in bifurcating Markov chains models. We complete their work by proving a moderate deviation principle for this estimator. Unlike the work of Bitseki and Gorgui (2021), it is interesting to see that the distinction of the two regimes disappears and that we are able to get moderate deviation principle for large values of the ergodic rate. It is also interesting and surprising to see that for moderate deviation principle, the ergodic rate begins to have an impact on the choice of th…
Our aim is to unify and extend the large deviation upper and lower bounds for the occupation times of a Markov process with $L_2$ semigroups under minimal conditions on the state space and the process trajectories; for example, no strong Markov property is needed. The methods used here apply in both continuous and discrete time. We present the proofs for continuous time only because of the inherent technical difficulties in that situation; the proofs can be adapted for discrete time in a straightforward manner.
The main purpose of this article is to establish moderate deviation principles for additive functionals of bifurcating Markov chains. Bifurcating Markov chains are a class of processes which are indexed by a regular binary tree. They can be seen as the models which represent the evolution of a trait along a population where each individual has two offsprings. Unlike the previous results of Bitseki, Djellout \& Guillin (2014), we consider here the case of functions which depend only on one variable. So, mainly inspired by the recent works of Bitseki \& Delmas (2020) about the central limit theo…
This paper studies the subgeometric convergence of the stationary distribution in taking the infinite-level limit of a finite-level M/G/1-type Markov chain, that is, in letting the upper boundary level go to infinity. This study is performed through the fundamental deviation matrix, which is a block-decomposition-friendly solution for the Poisson equation of the deviation matrix. The fundamental deviation matrix yields a difference formula for the respective stationary distributions of the finite-level chain and the corresponding infinite-level chain. The difference formula plays a crucial rol…
We prove a large-deviation principle (LDP) for the sample paths of jump Markov processes in the small noise limit when, possibly, all the jump rates vanish uniformly, but slowly enough, in a region of the state space. We further discuss the optimality of our assumptions on the decay of the jump rates. As a direct application of this work we relax the assumptions needed for the application of LDPs to, e.g., Chemical Reaction Network dynamics, where vanishing reaction rates arise naturally particularly the context of mass action kinetics.
Let $S_N$ be the sum of vector-valued functions defined on a finite Markov chain. An analogue of the Bernstein--Hoeffding inequality is derived for the probability of large deviations of $S_N$ and relates the probability to the spectral gap of the Markov chain. Examples suggest that this inequality is better than alternative inequalities if the chain has a sufficiently large spectral gap and the function is high-dimensional.
The large deviations principle for the empirical measure for both continuous and discrete time Markov processes is well known. Various expressions are available for the rate function, but these expressions are usually as the solution to a variational problem, and in this sense not explicit. An interesting class of continuous time, reversible processes was identified in the original work of Donsker and Varadhan for which an explicit expression is possible. While this class includes many (reversible) processes of interest, it excludes the case of continuous time pure jump processes, such as a re…
In this paper, the large deviations on trajectory level for ergodic Markov processes are studied. These processes take values in the non-negative quadrant of the two dimension lattice and are concentrated on step-wise functions. The rates of jumps towards the axes (jump down) depend on the position of the process -- the higher the position, the greater the rate. The rates of jumps going in the same direction as the axes (jump up) are constants. Therefore the processes are ergodic. The large deviations are studied under equal scalings of both space and time. The scaled versions of the processes…
We prove a large deviation principle on path space for a class of discrete time Markov processes whose state space is the intersection of a regular domain $Ł\subset \R^d$ with some lattice of spacing $\e$. Transitions from $x$ to $y$ are allowed if $\e^{-1}(x-y)\in \D$ for some fixed set of vectors $\D$. The transition probabilities $p_\e(t,x,y)$, which themselves depend on $\e$, are allowed to depend on the starting point $x$ and the time $t$ in a sufficiently regular way, except near the boundaries, where some singular behaviour is allowed. The rate function is identified as an action functi…
Suppose $ E$ is a space with a null-recurrent Markov kernel $ P$. Furthermore, suppose there are infinite particles with variable weights on $ E$ performing a random walk following $ P$. Let $ X_{t}$ be a weighted functional of the position of particles at time $ t$. Under some conditions on the initial distribution of the particles the process $ (X_{t})$ is stationary over time. Non-Gaussian infinitely divisible (ID) distributions turn out to be natural candidates for the initial distribution and then the process $ (X_{t})$ is ID. We prove a functional large and moderate deviation principle f…
In this paper we consider two related stochastic models. The first one is a branching system consisting of particles moving according to a Markov family in R^d and undergoing subcritical branching with a constant rate of V>0. New particles immigrate to the system according to a homogeneous space time Poisson random field. The second model is the superprocess corresponding to the branching particle system. We study rescaled occupation time process and the process of its fluctuations with very mild assumptions on the Markov family. In the general setting a functional central limit theorem as wel…
In this paper, we present new Poisson-type deviation inequalities for continuous-time Markov chains whose Wasserstein curvature or $Γ$-curvature is bounded below. Although these two curvatures are equivalent for Brownian motion on Riemannian manifolds, they are not comparable in discrete settings and yield different deviation bounds. In the case of birth--death processes, we provide some conditions on the transition rates of the associated generator for such curvatures to be bounded below and we extend the deviation inequalities established [Ané, C. and Ledoux, M. On logarithmic Sobolev inequa…
Through this paper we analyze the ergodic properties of continuous time Markov chains with values on the one-dimensional spin lattice 1,...,d}^N (also known as the Bernoulli space). Initially, we consider as the infinitesimal generator the operator $L={\mc L}_A -I$, where \mc L_A is a discrete time Ruelle operator (transfer operator), and A:{1,...,d}^N \to R is a given fixed Lipschitz function. The associated continuous time stationary Markov chain will define the\emph{a priori}probability. Given a Lipschitz interaction V:\{1,...,d\}^{\bb N}\to \mathbb{R}, we are interested in Gibbs (equilibri…
We prove a sample path Large Deviation Principle (LDP) for a class of jump processes whose rates are not uniformly Lipschitz continuous in phase space. Building on it we further establish the corresponding Wentzell-Freidlin (W-F) (infinite time horizon) asymptotic theory. These results apply to jump Markov processes that model the dynamics of chemical reaction networks under mass action kinetics, on a microscopic scale. We provide natural sufficient topological conditions for the applicability of our LDP and W-F results. This then justifies the computation of non-equilibrium potential and expo…
For ${1/2}<α<1$, we propose the MDP analysis for family $$ S^α_n=\frac{1}{n^α}\sum_{i=1}^nH(X_{i-1}), n\ge 1, $$ where $(X_n)_{n\ge 0}$ be a homogeneous ergodic Markov chain, $X_n\in \mathbb{R}^d$, when the spectrum of operator $P_x$ is continuous. The vector-valued function $H$ is not assumed to be bounded but the Lipschitz continuity of $H$ is required. The main helpful tools in our approach are Poisson's equation and Stochastic Exponential; the first enables to replace the original family by $\frac{1}{n^α}M_n$ with a martingale $M_n$ while the second to avoid the direct Laplace transform an…
For ${1/2}<α<1$, we propose the MDP analysis for family $$ S^α_n=\frac{1}{n^α}\sum_{i=1}^nH(X_{i-1}), n\ge 1, $$ where $(X_n)_{n\ge 0}$ be a homogeneous ergodic Markov chain, $X_n\in \mathbb{R}^d$, when the spectrum of operator $P_x$ is continuous. The vector-valued function $H$ is not assumed to be bounded but the Lipschitz continuity of $H$ is required. The main helpful tools in our approach are Poisson equation and Stochastic Exponential; the first enables to replace the original family by $\frac{1}{n^α}M_n$ with a martingale $M_n$ while the second to avoid the direct Laplace transform anal…
Large deviations related to Dynkin--Lamperti arcsine laws for last visit times of Markov processes
Faculty of Arts and Sciences, Kyoto Institute of Technology（京都工艺纤维大学艺术与科学学院）；Department of Mathematics, Graduate School of Science, The University of Osaka（大阪大学理学研究科数学系）；Department of Systems Innovation, Graduate School of Engineering Science, The University of Osaka（大阪大学工学研究科系统创新系）
Large deviation results are given for a class of perturbed nonhomogeneous Markov chains on finite state space which formally includes some stochastic optimization algorithms. Specifically, let {P_n} be a sequence of transition matrices on a finite state space which converge to a limit transition matrix P. Let {X_n} be the associated nonhomogeneous Markov chain where P_n controls movement from time n-1 to n. The main statements are a large deviation principle and bounds for additive functionals of the nonhomogeneous process under some regularity conditions. In particular, when P is reducible, t…
