In 1956, Dobrushin proved a definitive central limit theorem for non-homogeneous Markov chains. In this note, a shorter and different proof elucidating more the assumptions is given through martingale approximation.
On conditions for Dobrushin's Central limit theorem for non-homogeneous Markov chains
A.A. Kharkevich Institute for Information Transmission Problems of Russian Academy of Sciences(俄罗斯科学院信息传输问题阿·阿·哈尔维奇研究所);S.M. Nikol’skii Mathematical Institute, RUDN University(俄罗斯人民友谊大学尼古利斯基数学研究所);National Research University Higher School of Economics(国立高等经济大学)
In this paper the stability and the perturbation bounds of Markov operators acting on abstract state spaces are investigated. Here, an abstract state space is an ordered Banach space where the norm has an additivity property on the cone of positive elements. We basically study uniform ergodic properties of Markov operators by means of so-called a generalized Dobrushin's ergodicity coefficient. This allows us to get several convergence results with rates. Some results on quasi-compactness of Markov operators are proved in terms of the ergodicity coefficient. Furthermore, a characterization of u…
Filter stability is a classical problem in the study of partially observed Markov processes (POMP), also known as hidden Markov models (HMM). For a POMP, an incorrectly initialized non-linear filter is said to be (asymptotically) stable if the filter eventually corrects itself as more measurements are collected. Filter stability results in the literature that provide rates of convergence typically rely on very restrictive mixing conditions on the transition kernel and measurement kernel pair, and do not consider their effects independently. In this paper, we introduce an alternative approach u…
In our earlier paper, a generalized Dobrushin ergodicity coefficient of Markov operators (acting on abstract state spaces) with respect to a projection $P$, has been introduced and studied. It turned out that the introduced coefficient was more effective than the usual ergodicity coefficient. In the present work, by means of a left consistent Markov projections and the generalized Dobrushin's ergodicity coefficient, we investigate uniform and weak $P$-ergodicities of non-homogeneous discrete Markov chains (NDMC) on abstract state spaces. It is easy to show that uniform $P$-ergodicity implies a…
Improved rates of convergence for ergodic Markov chains and relaxed conditions for them, as well as analogous convergence results for some non-homogeneous Markov chains are studied. The setting from the previous works is extended. Examples are provided where the new bounds are better and where they give the same convergence rate as in the classical Markov -- Dobrushin inequality.
We construct a nonstandard martingale from a discrete Markov chain. This is shown to be useful for solving the heat equation with a non smooth initial condition. We show that the nonstandard solution to the heat equation with a smooth initial condition specialises to the classical solution.
Comparison results for Markov processes w.r.t. function class induced (integral) stochastic orders have a long history. The most general results so far for this problem have been obtained based on the theory of evolution systems on Banach spaces. In this paper we transfer the martingale comparison method, known for the comparison of semimartingales to Markovian semimartingales, to general Markov processes. The basic step of this martingale approach is the derivation of the supermartingale property of the linking process, giving a link between the processes to be compared. In this paper this pr…
We discuss a class of Backward Stochastic Differential Equations(BSDEs) with no driving martingale. When the randomness of the driver depends on a general Markov process $X$, those BSDEs are denominated Markovian BSDEs and can be associated to a deterministic problem,called Pseudo-PDE which constitute the natural generalization of a parabolicsemilinear PDE which naturally appears when the underlying filtration is Brownian. We consider two aspects of well-posedness forthe Pseudo-PDEs: "classical" and "martingale" solutions.
Improved rates of convergence for ergodic homogeneous Markov chains are studied. In comparison to the earlier papers the setting is also generalised to the case without a unique dominated measure. Examples are provided where the new bound is compared with the classical Markov -- Dobrushin inequality and with the second eigenvalue of the transition matrix for finite state spaces.
In this paper we obtain the central limit theorem for triangular arrays of non-homogeneous Markov chains under a condition imposed to the maximal coefficient of correlation. The proofs are based on martingale techniques and a sharp lower bound estimate for the variance of partial sums. The results complement an important central limit theorem of Dobrushin based on the contraction coefficient.
We present sufficient conditions, in terms of the jumping kernels, for two large classes of conservative Markov processes of pure-jump type to be purely discontinuous martingales with finite second moment. As an application, we establish the law of the iterated logarithm for sample paths of the associated processes.
We identify the linear space spanned by the real-valued excessive functions of a Markov process with the set of those functions which are quasimartingales when we compose them with the process. Applications to semi-Dirichlet forms are given. We provide a unifying result which clarifies the relations between harmonic, co-harmonic, invariant, co-invariant, martingale and co-martingale functions, showing that in the conservative case they are all the same. Finally, using the co-excessive functions, we present a two-step approach to the existence of invariant probability measures.
We study general properties for the family of stochastic processes with polynomial regression property, that is that every conditional moment of the process is a polynomial. It turns out that then there exists a family of polynomial martingales $\left\{ M_{n}(X_{t},t)\right\}_{n\geq1}$ that contains complete information on the distribution (both marginal and transitional) of the process. We specify conditions expressed in terms of $M_{n}^{\prime}s$ under which a given process has independent increments and further is a Levy process, contains reversed martingales, is a harness or quadratic harn…
In this paper we prove that every random variable of the form $F(M_T)$ with $F:\real^d \to\real$ a Borelian map and $M$ a $d$-dimensional continuous Markov martingale with respect to a Markov filtration $\mathcal{F}$ admits an exact integral representation with respect to $M$, that is, without any orthogonal component. This representation holds true regardless any regularity assumption on $F$. We extend this result to Markovian quadratic growth BSDEs driven by $M$ and show they can be solved without an orthogonal component. To this end, we extend first existence results for such BSDEs under a …
The existence of global martingale weak solution for the 2D and 3D stochastic Cahn-Hilliard-Navier-Stokes equations driven by multiplicative noise in a smooth bounded domain is established. In particular, the system is supplied with the dynamic boundary condition which accounts for the interaction between the fluid components and the rigid walls. The proof is completed by a three-level approximate scheme combining a fixed point argument and the stochastic compactness argument, overcoming challenges from strong nonlinearity, dynamic boundary and random effect. Then, we prove the existence of an…
We prove a new inequality controlling the large deviations of the empirical measure of a Markov chain. This inequality is based on the martingale used by Donsker and Varadhan and the minimax theorem. It holds for convex sets and it requires to take an infimum over the starting point. In the case of a compact space, this inequality is a partial improvement of the large deviations estimates of Donsker and Varadhan. In the case of a non compact space, we condition on the event that the process visits $n$ times a compact subset of the space and we still obtain a control on the exponential scale.
We focus on a class of BSDEs driven by a cadlag martingale and corresponding Markov type BSDE which arise when the randomness of the driver appears through a Markov process. To those BSDEs we associate a deterministic problem which, when the Markov process is a Brownian diffusion, is nothing else but a parabolic type PDE. The solution of the deterministic problem is intended as decoupled mild solution, and it is formulated with the help of a time-inhomogeneous semigroup.
In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition steps. An example of a class such a process provided indicates that such types of estimates considering several transition steps may be applicable when one transition can not guarantee any convergence. Moreover, a better estimate can be obtained for a higher number of transitions steps. A law of large numbers is presented for a class of ergodic nonlinear Ma…
Constrained Markov processes, such as reflecting diffusions, behave as an unconstrained process in the interior of a domain but upon reaching the boundary are controlled in some way so that they do not leave the closure of the domain. In this paper, the behavior in the interior is specified by a generator of a Markov process, and the constraints are specified by a controlled generator. Together, the generators define a "constrained martingale problem". The desired constrained processes are constructed by first solving a simpler "controlled martingale problem" and then obtaining the desired pro…
In this Note we consider a quadratic backward stochastic differential equation (BSDE) driven by a continuous martingale $M$ and whose generator is a deterministic function. We prove (in Theorem \ref{theorem:main}) that if $M$ is a strong homogeneous Markov process and if the BSDE has the form \eqref{BSDE} then the unique solution $(Y,Z,N)$ of the BSDE is reduced to $(Y,Z)$, \textit{i.e.} the orthogonal martingale $N$ is equal to zero showing that in a Markovian setting the "usual" solution $(Y,Z)$ has not to be completed by a strongly orthogonal even if $M$ does not enjoy the martingale repres…
This work shows how exponential concentration inequalities for additive functionals of stochastic processes over a finite time interval can be derived from concentration inequalities for martingales. The approach is entirely probabilistic and naturally includes time-inhomogeneous and non-stationary processes as well as initial laws concentrated on a single point. The class of processes studied includes martingales, Markov processes and general square integrable processes. The general approach is complemented by a simple and direct method for martingales, diffusions and discrete-time Markov pro…
The Dobrushin comparison theorem is a powerful tool to bound the difference between the marginals of high-dimensional probability distributions in terms of their local specifications. Originally introduced to prove uniqueness and decay of correlations of Gibbs measures, it has been widely used in statistical mechanics as well as in the analysis of algorithms on random fields and interacting Markov chains. However, the classical comparison theorem requires validity of the Dobrushin uniqueness criterion, essentially restricting its applicability in most models to a small subset of the natural pa…
Let $\mathfrak{z}$ be a stochastic exponential, i.e., $\mathfrak{z}_t=1+\int_0^t\mathfrak{z}_{s-}dM_s$, of a local martingale $M$ with jumps $\triangle M_t>-1$. Then $\mathfrak{z}$ is a nonnegative local martingale with $\E\mathfrak{z}_t\le 1$. If $\E\mathfrak{z}_T= 1$, then $\mathfrak{z}$ is a martingale on the time interval $[0,T]$. Martingale property plays an important role in many applications. It is therefore of interest to give natural and easy verifiable conditions for the martingale property. In this paper, the property $\E\mathfrak{z}_{_T}=1$ is verified with the so-called linear gro…
In this paper we survey the almost sure central limit theorem and its functional form (quenched) for stationary and ergodic processes. For additive functionals of a stationary and ergodic Markov chain these theorems are known under the terminology of central limit theorem and its functional form, started at a point. All these results have in common that they are obtained via a martingale approximation in the almost sure sense. We point out several applications of these results to classes of mixing sequences, shift processes, reversible Markov chains, Metropolis Hastings algorithms.
In fluid dynamics governed by the one dimensional inviscid Burgers equation $\partial_t u+u\partial_x(u)=0$, the stirring is explained by the sticky particles model. A Markov process $([Z^1_t,Z^2_t],\,t\geq0)$ describes the motion of random turbulent intervals which evolve inside an other Markov process $([Z^3_t,Z^4_t],\,t\geq0)$, describing the motion of random clusters concerned with the turbulence. Then, the four velocity processes $(u(Z^i_t,t),\,t\geq0)$ are backward semi-martingales.
Hamza-Klebaner posed the problem of constructing martingales with Brownian marginals that differ from Brownian motion, so called fake Brownian motions. Besides its theoretical appeal, the problem represents the quintessential version of the ubiquitous fitting problem in mathematical finance where the task is to construct martingales that satisfy marginal constraints imposed by market data. Non-continuous solutions to this challenge were given by Madan-Yor, Hamza-Klebaner, Hobson, and Fan-Hamza-Klebaner whereas continuous (but non-Markovian) fake Brownian motions were constructed by Oleszkiewic…
The density-dependent Markov chain (DDMC) introduced in \cite{Kurtz1978} is a continuous time Markov process applied in fields such as epidemics, chemical reactions and so on. In this paper, we give moderate deviation principles of paths of DDMC under some generally satisfied assumptions. The proofs for the lower and upper bounds of our main result utilize an exponential martingale and a generalized version of Girsanov's theorem. The exponential martingale is defined according to the generator of DDMC.
The solution of Poisson's equation plays a key role in constructing the martingale through which sums of Markov correlated random variables can be analyzed. In this paper, we study two different representations for the solution in countable state space, one based on regenerative structure and the other based on an infinite sum of expectations. We also consider integrability and related uniqueness issues associated with solutions to Poisson's equation, and provide verifiable Lyapunov conditions to support our theory. Our key results include a central limit theorem and law of the iterated logari…
The dynamics of a Markov process are often specified by its infinitesimal generator or, equivalently, its symbol. This paper contains examples of analytic symbols which do not determine the law of the corresponding Markov process uniquely. These examples also show that the law of a polynomial process is not necessarily determined by its generator. On the other hand, we show that a combination of smoothness of the symbol and ellipticity warrants uniqueness in law. The proof of this result is based on proving stability of univariate marginals relative to some properly chosen distance.
We show a decomposition into the sum of a martingale and a deterministic quantity for time averages of the solutions to non-autonomous SDEs and for discrete-time Markov processes. In the SDE case the martingale has an explicit representation in terms of the gradient of the associated semigroup or transition operator. We show how the results can be used to obtain quenched Gaussian concentration inequalities for time averages and to provide insights into the Averaging principle for two-timescale processes.
We study optimal investment strategies that maximize expected utility from consumption and terminal wealth in a pure-jump asset price model with Markov-modulated (regime switching) jump-size distributions. We give sufficient conditions for existence of optimal policies and find closed-form expressions for the optimal value function for agents with logarithmic and fractional power (CRRA) utility in the case of two-state Markov chains. The main tools are convex duality techniques, stochastic calculus for pure-jump processes and explicit formulae for the moments of telegraph processes with Markov…
In this paper we establish a complete representation theorem for $G$-martingales. Unlike the existing results in the literature, we provide the existence and uniqueness of the second order term, which corresponds to the second order derivative in Markovian case. The main ingredient of the paper is a new norm for that second order term, which is based on an operator introduced by Song [26].
IIn this paper we provide predictable and chaotic representations for Itô-Markov additive processes $X$. Such a process is governed by a finite-state CTMC $J$ which allows one to modify the parameters of the Itô-jump process (in so-called regime switching manner). In addition, the transition of $J$ triggers the jump of $X$ distributed depending on the states of $J$ just prior to the transition. This family of processes includes Markov modulated Itô-Lévy processes and Markov additive processes. The derived chaotic representation of a square-integrable random variable is given as a sum of stocha…
Let $(\mathbb{P}^{s,x})_{(s,x)\in[0,T]\times E}$ be a family of probability measures, where $E$ is a Polish space,defined on the canonical probability space ${\mathbb D}([0,T],E)$ of $E$-valued cadlag functions. We suppose that a martingale problem with respect to a time-inhomogeneous generator $a$ is well-posed. We consider also an associated semilinear {\it Pseudo-PDE} with generator $a$ for which we introduce a notion of so called {\it decoupled mild} solution and study the equivalence with the notion of martingale solution introduced in a companion paper. We also investigate well-posedness…
The paper introduces and investigates the natural extension to the path-dependent setup of the usual concept of canonical Markov class introduced by Dynkin and which is at the basis of the theory of Markov processes. That extension, indexed by starting paths rather than starting points will be called path-dependent canonical class. Associated with this is the generalization of the notions of semi-group and of additive functionals to the path-dependent framework. A typical example of such family is constituted by the laws $({\mathbb P}^{s,$η$})\_{(s,η) \in{\mathbb R} \times Ω}$ , where for fixe…
We consider a general piecewise deterministic Markov process (PDMP) $X=\{X_t\}_{t\geqslant 0}$ with measure-valued generator $\mathcal{A}$, for which the conditional distribution function of the inter-occurrence time is not necessarily absolutely continuous. A general form of the exponential martingales is presented as $$M^f_t=\frac{f(X_t)}{f(X_0)}\left[\mathrm{Sexp}\left(\int_{(0,t]}\frac{\mathrm{d}L(\mathcal{A}f)_s}{f(X_{s-})}\right)\right]^{-1}.$$ Using this exponential martingale as a likelihood ratio process, we define a new probability measure. It is shown that the original process remai…
In this paper we develop non-stationary martingale techniques for dependent data. We shall stress the non-stationary version of the projective Maxwell-Woodroofe condition, which will be essential for obtaining maximal inequalities and functional central limit theorem for the following examples: nonstationary \r{ho}-mixing sequences, functions of linear processes with non-stationary innovations, quenched version of the functional central limit theorem for a stationary sequence, evolutions in random media such as a process sampled by a shifted Markov chain.
In the first part of this paper, we give a useful criterion for uniform integrability of exponential martingales in the context of Markov processes. The condition of this criterion is easy to verify and is, in general, much weaker than the commonly used Novikov's condition. In the second part of this paper, we present a new approach to the study of spectral bounds of Feynman-Kac semigroups for a large class of symmetric Markov processes. We first establish criteria for the $L^p$-independence of spectral bounds for Feynman-Kac semigroups generated by continuous additive functionals, using gauge…