In this paper we study the additive functionals of Markov chains via conditioning with respect to both past and future of the chain. We shall point out new sufficient projective conditions, which assure that the variance of partial sums of n consecutive random variables of a stationary Markov chain is linear in n. The paper also addresses the central limit theorem problem and is listing several open questions.
In this paper we consider stationary Markov chains with trivial two-sided tail sigma field, and prove that additive functionals satisfy the central limit theorem provided the variance of partial sums divided by n is bounded.
In this paper we give sufficient conditions for the almost sure central limit theorem started at a point, known under the name of quenched central limit theorem. This is achieved by using a new idea of conditioning with respect to both the past and the future of the Markov chain. As applications we provide a new sufficient projective conditions for the quenched CLT.
In this paper we study the central limit theorem for additive functionals of stationary Markov chains with general state space by using a new idea involving conditioning with respect to both the past and future of the chain. Practically, we show that any additive functionals of a stationary and totally ergodic Markov chain with the variance of S_n divided by n uniformly bounded, satisfies a square root central limit theorem with a random centering. We do not assume that the Markov chain is irreducible and aperiodic. However, the random centering is not needed if the Markov chain satisfies stro…
The Central Limit Theorem (CLT) for additive functionals of Markov chains is a well known result with a long history. In this paper we present applications to two finite-memory versions of the Elephant Random Walk, solving a problem from arXiv:1812.01915. We also present a derivation of the CLT for additive functionals of finite state Markov chains, which is based on positive recurrence, the CLT for IID sequences and some elementary linear algebra, and which focuses on characterization of the variance.
We present a general functional central limit theorem started at a point also known under the name of quenched. As a consequence, we point out several new classes of stationary processes, defined via projection conditions, which satisfy this type of asymptotic result. One of the theorems shows that if a Markov chain is stationary ergodic and reversible, this result holds for bounded additive functionals of the chain which have a martingale coboundary in L_1 representation. Our results are also well adapted for strongly mixing sequences providing for this case an alternative, shorter approach t…
In this paper, we investigate the functional central limit theorem for stochastic processes associated to partial sums of additive functionals of reversible Markov chains with general spate space, under the normalization standard deviation of partial sums. For this case, we show that the functional central limit theorem is equivalent to the fact that the variance of partial sums is regularly varying with exponent 1 and the partial sums satisfy the CLT. It is also equivalent to the conditional CLT.
The solution of Poisson's equation plays a key role in constructing the martingale through which sums of Markov correlated random variables can be analyzed. In this paper, we study two different representations for the solution in countable state space, one based on regenerative structure and the other based on an infinite sum of expectations. We also consider integrability and related uniqueness issues associated with solutions to Poisson's equation, and provide verifiable Lyapunov conditions to support our theory. Our key results include a central limit theorem and law of the iterated logari…
In this paper we develop non-stationary martingale techniques for dependent data. We shall stress the non-stationary version of the projective Maxwell-Woodroofe condition, which will be essential for obtaining maximal inequalities and functional central limit theorem for the following examples: nonstationary \r{ho}-mixing sequences, functions of linear processes with non-stationary innovations, quenched version of the functional central limit theorem for a stationary sequence, evolutions in random media such as a process sampled by a shifted Markov chain.
We obtain convergence rates (in the Levi-Prokhorove metric) in the functional central limit theorem (CLT) for partial sums $S_n=\sum_{j=1}^{n}ξ_{j,n}$ of triangular arrays $\{ξ_{1,n},ξ_{2,n},...,ξ_{n,n}\}$ satisfying some mixing and moment conditions (which are not necessarily uniform in $n$). For certain classes of additive functionals of triangular arrays of contracting Markov chains (in the sense of Dobrushin) we obtain rates which are close to the best rates obtained for independent random variables. In addition, we obtain close to optimal rates in the usual CLT and a moderate deviations p…
In this paper, we study the quenched central limit theorem for the discrete Fourier transform. We show that the Fourier transform of a stationary ergodic process, suitable centered and normalized, satisfies the quenched CLT conditioned by the past sigma algebra. For functions of Markov chains with stationary transitions, this means that the CLT holds with respect to the law of the chain started at a point for almost all starting points. It is necessary to emphasize that no assumption of irreducibility with respect to a measure or other regularity conditions are imposed for this result. We also…
We provide necessary and sufficient conditions for convergence of exponential integrals of Markov additive processes. Other than in the classical Lévy case studied by Erickson and Maller we have to distinguish between almost sure convergence and convergence in probability. Our proofs rely on recent results on perpetuities in a Markovian environment by Alsmeyer and Buckmann.
General Markov chains with a countably additive transition probability in arbitrary phase space are considered. Markov operators extend from the space of countably additive measures to the space of finitely additive measures. In the author's papers a theorem was earlier proved that if all invariant finitely additive measures of a Markov chain are countably additive, i.e. there are no invariant purely finitely additive measures, then their subspace is finite-dimensional and the Markov chain satisfies the Doob-Doeblin quasicompactness conditions. In the same paper, a partial inversion of this th…
In the last decade Hawkes processes have received much attention as models for functional connectivity in neural spiking networks and other dynamical systems with a cascade behavior. In this paper we establish a renewal approach for analyzing this process. We consider the ordinary nonlinear Hawkes process as well as the more recently described age dependent Hawkes process. We construct renewal-times and establish moment results for these. This gives rise to study the Hawkes process as a Markov chain. As an application, we prove asymptotic results such as a functional CLT and a time-average CLT…
We propose some backward-forward martingale decompositions for functions of reversible Markov chains. These decompositions are used to prove the functional CLT for reversible Markov chains with asymptotically linear variance of partial sums. We also provide a proof of the equivalence between asymptotic linearity of the variance and convergence of the integral of $1/(1-t)$ with respect to the associated spectral measure $ρ$. We also study the asymptotic behavior of linear processes having as innovations mean zero square integrable functions of stationary reversible Markov chains. We apply this …
In this paper, we consider general Markov chains (MC), specified by the transition probability (kernel) $ P (x, E) $, finitely additive in the second argument. Such MC are studied within the framework of the functional operator treatment. The state space (phase space) of the MC $ X $ has any cardinality, and the sigma-algebra $ Σ$ is discrete, i.e. is the set of all subsets in $ X $. This construction of the phase space $ (X, Σ) $ allows us to decompose the Markov kernel $ P (x, E) $ into the sum of two components - countably additive and purely finitely additive in the second argument and mea…
We study the exponential growth of bifurcating processes with ancestral dependence. We suppose here that the lifetimes of the cells are dependent random variables, that the numbers of new cells are random and dependent. Lifetimes and new cells's numbers are also assumed to be dependent. We illustrate our results by examples, including some Markov models. Our approach is related to the behaviour of the Laplace transform of nonnegative additive functional of Markov chains and require weak moment assumption (no exponential moment is needed).
Using the renewal approach we prove Bernstein-like inequalities for additive functionals of geometrically ergodic Markov chains, thus obtaining counterparts of inequalities for sums of independent random variables. The coefficient in the sub-Gaussian part of our estimate is the asymptotic variance of the additive functional, i.e. the variance of the limiting Gaussian variable in the Central Limit Theorem for Markov chains. This refines earlier results by R. Adamczak and W. Bednorz, which were obtained under the additional assumption of strong aperiodicity of the chain.
From multitype branching Brownian motions to branching Markov additive processes
University of Chinese Academy of Sciences（中国科学院大学）；Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院）；LMAM School of Mathematical Sciences & Center for Statistical Science, Peking University（北京大学数学学院（LMAM）及统计科学中心）；School of Mathematical Sciences, Beijing University of Posts and Telecommunications（北京邮电大学数学科学学院）
We provide results relating to the integrability, uniform integrability and local integrability of exponential MAPs, which are natural extensions of exponential Levy models. Then, we use Mellin transform and partial integro-differential equation methods to value European options under a such a model. Finally, a comparison is made between the price of a European call option and that of an Asian call option.
We derive the Markov-modulated generalized Ornstein-Uhlenbeck process by embedding a Markov-modulated random recurrence equation in continuous time. The obtained process turns out to be the unique solution of a certain stochastic differential equation driven by a bivariate Markov-additive process. We present this stochastic differential equation as well as its solution explicitely in terms of the driving Markov-additive process. Moreover, we give necessary and sufficient conditions for strict stationarity of the Markov-modulated generalized Ornstein-Uhlenbeck process, and prove that its statio…
