For a class of stationary Markov-dependent sequences $(A_n,B_n)\in\mathbb{R}^2,$ we consider the random linear recursion $S_n=A_n+B_nS_{n-1},$ $n\in\mathbb{Z},$ and show that the distribution tail of its stationary solution has a power law decay.
We study a linear recursion with random Markov-dependent coefficients. In a "regular variation in, regular variation out" setup we show that its stationary solution has a multivariate regularly varying distribution. This extends results previously established for i.i.d. coefficients.
We consider the equation R(n)=Q(n)+M(n) R(n-1), with random non-i.i.d. coefficients (Q(n),M(n)), and show that the distribution tails of the stationary solution to this equation are regularly varying at infinity.
The Large Deviation Principle is established for stochastic models defined by past-dependent non linear recursions with small noise. In the Markov case we use the result to obtain an explicit expression for the asymptotics of exit time.
We consider the linear stochastic recursion $x_{i+1} = a_{i}x_{i}+b_{i}$ where the multipliers $a_i$ are random and have Markovian dependence given by the exponential of a standard Brownian motion and $b_{i}$ are i.i.d. positive random noise independent of $a_{i}$. Using large deviations theory we study the growth rates (Lyapunov exponents) of the positive integer moments $λ_q = \lim_{n\to \infty} \frac{1}{n} \log\mathbb{E}[(x_n)^q]$ with $q\in \mathbb{Z}_+$. We show that the Lyapunov exponents $λ_q$ exist, under appropriate scaling of the model parameters, and have non-analytic behavior manif…
Multivariate stochastic recurrence equations (SREs) are investigated when coefficients are triangular matrices. If coefficient matrices of SREs have all strictly positive elements, the Kesten's classical result yields solutions with regularly varying tails such that the tail indices of solutions are the same through coordinates. This framework is too restrictive for applications. In order to widen the applicability of the SREs, we study SREs with triangular matrix coefficients and prove that they have regularly varying solutions which may exhibit coordinate-wisely different tail exponents. We …
We consider a general multivariate affine stochastic recursion and the associated Markov chain on $\mathbb R^{d}$. We assume a natural geometric condition which implies existence of an unbounded stationary solution and we show that the large values of the associated stationary process follow extreme value properties of classical type, with a non trivial extremal index. We develop some explicit consequences such as convergence to Fr{é}chet's law or to an exponential law, as well as convergence to a stable law. The proof is based on a spectral gap property for the action of associated positive o…
We consider a Markov chain $\{X_n\}_{n=0}^\8$ on $\R^d$ defined by the stochastic recursion $X_{n}=M_n X_{n-1}+Q_n$, where $(Q_n,M_n)$ are i.i.d. random variables taking values in the affine group $H=\R^d\rtimes {\rm GL}(\R^d)$. Assume that $M_n$ takes values in the similarity group of $\R^d$, and the Markov chain has a unique stationary measure $ν$, which has unbounded support. We denote by $|M_n|$ the expansion coefficient of $M_n$ and we assume $\E |M|^\a=1$ for some positive $\a$. We show that the partial sums $S_n=\sum_{k=0}^n X_k$, properly normalized, converge to a normal law ($\a\ge 2$…
Let $Φ_n$ be an i.i.d. sequence of Lipschitz mappings of $\R^d$. We study the Markov chain $\{X_n^x\}_{n=0}^\infty$ on $\R^d$ defined by the recursion $X_n^x = Φ_n(X^x_{n-1})$, $n\in\N$, $X_0^x=x\in\R^d$. We assume that $Φ_n(x)=Φ(A_n x,B_n(x))$ for a fixed continuous function $Φ:\R^d\times \R^d\to\R^d$, commuting with dilations and i.i.d random pairs $(A_n,B_n)$, where $A_n\in {End}(\R^d)$ and $B_n$ is a continuous mapping of $\R^d$. Moreover, $B_n$ is $α$-regularly varying and $A_n$ has a faster decay at infinity than $B_n$. We prove that the stationary measure $ν$ of the Markov chain $\{X_n^…
Let $X_1,X_2,...$ be a sequence of random variables satisfying the distributional recursion $X_1=0$ and $X_n= X_{n-I_n}+1$ for $n=2,3,...$, where $I_n$ is a random variable with values in $\{1,...,n-1\}$ which is independent of $X_2,...,X_{n-1}$. The random variable $X_n$ can be interpreted as the absorption time of a suitable death Markov chain with state space ${\mathbb N}:=\{1,2,...\}$ and absorbing state 1, conditioned that the chain starts in the initial state $n$. This paper focuses on the asymptotics of $X_n$ as $n$ tends to infinity under the particular but important assumption that th…
Consider a discrete finite-dimensional, Markovian market model. In this setting, discretely sampled American options can be priced using the so-called ``non-recombining'' tree algorithm. By successively increasing the number of exercise times, the American option price itself can be computed; for combinatorial reasons, we shall consider a recursive algorithm that doubles the number of exercise times at each recursion step. First we prove, by elementary arguments, error bounds for the first order differences in this recursive algorithm. From this, bounds on the higher order differences can be o…
This paper considers an approximation usually used when implementing Ramaswami's recursion for the stationary distribution of the M/G/1-type Markov chain. The approximation is called the level-increment-truncation approximation because it truncates level increment at a given threshold. The main contribution of this paper is to present a geometric convergence formula of the level-wise difference between the respective stationary distributions of the original M/G/1-type Markov chain and its LI truncation approximation under the assumption that the level-increment distribution is light-tailed.
We give a development of the ODE method for the analysis of recursive algorithms described by a stochastic recursion. With variability modelled via an underlying Markov process, and under general assumptions, the following results are obtained: 1. Stability of an associated ODE implies that the stochastic recursion is stable in a strong sense when a gain parameter is small. 2. The range of gain-values is quantified through a spectral analysis of an associated linear operator, providing a non-local theory. 3. A second-order analysis shows precisely how variability leads to sensitivity of the al…
We consider a renewal-like recursion and prove that the solution is polynomially decaying asymptotically under suitable conditions. We prove similar results for the corresponding integral equation. In both cases coefficients and functions are of more general form than in the classic cases.
Consider the real Markov walk $S_n = X_1+ \dots+ X_n$ with increments $\left(X_n\right)_{n\geq 1}$ defined by a stochastic recursion starting at $X_0=x$. For a starting point $y>0$ denote by $τ_y$ the exit time of the process $\left( y+S_n \right)_{n\geq 1}$ from the positive part of the real line. We investigate the asymptotic behaviour of the probability of the event $τ_y \geq n$ and of the conditional law of $y+S_n$ given $τ_y \geq n$ as $n \to +\infty$.
This paper compiles several aspects of the dynamics of stochastic approximation algorithms with Markov iterate-dependent noise when the iterates are not known to be stable beforehand. We achieve the same by extending the lock-in probability (i.e. the probability of convergence of the iterates to a specific attractor of the limiting o.d.e. given that the iterates are in its domain of attraction after a sufficiently large number of iterations (say) n 0 ) framework to such recursions. Specifically, with the more restrictive assumption of Markov iterate-dependent noise supported on a bounded subse…
We fix $d \geq 2$ and denote $\mathcal S$ the semi-group of $d \times d$ matrices with non negative entries. We consider a sequence $(A_n, B_n)_{n \geq 1} $ of i. i. d. random variables with values in $\mathcal S\times \mathbb R_+^d$ and study the asymptotic behavior of the Markov chain $(X_n)_{n \geq 0}$ on $ \mathbb R_+^d$ defined by: \[ \forall n \geq 0, \qquad X_{n+1}=A_{n+1}X_n+B_{n+1}, \] where $X_0$ is a fixed random variable. We assume that the Lyapunov exponent of the matrices $A_n$ equals $0$ and prove, under quite general hypotheses, that there exists a unique (infinite) Radon measu…
Let $V=\mathbb R^d$ be the Euclidean $d$-dimensional space, $μ$ (resp $λ$) a probability measure on the linear (resp affine) group $G=G L (V)$ (resp $H= \Aff (V))$ and assume that $μ$ is the projection of $λ$ on $G$. We study asymptotic properties of the iterated convolutions $μ^n *δ\_{v}$ (resp $λ^n*δ\_{v})$ if $v\in V$, i.e asymptotics of the random walk on $V$ defined by $μ$ (resp $λ$), if the subsemigroup $T\subset G$ (resp.\ $Σ\subset H$) generated by the support of $μ$ (resp $λ$) is "large". We show spectral gap properties for the convolution operator defined by $μ$ on spaces of homogene…
The random coefficient integer-valued autoregressive process was introduced by Zheng, Basawa, and Datta. In this paper we study the asymptotic behavior of this model (in particular, weak limits of extreme values and the growth rate of partial sums) in the case where the additive term in the underlying random linear recursion belongs to the domain of attraction of a stable law.
We show the complete proof of the Markov property of the strong solution to a multidimensional SDE whose coefficients involve local time on a hyperplane of the unknown process.
We consider a general multidimensional affine recursion with corresponding Markov operator $P$ and a unique $P$-stationary measure. We show spectral gap properties on Hölder spaces for the corresponding Fourier operators and we deduce convergence to stable laws for the Birkhoff sums along the recursion. The parameters of the stable laws are expressed in terms of basic quantities depending essentially on the matricial multiplicative part of $P$. Spectral gap properties of $P$ and homogeneity at infinity of the $P$-stationary measure play an important role in the proofs.
We introduce a general algorithm for the computation of the scale functions of a spectrally negative Lévy process $X$, based on a natural weak approximation of $X$ via upwards skip-free continuous-time Markov chains with stationary independent increments. The algorithm consists of evaluating a finite linear recursion with its (nonnegative) coefficients given explicitly in terms of the Lévy triplet of $X$. Thus it is easy to implement and numerically stable. Our main result establishes sharp rates of convergence of this algorithm providing an explicit link between the semimartingale characteris…
Recurrence of multidimensional affine recursions in the critical case
Laboratoire d’Analyse et de Mathématiques Appliquées UMR 8050, Université Gustave Eiffel, Université Paris-Est Créteil, CNRS(应用分析与数学实验室 UMR 8050,巴黎东克雷泰伊大学,古斯塔夫·埃菲尔大学,法国国家科学研究中心);Institut Denis Poisson UMR 7013, Université de Tours, Université d’Orléans, CNRS(丹尼斯·普瓦松研究所 UMR 7013,图尔大学,奥尔良大学,法国国家科学研究中心)
In this paper we discuss backward stochastic differential equations with Markov chain noise, having continuous drivers. We obtain the existence of a solution which is possibly not unique. Moreover, we show there is a minimal solution for this kind of equation and derive the corresponding comparison result. This is applied to pricing of European options in a market with Markov chain noise.
Ito's construction of Markovian solutions to stochastic equations driven by a Lévy noise is extended to nonlinear distribution dependent integrands aiming at the effective construction of linear and nonlinear Markov semigroups and the corresponding processes with a given pseudo-differential generator. It is shown that a conditionally positive integro-differential operator (of the Lévy-Khintchine type) with variable coefficients (diffusion, drift and Lévy measure) depending Lipschitz continuously on its parameters (position and/or its distribution) generates a linear or nonlinear Markov semigro…
We consider a linear stochastic fluid network under Markov modulation, with a focus on the probability that the joint storage level attains a value in a rare set at a given point in time. The main objective is to develop efficient importance sampling algorithms with provable performance guarantees. For linear stochastic fluid networks without modulation, we prove that the number of runs needed (so as to obtain an estimate with a given precision) increases polynomially (whereas the probability under consideration decays essentially exponentially); for networks operating in the slow modulation r…
We consider the following recurrence relation with random i.i.d. coefficients $(a_n,b_n)$: $$ x_{n+1}=a_{n+1} x_n+b_{n+1} $$ where $a_n\in GL(d,\mathbb{R}),b_n\in \mathbb{R}^d$. Under natural conditions on $(a_n,b_n)$ this equation has a unique stationary solution, and its support is non-compact. We show that, in general, its law has a heavy tail behavior and we study the corresponding directions. This provides a natural construction of laws with heavy tails in great generality. Our main result extends to the general case the results previously obtained by H. Kesten in [16] under positivity or…
The paper considers a stochastic differential equation of Duffing type with Markov coefficients. The existence of unpredictable solutions is considered. The unpredictability is a property of bounded functions characterized by unbounded sequences of moments of divergence and convergence in Bebutov dynamics. Markov components of the equation coefficients admit the unpredictability property. The components of the equation coefficients are derived from a Markov chain. The existence, uniqueness and exponential stability of an unpredictable solution are proved. The sequences of divergence and conver…
This paper is related to nonzero-sum stochastic differential games in the Markovian framework. We show existence of a Nash equilibrium point for the game when the drift is no longer bounded and only satisfies a linear growth condition. The main tool is the notion of backward stochastic differential equations which, in our case, are multidimensional with continuous coefficient and stochastic linear growth.
In this paper the stability and the perturbation bounds of Markov operators acting on abstract state spaces are investigated. Here, an abstract state space is an ordered Banach space where the norm has an additivity property on the cone of positive elements. We basically study uniform ergodic properties of Markov operators by means of so-called a generalized Dobrushin's ergodicity coefficient. This allows us to get several convergence results with rates. Some results on quasi-compactness of Markov operators are proved in terms of the ergodicity coefficient. Furthermore, a characterization of u…
We apply Doeblin's ergodicity coefficient as a computational tool to approximate the occupancy distribution of a set of states in a homogeneous but possibly non-stationary finite Markov chain. Our approximation is based on new properties satisfied by this coefficient, which allow us to approximate a chain of duration n by independent and short-lived realizations of an auxiliary homogeneous Markov chain of duration of order ln(n). Our approximation may be particularly useful when exact calculations via first-step methods or transfer matrices are impractical, and asymptotic approximations may no…
Given a barrier $0 \leq b_0 \leq b_1 \leq ...$, let $f(n)$ be the number of nondecreasing integer sequences $0 \leq a_0 \leq a_1 \leq ... \leq a_n$ for which $a_j \leq b_j$ for all $0 \leq j \leq n$. Known formulæfor $f(n)$ include an $n \times n$ determinant whose entries are binomial coefficients (Kreweras, 1965) and, in the special case of $b_j = rj+s$, a short explicit formula (Proctor, 1988, p.320). A relatively easy bivariate recursion, decomposing all sequences according to $n$ and $a_n$, leads to a bivariate generating function, then a univariate generating function, then a linear recu…
We present two novel approaches for the computation of the exact distribution of a pattern in a long sequence. Both approaches take into account the sparse structure of the problem and are two-part algorithms. The first approach relies on a partial recursion after a fast computation of the second largest eigenvalue of the transition matrix of a Markov chain embedding. The second approach uses fast Taylor expansions of an exact bivariate rational reconstruction of the distribution. We illustrate the interest of both approaches on a simple toy-example and two biological applications: the transcr…
In our earlier paper, a generalized Dobrushin ergodicity coefficient of Markov operators (acting on abstract state spaces) with respect to a projection $P$, has been introduced and studied. It turned out that the introduced coefficient was more effective than the usual ergodicity coefficient. In the present work, by means of a left consistent Markov projections and the generalized Dobrushin's ergodicity coefficient, we investigate uniform and weak $P$-ergodicities of non-homogeneous discrete Markov chains (NDMC) on abstract state spaces. It is easy to show that uniform $P$-ergodicity implies a…