Let Y be an Ornstein-Uhlenbeck diffusion governed by a stationary and ergodic Markov jump process X: dY_t=a(X_t)Y_t dt+σ(X_t) dW_t, Y_0=y_0. Ergodicity conditions for Y have been obtained. Here we investigate the tail propriety of the stationary distribution of this model. A characterization of either heavy or light tail case is established. The method is based on a renewal theorem for systems of equations with distributions on R.
In this paper, the weak convergence of impulsive recurrent process with semi-Markov switching in the scheme of Levy approximation is proved. Singular perturbation problem for the compensating operator of the extended Markov renewal process is used to prove the relative compactness.
In this paper, the weak convergence of impulsive recurrent process with Markov switching in the scheme of Levy approximation is proved. For the relative compactness, a method proposed by R. Liptser for semimartingales is used with a modification, where we apply a solution of a singular perturbation problem instead of an ergodic theorem.
This work is denoted to studying the tail behavior of Cox-Ingersoll-Ross (CIR) processes with regime-switching. One essential difference shown in this work between CIR process with regime-switching and without regime-switching is that the stationary distribution for CIR process with regime-switching could be heavy-tailed. Our results provide a theoretical evidence of the existence of regime-switching for interest rates model based on its heavy-tailed empirical evidence. In this work, we first provide sharp criteria to justify the existence of stationary distribution for the CIR process with re…
In this paper, the weak convergence of additive functionals of processes with locally independent increments and with Markov switching in the scheme of Poisson approximation is proved. For the relative compactness, a method proposed by R. Liptser for semimartingales is used with a modification, where we apply a solution of a singular perturbation problem instead of an ergodic theorem.
Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled by a continuous-time Markov chain. Different from the usual switching diffusions, the systems include mean-field interactions. Our effort is devoted to obtaining laws of large numbers for the underlying systems. One of the distinct features of the paper is the limit of the empirical measures is not deterministic but a random measure depending on the history…
A finite-state Markov chain is introduced in the noise terms of the three-dimensional stochastic Navier-Stokes equations in order to allow for transitions between two types of multiplicative noises. We call such systems as stochastic Navier-Stokes equations with Markov switching. To solve such a system, a family of regularized stochastic systems is introduced. For each such regularized system, the existence of a unique strong solution (in the sense of stochastic analysis) is established by the method of martingale problems and pathwise uniqueness. The regularization is removed in the limit by …
We present two main theorems for stochastic processes with a Markov regime-switching model. First, we work on an existence-uniqueness theorem for a Stochastic Differential Delay Equation with Jumps and Regimes (SDDEJRs). Then, we provide the duality between an SDDEJR and an Anticipated Backward Stochastic Differential Equation with Jumps and Regimes (ABSDEJRs). Our goal is to provide two technical and basis theorems for the future theoretical and applied developments of time-delayed and time-advanced models.
In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated diffusion process and the occupation measure of the Markov chain (which evidently also yields the large deviations principle for each of them separately by applying the contraction principle). The structure of the proof is such that we first prove exponential tightness, and then establish a local large deviations principle (where the latter part is split int…
Exponential stability of the exact solutions as well as $θ$-EM ($\frac{1}{2}<θ\le 1$) approximations to neutral stochastic differential delay equations with Markov switching will be investigated in this paper. Sufficient conditions are obtained to ensure the $p$-th moment ($p\ge1$) and almost sure exponential stability of the exact solutions as well as $θ$-EM approximations ($p=2$). An example will be presented to support our conclusions.
We study a general $k$ dimensional infinite server queues process with Markov switching, Poisson arrivals and where the service times are fat tailed with index $α\in (0,1)$. When the arrival rate is sped up by a factor $n^γ$, the transition probabilities of the underlying Markov chain are divided by $n^γ$ and the service times are divided by $n$, we identify two regimes (''fast arrivals'', when $γ>α$, and ''equilibrium'', when $γ=α$) in which we prove that a properly rescaled process converges pointwise in distribution to some limiting process. In a third ''slow arrivals'' regime, $γ<α$, we sh…
We study ergodic properties of a class of Markov-modulated general birth-death processes under fast regime switching. The first set of results concerns the ergodic properties of the properly scaled joint Markov process with a parameter that is taken large. Under very weak hypotheses, we show that if the averaged process is exponentially ergodic for large values of the parameter, then the same applies to the original joint Markov process. The second set of results concerns steady-state diffusion approximations, under the assumption that the 'averaged' fluid limit exists. Here, we establish conv…
This paper studies the asymptotic behavior of processes with switching. More precisely, the stability under fast switching for diffusion processes and discrete state space Markovian processes is considered. The proofs are based on semimartingale techniques, so that no Markovian assumption for the modulating process is needed.
Asymptotic behavior of the three-dimensional stochastic Navier-Stokes equations with Markov switching in additive noises is studied for incompressible fluid flow in a bounded domain in the three-dimensional space. To study such a system, we introduce a family of regularized equations and investigate the asymptotic behavior of the regularized equations first. The existence an ergodic measure for the regularized system is established via the Krylov-Bogolyubov method. Then the existence of an stationary measure to the original system is obtained by extracting a limit from the ergodic measures of …
In many dynamical systems in nature, the law of the dynamics changes along with the temporal evolution of the system. These changes are often associated with the occurrence of certain events. The timing of occurrence of these events depends, in turn, on the trajectory of the dynamical system itself, making the dynamics of the system and the timing of a change in the dynamics strongly coupled. Naturally, trajectories that take longer to satisfy the event will last longer. Therefore, we expect to observe more frequently the dominant dynamics, the ones that take longer to change in the long run. …
We study the threshold dynamics of a stochastic SAIRS-type model with vaccination, where the role of asymptomatic and symptomatic infectious individuals is explicitly considered in the epidemic dynamics. In the model, the values of the disease transmission rate may switch between different levels under the effect of a semi-Markov process. We provide sufficient conditions ensuring the almost surely epidemic extinction and persistence in time mean. In the case of disease persistence, we investigate the omega-limit set of the system and give sufficient conditions for the existence and uniqueness …
Let $Y$ be an Ornstein-Uhlenbeck diffusion governed by an ergodic finite state Markov process $X$: $dY_t=-λ(X_t)Y_tdt+σ(X_t)dB_t$, $Y_0$ given. Under ergodicity condition, we get quantitative estimates for the long time behavior of $Y$. We also establish a trichotomy for the tail of the stationary distribution of $Y$: it can be heavy (only some moments are finite), exponential-like (only some exponential moments are finite) or Gaussian-like (its Laplace transform is bounded below and above by Gaussian ones). The critical moments are characterized by the parameters of the model.
We prove pathwise large-deviation principles of switching Markov processes by exploiting the connection to associated Hamilton-Jacobi equations, following Jin Feng's and Thomas Kurtz's method. In the limit that we consider, we show how the large-deviation problem in path-space reduces to a spectral problem of finding principal eigenvalues. The large-deviation rate functions are given in action-integral form. As an application, we demonstrate how macroscopic transport properties of stochastic models of molecular motors can be deduced from an associated principal-eigenvalue problem. The precise …
This work is devoted to the almost sure stabilization of adaptive control systems that involve an unknown Markov chain. The control system displays continuous dynamics represented by differential equations and discrete events given by a hidden Markov chain. Different from previous work on stabilization of adaptive controlled systems with a hidden Markov chain, where average criteria were considered, this work focuses on the almost sure stabilization or sample path stabilization of the underlying processes. Under simple conditions, it is shown that as long as the feedback controls have linear g…
Most of the published articles on random motions have been devoted to the study of the telegraph process or its generalizations that describe the random motion in $R^n$ of a single particle in a Markov or semi-Markov medium. However, up to our best knowledge there are no published papers dealing with the interaction of two or more particles which move according to the telegraph processes. In this paper, we construct the system of telegraph processes with interactions, which can be interpreted as a model of ideal gas. In this model, we investigate the free path times of a family of particles be…
Exponential stability of the nonlinear filtering equation is revisited, when the signal is a finite state Markov chain. An asymptotic upper bound for the filtering error due to incorrect initial condition is derived in the case of slowly switching signal.
In this paper, we investigate the open-loop and weak closed-loop solvabilities of stochastic linear quadratic (LQ, for short) optimal control problem of Markovian regime switching system. Interestingly, these two solvabilities are equivalent. We first provide an alternative characterization of the open-loop solvability of the LQ problem using the perturbation approach. Then, we study the weak closed-loop solvability of the LQ problem of Markovian regime switching system, and establish the equivalent relationship between open-loop and weak closed-loop solvabilities. Finally, we present an examp…
This paper investigates the stochastic linear quadratic (LQ, for short) optimal control problem of Markov regime switching system. The representation of the cost functional for the stochastic LQ optimal control problem of Markov regime switching system is derived using the technique of It{ô}'s formula. For the stochastic LQ optimal control problem of Markov regime switching system, we establish the equivalence between the open-loop (closed-loop) solvability and the existence of an adapted solution to the corresponding forward-backward stochastic differential equation with constraint (the exist…
In this paper we consider stationary Markov chains with trivial two-sided tail sigma field, and prove that additive functionals satisfy the central limit theorem provided the variance of partial sums divided by n is bounded.
Positive recurrence of a $d$-dimensional diffusion with switching and with one recurrent and one transient regimes and variable switching intensities is established under suitable conditions. The approach is based on embedded Markov chains.
The paper is dedicated to studying the problem of existence and uniqueness of solutions as well as existence of and exponential convergence to invariant measures for McKean-Vlasov stochastic differential equations with Markovian switching. Since the coefficients are only locally Lipschitz, we need to truncate them both in space and distribution variables simultaneously to get the global existence of solutions under the Lyapunov condition. Furthermore, if the Lyapunov condition is strengthened, we establish the exponential convergence of solutions' distributions to the unique invariant measure …
In this paper, we consider a discrete time economy where we assume that the short term interest rate follows a quadratic term structure of a regime switching asset process. The possible non-linear structure and the fact that the interest rate can have different economic or financial trends justify the interest of Regime Switching Quadratic Term Structure Model (RS-QTSM). Indeed, this regime switching process depends on the values of a Markov chain with a time dependent transition probability matrix which can well captures the different states (regimes) of the economy. We prove that under this …
We study a Markov process with two components: the first component evolves according to one of finitely many underlying Markovian dynamics, with a choice of dynamics that changes at the jump times of the second component. The second component is discrete and its jump rates may depend on the position of the whole process. Under regularity assumptions on the jump rates and Wasserstein contraction conditions for the underlying dynamics, we provide a concrete criterion for the convergence to equilibrium in terms of Wasserstein distance. The proof is based on a coupling argument and a weak form of …
Exponential ergodicity in the bounded-Lipschitz distance for a subclass of piecewise-deterministic Markov processes with random switching between flows
This paper is concerned with a stochastic linear-quadratic optimal control problem with regime switching, random coefficients, and cone control constraint. The randomness of the coefficients comes from two aspects: the Brownian motion and the Markov chain. Using Itô's lemma for Markov chain, we obtain the optimal state feedback control and optimal cost value explicitly via two new systems of extended stochastic Riccati equations (ESREs). We prove the existence and uniqueness of the two ESREs using tools including multidimensional comparison theorem, truncation function technique, log transform…
The coefficients of the stochastic differential equations with Markovian switching (SDEwMS) additionally depend on a Markov chain and there is no notion of differentiating such functions with respect to the Markov chain. In particular, this implies that the Itô-Taylor expansion for SDEwMS is not a straightforward extension of the Itô-Taylor expansion for stochastic differential equations (SDEs). Further, higher-order numerical schemes for SDEwMS are not available in the literature, perhaps because of the absence of the Itô-Taylor expansion. In this article, first, we overcome these challenges …
Multidimensional indefinite stochastic Riccati equations and zero-sum stochastic linear-quadratic differential games with non-Markovian regime switching
