P. Chigansky
Exponential stability of the nonlinear filtering equation is revisited, when the signal is a finite state Markov chain. An asymptotic upper bound for the filtering error due to incorrect initial condition is derived in the case of slowly switching signal.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
继续探索
Ergodicity and regularity properties of ODEs with semi-Markov switching
该文研究有限向量场间按任意 R_+ 分布随机切换形成的 ODE 过程，证明非奇异分布下过程具有 Feller 性，并给出使 Markov 情形的 Lie 括号条件仍蕴含遍历性的条件。
We investigate an application of slowly varying functions (in sense of Karamata) in the theory of Markov branching process. We treat the critical case so that the infinitesimal generating function of the process has the infinite second moment, but it regularly varies with the remainder. We improve the Basic Lemma of the theory of critical Markov branching process and refine known limit results.
The paper is dedicated to studying the problem of existence and uniqueness of solutions as well as existence of and exponential convergence to invariant measures for McKean-Vlasov stochastic differential equations with Markovian switching. Since the coefficients are only locally Lipschitz, we need to truncate them both in space and distribution variables simultaneously to get the global existence of solutions under the Lyapunov condition. Furthermore, if the Lyapunov condition is strengthened, we establish the exponential convergence of solutions' distributions to the unique invariant measure …
We consider Markov chains which are polynomially mixing, in a weak sense expressed in terms of the space of functions on which the mixing speed is controlled. In this context, we prove polynomial large and moderate deviations inequalities. These inequalities can be applied in various natural situations coming from probability theory or dynamical systems. Finally, we discuss examples from these various settings showing that our inequalities are sharp.
In this paper, the weak convergence of impulsive recurrent process with semi-Markov switching in the scheme of Levy approximation is proved. Singular perturbation problem for the compensating operator of the extended Markov renewal process is used to prove the relative compactness.
This paper is concerned with a class of stochastic differential equations with Markovian switching. The Malliavin calculus is used to study the smoothness of the density of the solution under a Hörmander type condition. Furthermore, we obtain a Bismut type formula which is used to establish the strong Feller property.
In this paper, the weak convergence of impulsive recurrent process with Markov switching in the scheme of Levy approximation is proved. For the relative compactness, a method proposed by R. Liptser for semimartingales is used with a modification, where we apply a solution of a singular perturbation problem instead of an ergodic theorem.
In this paper, the weak convergence of additive functionals of processes with locally independent increments and with Markov switching in the scheme of Poisson approximation is proved. For the relative compactness, a method proposed by R. Liptser for semimartingales is used with a modification, where we apply a solution of a singular perturbation problem instead of an ergodic theorem.
Discrete-time weak approximation of a Black-Scholes model with drift and volatility Markov switching
针对带马尔可夫切换的Black-Scholes模型，构建离散时间市场乘性格式，证明离散切换链及市场模型分别弱收敛于连续过程与原模型，且收敛条件具一般性。
In this paper we consider a class of stochastic differential equations driven by subordinate Brownian motion with Markovian switching. We use Malliavin calculus to study the smoothness of the density for the solution under uniform Hörmander's type condition.
A finite-state Markov chain is introduced in the noise terms of the three-dimensional stochastic Navier-Stokes equations in order to allow for transitions between two types of multiplicative noises. We call such systems as stochastic Navier-Stokes equations with Markov switching. To solve such a system, a family of regularized stochastic systems is introduced. For each such regularized system, the existence of a unique strong solution (in the sense of stochastic analysis) is established by the method of martingale problems and pathwise uniqueness. The regularization is removed in the limit by …
We present two main theorems for stochastic processes with a Markov regime-switching model. First, we work on an existence-uniqueness theorem for a Stochastic Differential Delay Equation with Jumps and Regimes (SDDEJRs). Then, we provide the duality between an SDDEJR and an Anticipated Backward Stochastic Differential Equation with Jumps and Regimes (ABSDEJRs). Our goal is to provide two technical and basis theorems for the future theoretical and applied developments of time-delayed and time-advanced models.
In this paper, we study small noise asymptotics of Markov-modulated diffusion processes in the regime that the modulating Markov chain is rapidly switching. We prove the joint sample-path large deviations principle for the Markov-modulated diffusion process and the occupation measure of the Markov chain (which evidently also yields the large deviations principle for each of them separately by applying the contraction principle). The structure of the proof is such that we first prove exponential tightness, and then establish a local large deviations principle (where the latter part is split int…
Exponential stability of the exact solutions as well as $θ$-EM ($\frac{1}{2}<θ\le 1$) approximations to neutral stochastic differential delay equations with Markov switching will be investigated in this paper. Sufficient conditions are obtained to ensure the $p$-th moment ($p\ge1$) and almost sure exponential stability of the exact solutions as well as $θ$-EM approximations ($p=2$). An example will be presented to support our conclusions.
We study a Markov process with two components: the first component evolves according to one of finitely many underlying Markovian dynamics, with a choice of dynamics that changes at the jump times of the second component. The second component is discrete and its jump rates may depend on the position of the whole process. Under regularity assumptions on the jump rates and Wasserstein contraction conditions for the underlying dynamics, we provide a concrete criterion for the convergence to equilibrium in terms of Wasserstein distance. The proof is based on a coupling argument and a weak form of …
On absolute continuity of invariant measures associated with a piecewise-deterministic Markov processes with random switching between flows
本文研究了生物模型中分段确定性 Markov 过程平稳分布的绝对连续性，该过程由 Poisson 过程跳跃和连续半流切换组成，提出了一组可验证条件，证明其不变分布具有关于 Lebesgue 测度的密度。
Exponential ergodicity in the bounded-Lipschitz distance for a subclass of piecewise-deterministic Markov processes with random switching between flows
本文研究了一类在流之间随机切换的分段确定性马尔可夫过程，提出了仅依赖流性质和跳跃后位置转移律的可验证条件，以保证其在有界Lipschitz距离下的指数遍历性，并为适用于生物模型的特例建立了简单判据。
On invariant distributions of Feller Markov chains with applications to dynamical systems with random switching
本文给出保证紧流形上 Feller Markov 链不变分布具有不同正则性密度的条件，并将其用于随机复合映射与随机切换流形成的过程。
Well-Posedness and Ergodicity of Functional Stochastic Partial Differential Equations with Markovian Switching
本文研究带马尔可夫切换的半线性泛函随机偏微分方程，利用Skorokhod表示证明适定性，并分别用remote start方法和有限划分方法推导有限及可数无穷状态空间下的指数混合性。
We study a stochastic SIS (susceptible-infected-susceptible) epidemic dynamics on network, under the effect of a Markovian regime-switching. We first prove the existence of a unique global positive solution, and find a positive invariant set for the system. Then, we find sufficient conditions for a.s. extinction and stochastic permanence, showing also their relation with the stationary probability distribution of the Markov chain that governs the switching and with the network topology. We provide an asymptotic lower bound for the time average of the sample-path solution under the conditions e…
This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in contexts in which time-of-day effects or seasonality effects need to be incorporated. Our approximations are valid asymptotically in regimes in which the transition probabilities change slowly over time. Specifically, we develop approximations for the expected infinite horizon discounted reward, the expected reward to the hitting time of a set, the expected reward…
Stability of three-dimensional stochastic Navier-Stokes equation with Markov switching
本文研究了具有马尔可夫切换的三维随机Navier-Stokes方程的p阶矩和几乎必然指数稳定性。
We study a general $k$ dimensional infinite server queues process with Markov switching, Poisson arrivals and where the service times are fat tailed with index $α\in (0,1)$. When the arrival rate is sped up by a factor $n^γ$, the transition probabilities of the underlying Markov chain are divided by $n^γ$ and the service times are divided by $n$, we identify two regimes (''fast arrivals'', when $γ>α$, and ''equilibrium'', when $γ=α$) in which we prove that a properly rescaled process converges pointwise in distribution to some limiting process. In a third ''slow arrivals'' regime, $γ<α$, we sh…
We study ergodic properties of a class of Markov-modulated general birth-death processes under fast regime switching. The first set of results concerns the ergodic properties of the properly scaled joint Markov process with a parameter that is taken large. Under very weak hypotheses, we show that if the averaged process is exponentially ergodic for large values of the parameter, then the same applies to the original joint Markov process. The second set of results concerns steady-state diffusion approximations, under the assumption that the 'averaged' fluid limit exists. Here, we establish conv…
Markov chains, CAT(0) cube complexes, and enumeration: monotone paths in a strip mix slowly
该研究运用CAT(0)立方复形理论证明带状区域单调路径上两类马尔可夫链混合缓慢，还给出了单调路径计数公式并推广了相关指数增长常数结果。
This paper studies the asymptotic behavior of processes with switching. More precisely, the stability under fast switching for diffusion processes and discrete state space Markovian processes is considered. The proofs are based on semimartingale techniques, so that no Markovian assumption for the modulating process is needed.
This paper investigates the stochastic linear quadratic (LQ, for short) optimal control problem of Markov regime switching system. The representation of the cost functional for the stochastic LQ optimal control problem of Markov regime switching system is derived using the technique of It{ô}'s formula. For the stochastic LQ optimal control problem of Markov regime switching system, we establish the equivalence between the open-loop (closed-loop) solvability and the existence of an adapted solution to the corresponding forward-backward stochastic differential equation with constraint (the exist…
Asymptotic behavior of the three-dimensional stochastic Navier-Stokes equations with Markov switching in additive noises is studied for incompressible fluid flow in a bounded domain in the three-dimensional space. To study such a system, we introduce a family of regularized equations and investigate the asymptotic behavior of the regularized equations first. The existence an ergodic measure for the regularized system is established via the Krylov-Bogolyubov method. Then the existence of an stationary measure to the original system is obtained by extracting a limit from the ergodic measures of …
Conditional McKean-Vlasov SDEs with jumps and Markovian regime-switching: wellposedness, propagation of chaos, averaging principle
本文研究带跳和马尔可夫机制切换的条件McKean-Vlasov随机微分方程，利用L2-Wasserstein距离证明强适定性，建立平均场粒子系统的混沌传播及显式收敛速率，并针对双时间尺度情形建立平均化原理。
We propose a new tamed Milstein-type scheme for stochastic differential equation with Markovian switching when drift coefficient is assumed to grow super-linearly. The strong rate of convergence is shown to be equal to $1.0$ under mild regularity (e.g. once differentiability) requirements on drift and diffusion coefficients. Novel techniques are developed to tackle two-fold difficulties arising due to jumps of the Markov chain and the reduction of regularity requirements on the coefficients.
In many dynamical systems in nature, the law of the dynamics changes along with the temporal evolution of the system. These changes are often associated with the occurrence of certain events. The timing of occurrence of these events depends, in turn, on the trajectory of the dynamical system itself, making the dynamics of the system and the timing of a change in the dynamics strongly coupled. Naturally, trajectories that take longer to satisfy the event will last longer. Therefore, we expect to observe more frequently the dominant dynamics, the ones that take longer to change in the long run. …
We study the threshold dynamics of a stochastic SAIRS-type model with vaccination, where the role of asymptomatic and symptomatic infectious individuals is explicitly considered in the epidemic dynamics. In the model, the values of the disease transmission rate may switch between different levels under the effect of a semi-Markov process. We provide sufficient conditions ensuring the almost surely epidemic extinction and persistence in time mean. In the case of disease persistence, we investigate the omega-limit set of the system and give sufficient conditions for the existence and uniqueness …
Let $Y$ be an Ornstein-Uhlenbeck diffusion governed by an ergodic finite state Markov process $X$: $dY_t=-λ(X_t)Y_tdt+σ(X_t)dB_t$, $Y_0$ given. Under ergodicity condition, we get quantitative estimates for the long time behavior of $Y$. We also establish a trichotomy for the tail of the stationary distribution of $Y$: it can be heavy (only some moments are finite), exponential-like (only some exponential moments are finite) or Gaussian-like (its Laplace transform is bounded below and above by Gaussian ones). The critical moments are characterized by the parameters of the model.
An explicit Milstein-type scheme for stochastic differential equation with Markovian switching is derived and its strong convergence in $\mathcal{L}^2$-sense is established without using Itô-Taylor expansion formula. Rate of strong convergence is shown to be equal to $1.0$ under the assumptions that coefficients satisfy mild regularity conditions. More precisely, coefficients are assumed to be only once differentiable which are more relaxed conditions than those made in existing literature.
A Multi-level Monte Carlo simulation for invariant distribution of Markovian switching Lévy-driven SDEs with super-linearly growth coefficients
本文提出结合驯化自适应Euler-Maruyama与多层蒙特卡洛的方法，用于逼近马尔可夫切换Lévy驱动的超线性增长SDE的不变分布。
We prove pathwise large-deviation principles of switching Markov processes by exploiting the connection to associated Hamilton-Jacobi equations, following Jin Feng's and Thomas Kurtz's method. In the limit that we consider, we show how the large-deviation problem in path-space reduces to a spectral problem of finding principal eigenvalues. The large-deviation rate functions are given in action-integral form. As an application, we demonstrate how macroscopic transport properties of stochastic models of molecular motors can be deduced from an associated principal-eigenvalue problem. The precise …
This work is devoted to the almost sure stabilization of adaptive control systems that involve an unknown Markov chain. The control system displays continuous dynamics represented by differential equations and discrete events given by a hidden Markov chain. Different from previous work on stabilization of adaptive controlled systems with a hidden Markov chain, where average criteria were considered, this work focuses on the almost sure stabilization or sample path stabilization of the underlying processes. Under simple conditions, it is shown that as long as the feedback controls have linear g…
In this paper, we consider a discrete time economy where we assume that the short term interest rate follows a quadratic term structure of a regime switching asset process. The possible non-linear structure and the fact that the interest rate can have different economic or financial trends justify the interest of Regime Switching Quadratic Term Structure Model (RS-QTSM). Indeed, this regime switching process depends on the values of a Markov chain with a time dependent transition probability matrix which can well captures the different states (regimes) of the economy. We prove that under this …
Most of the published articles on random motions have been devoted to the study of the telegraph process or its generalizations that describe the random motion in $R^n$ of a single particle in a Markov or semi-Markov medium. However, up to our best knowledge there are no published papers dealing with the interaction of two or more particles which move according to the telegraph processes. In this paper, we construct the system of telegraph processes with interactions, which can be interpreted as a model of ideal gas. In this model, we investigate the free path times of a family of particles be…
The existence and uniqueness of the numerical invariant measure of the backward Euler-Maruyama method for stochastic differential equations with Markovian switching is yielded, and it is revealed that the numerical invariant measure converges to the underlying invariant measure in the Wasserstein metric. Under the polynomial growth condition of drift term the convergence rate is estimated. The global Lipschitz condition on the drift coefficients required by Bao et al., 2016 and Yuan et al., 2005 is released. Several examples and numerical experiments are given to verify our theory.
Let Y be an Ornstein-Uhlenbeck diffusion governed by a stationary and ergodic Markov jump process X: dY_t=a(X_t)Y_t dt+σ(X_t) dW_t, Y_0=y_0. Ergodicity conditions for Y have been obtained. Here we investigate the tail propriety of the stationary distribution of this model. A characterization of either heavy or light tail case is established. The method is based on a renewal theorem for systems of equations with distributions on R.
Stability of stochastic dynamic systems of a random structure with Markov switchings in the presence of concentration points
本文研究了存在浓度点时具有Markov切换的随机结构随机微分方程的稳定性，利用Lyapunov函数及对跳跃幅度和时间的约束证明了渐近稳定性，并通过实例验证。
A curiously slowly mixing Markov chain
该研究提出了一种超立方体上的Burnside过程，展示了其在不同混合度量下的不同混合速率，并通过显式对角化方法解释了$\ell^2$混合结果。
Mean-square exponential stability of exact and numerical solutions for neutral stochastic delay differential equations with Markovian switching
本文研究了具有马尔可夫切换的中性随机延迟微分方程的均方指数稳定性，通过欧拉-马尔尤拉方法提出新的稳定性准则，并证明数值方案可高精度再现真实解的衰减率。
Strong Predictor-Corrector Euler-Maruyama Methods for Stochastic Differential Equations with Markovian Switching
针对带马尔可夫切换的随机微分方程，提出强预测-校正欧拉-丸山方法，通过路径逼近克服误差传播，证明强收敛性并给出误差阶，研究p-稳定性准则，数值实验展示计算效率。
Time-dependent Robin heat equation via Markovian switching
本文研究了带有罗宾边界条件的热方程，其中反应参数通过连续时间马尔可夫链建模。通过泛函分析方法，分析了两种随机框架下的系统，推导了费曼-科茨公式并证明了快速切换极限下的平均原理。
Spectral Characterisation of Covariance Existence in Markov-Switching Affine Recurrences
研究马尔可夫切换仿射递归平稳协方差矩阵存在性，核心方法是通过马尔可夫切换克罗内克算子及佩龙激励条件判断，贡献是将均方谱条件转化为平稳分布协方差存在准则，并举例说明相关特性。
Optimal control of McKean-Vlasov systems under partial observation and hidden Markov switching
本文研究了在部分观测下麦金-沃拉斯科夫系统最优控制问题，通过概率变换框架处理分布依赖性，推导出扎卡伊方程和贝尔曼方程，解决均场控制问题。
Large deviations for Markov processes with switching and homogenisation via Hamilton-Jacobi-Bellman equations
本文针对带内状态切换的分子马达扩散模型，通过分析同时依赖位置与动量的Hamilton–Jacobi–Bellman方程，用Feng-Kurtz方法证明了齐次化极限下轨迹的大偏差原理。
The coefficients of the stochastic differential equations with Markovian switching (SDEwMS) additionally depend on a Markov chain and there is no notion of differentiating such functions with respect to the Markov chain. In particular, this implies that the Itô-Taylor expansion for SDEwMS is not a straightforward extension of the Itô-Taylor expansion for stochastic differential equations (SDEs). Further, higher-order numerical schemes for SDEwMS are not available in the literature, perhaps because of the absence of the Itô-Taylor expansion. In this article, first, we overcome these challenges …
Multidimensional indefinite stochastic Riccati equations and zero-sum stochastic linear-quadratic differential games with non-Markovian regime switching
针对非 Markov 机制切换下的零和随机线性二次微分博弈，本文借助新型多维不定 SRE 与无界系数线性 BSDE 给出闭环最优策略，并证明该 SRE 解的存在唯一性。
扫码添加微信好友，提出您的宝贵建议 👇
💡 备注请填写：网站反馈
发表机构由 AI 从论文文本抽取，如发现错误，欢迎反馈修正建议。