Andi Q. Wang, David Steinsaltz
For a continuous-time Markov process, we characterize the law of the first jump location when started from an arbitrary initial distribution, in terms of the invariant distribution of an auxiliary Markov process. This could be of interest in the burgeoning fields of piecewise-deterministic Markov chain Monte Carlo methods and quasi-stationary Monte Carlo methods.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
继续探索
In this paper we discuss weak convergence of continuous-time Markov chains to a non-symmetric pure jump process. We approach this problem using Dirichlet forms as well as semimartingales. As an application, we discuss how to approximate a given Markov process by Markov chains.
As well-known, transition probabilities of jump Markov processes satisfy Kolmogorov's backward and forward equations. In the seminal 1940 paper, William Feller investigated solutions of Kolmogorov's equations for jump Markov processes. Recently the authors solved the problem studied by Feller and showed that the minimal solution of Kolmogorov's backward and forward equations is the transition probability of the corresponding jump Markov process if the transition rate at each state is bounded. This paper presents more general results. For Kolmogorov's backward equation, the sufficient condition…
We present sufficient conditions, in terms of the jumping kernels, for two large classes of conservative Markov processes of pure-jump type to be purely discontinuous martingales with finite second moment. As an application, we establish the law of the iterated logarithm for sample paths of the associated processes.
In this paper, we are interested in the exact simulation of a class of Piecewise Deterministic Markov Processes (PDMP). We show how to perform efficient thinning algorithms depending on the jump rate bound. For different types of jump rate bounds, we compare theoretically the mean number of generated (total) jump times and we compare numerically the simulation times. We use thinning algorithms on Hodgkin-Huxley models with Markovian ion channels dynamic to illustrate the results.
Motivated by entropic optimal transport, time reversal of Markov jump processes in $\mathbb{R}^n$ is investigated. Relying on an abstract integration by parts formula for the carré du champ of a Markov process recently obtained by Cattiaux, Gentil and the authors, and using an entropic improvement strategy discovered by Föllmer in the eighties, we compute the semimartingale characteristics of the time reversed process for a wide class of jump processes with possibly unbounded variation sample paths and singular intensities of jump.
We consider piecewise deterministic Markov processes with degenerate transition kernels of the "house-of-cards"-type. We use a splitting scheme based on jump times to prove the absolute continuity, as well as some regularity, of the invariant measure of the process. Finally, we obtain finer results on the regularity of the one-dimensional marginals of the invariant measure, using integration by parts with respect to the jump times.
We aim in proving Poincaré inequalities for a class of pure jump Markov processes inspired by the model introduced in \cite{G-L} by Galves and Löcherbach to describe the behaviour of interacting brain neurons. In particular, we consider neurons with degenerate jumps, i.e. that lose their memory when they spike, while the probability of a spike depends on the actual position and thus the past of the whole neural system.
In this note we show a simple formula for the joint density of local times, last exit tree and cycling numbers of continuous-time Markov Chains on finite graphs, which involves the modified Bessel function of the first type.
We study Talagrand concentration and Poincaré type inequalities for unbounded pure jump Markov processes. In particular we focus on processes with degenerate jumps that depend on the past of the whole system, based on the model introduced by Galves and Löcherbach in \cite{G-L}, in order to describe the activity of a biological neural network. As a result we obtain exponential rates of convergence to equilibrium.
In this paper we study backward stochastic differential equations (BSDEs) driven by the compensated random measure associated to a given pure jump Markov process X on a general state space K. We apply these results to prove well-posedness of a class of nonlinear parabolic differential equations on K, that generalize the Kolmogorov equation of X. Finally we formulate and solve optimal control problems for Markov jump processes, relating the value function and the optimal control law to an appropriate BSDE that also allows to construct probabilistically the unique solution to the Hamilton-Jacobi…
We study the rate of weak convergence of Markov chains to diffusion processes under suitable but quite general assumptions. We give an example in the financial framework, applying the convergence analysis to a multiple jumps tree approximation of the CIR process. Then, we combine the Markov chain approach with other numerical techniques in order to handle the different components in jump-diffusion coupled models. We study the speed of convergence of this hybrid approach and we provide an example in finance, applying our results to a tree-finite difference approximation in the Heston or Bates m…
We derive concentration inequalities for empirical means $\frac{1}{t} \int_0^t f(X_s) ds$ where $X_s$ is an irreducible Markov jump process on a finite state space and $f$ some observable. Using a Feynman-Kac semigroup we first derive a general concentration inequality. Then, based on this inequality we derive further concentration inequalities. Hereby we use three different methods; perturbation theory, Poincaré inequalities and information inequalities. We also obtain a Bernstein type concentration inequality.
In this paper, we obtain new drift-type conditions for nonexplosion and explosion for nonhomogeneous Markov pure jump processes in Borel state spaces. The conditions are sharp; e.g., the one for nonexplosion is necessary if the state space is in addition locally compact and the $Q$-function satisfies weak Feller-type and local boundedness conditions. We comment on the relations of our conditions with the existing ones in the literature, and demonstrate some possible applications.
We present a new approach to positive self-similar Markov processes (pssMps) by reformulating Lamperti's transformation via jump type SDEs. As applications, we give direct constructions of pssMps (re)started continuously at zero if the Lamperti transformed Levy process is spectrally negative. Our paper can be seen as a continuation of similar studies for continuous state branching processes but the approach seems to be more fruitful in the context of pssMps.
This paper describes the structure of solutions to Kolmogorov's equations for nonhomogeneous jump Markov processes and applications of these results to control of jump stochastic systems. These equations were studied by Feller (1940), who clarified in 1945 in the errata to that paper that some of its results covered only nonexplosive Markov processes. In this work, which is largely of a survey nature, the case of explosive processes is also considered. This paper is based on the invited talk presented by the authors at the conference "Chebyshev-200", and it describes the results of their joine…
We start by providing an explicit characterization and analytical properties, including the persistence phenomena, of the distribution of the extinction time $\mathbb{T}$ of a class of non-Markovian self-similar stochastic processes with two-sided jumps that we introduce as a stochastic time-change of Markovian self-similar processes. For a suitably chosen time-changed, we observe, for classes with two-sided jumps, the following surprising facts. On the one hand, all the $\mathbb{T}$'s within a class have the same law which we identify in a simple form for all classes and reduces, in the spect…
Markov branching processes with disasters: extinction, survival and duality to p-jump processes
本文通过建立 p-跳跃过程在单位区间上的极限定理，并利用概率生成函数对偶性，研究带二项灾难的分支过程的生存概率极限，进而推广到时间非齐次生灭过程和带 p-跳跃的连续状态分支过程。
In his 1972 paper, John Lamperti characterized all positive self-similar Markov processes as time-changes of exponentials of Levy processes. In the past decade the problem of classifying all non-negative self-similar Markov processes that do not necessarily have zero as a trap has been solved gradually via connections to ladder height processes and excursion theory. Motivated by a recent article of Chaumont, Rivero, Panti we classify via jump-type SDEs the symmetric real-valued self-similar Markov processes that only decrease the absolute value by jumps and leave zero continuously. Our constru…
On the Existence and Uniqueness of Stationary Distributions for Some Piecewise Deterministic Markov Processes With State-Dependent Jump Intensity
本文研究一类分段确定性马尔可夫过程，证明其平稳分布与跳跃后位置马尔可夫链的平稳分布一一对应，并据此为随机迭代函数系统情形建立平稳分布存在唯一性判据。
A systematic exposition of scale functions is given for positive self-similar Markov processes (pssMp) with one-sided jumps. The scale functions express as convolution series of the usual scale functions associated with spectrally one-sided Lévy processes that underly the pssMp through the Lamperti transform. This theory is then brought to bear on solving the spatio-temporal: (i) two-sided exit problem; (ii) joint first passage problem upwards for the the pssMp and its multiplicative drawdown (resp. drawup) in the spectrally negative (resp. positive) case.
Optimal Fluctuations for Discrete-time Markov Jump Processes
本文研究了离散时间马尔可夫跳跃过程中噪声诱导的大波动现象，通过大偏差理论和时间反转概念，揭示了最佳路径与特定概率分布时间反转之间的关系，展示了稀有随机事件如何产生确定性机制。
We investigate a piecewise-deterministic Markov process, evolving on a Polish metric space, whose deterministic behaviour between random jumps is governed by some semi-flow, and any state right after the jump is attained by a randomly selected continuous transformation. It is assumed that the jumps appear at random moments, which coincide with the jump times of a Poisson process with intensity $λ$. The model of this type, although in a more general version, was examined in our previous papers, where we have shown, among others, that the Markov process under consideration possesses a unique inv…
Let $f$ be the density function associated to a matrix-exponential distribution of parameters $(α, T,s)$. By exponentially tilting $f$, we find a probabilistic interpretation which generalises the one associated to phase-type distributions. More specifically, we show that for any sufficiently large $λ\ge 0$, the function $x\mapsto \left(\int_0^\infty e^{-λr}f(r) dr\right)^{-1}e^{-λx}f(x)$ can be described in terms of a Markov jump process whose generator is tied to $T$. Finally, we show how to revert the exponential tilting in order to assign a probabilistic interpretation to $f$ itself.
The law of the iterated logarithm for a piecewise deterministic Markov process assured by the properties of the Markov chain given by its post-jump locations
本文研究半流由 Poisson 跳变切换的分段确定性 Markov 过程，借助其跳后 Markov 链的已有遍历性质证明连续时间过程的重对数律，并指出其可用于基因表达随机动力学建模。
We show that the convergence of finite state space Markov chains to stationarity can often be considerably speeded up by alternating every step of the chain with a deterministic move. Under fairly general conditions, we show that not only do such schemes exist, they are numerous.
The purpose of this paper is to consider the exit-time problem for a finite-range Markov jump process, i.e, the distance the particle can jump is bounded independent of its location. Such jump diffusions are expedient models for anomalous transport exhibiting super-diffusion or nonstandard normal diffusion. We refer to the associated deterministic equation as a volume-constrained nonlocal diffusion equation. The volume constraint is the nonlocal analogue of a boundary condition necessary to demonstrate that the nonlocal diffusion equation is well-posed and is consistent with the jump process. …
Markov Chains Approximations of jump-Diffusion Quantum Trajectories
“量子轨迹”是随机微分方程的解，也称为Belavkin或随机薛定谔方程。它们描述了量子测量理论中的随机现象。通常考虑两种类型的此类方程，一种是一维布朗运动驱动的，另一种是计数过程驱动的。在这篇文章中，我们提出了一种方法来获得更先进的模型，使用跳跃扩散随机微分方程。这种模型来源于无穷小生成元的鞅问题的解。这些生成元是从描述量子轨道离散模型的经典马尔可夫链生成元的极限中得到的。进一步证明了跳跃-扩散方程的解可以作为离散轨线的极限来获得，从而证明了跳跃-扩散方程的随机模型是物理上合理的。
This paper concerns the Vertex Reinforced Jump Process (VRJP) and its representations as a Markov process in random environment. We show that all possible representations of the VRJP as a mixture of Markov processes can be expressed in a similar form, using a random potential and harmonic functions for an associated operator. This allows to show that the VRJP on $\mathbb{Z}^d$ (with certain initial conditions) has a unique representation, by proving that an associated Martin boundary is trivial. Moreover, on infinite trees, we construct a family of representations, that are all different when …
We prove existence of boundary limits of ratios of positive harmonic functions for a wide class of Markov processes with jumps and irregular domains, in the context of general metric measure spaces. As a corollary, we prove uniqueness of the Martin kernel at each boundary point, that is, we identify the Martin boundary with the topological boundary. We also prove a Martin representation theorem for harmonic functions. Examples covered by our results include: strictly stable Lévy processes in R^d with positive continuous density of the Lévy measure; stable-like processes in R^d and in domains; …
Mean-field integro-differential equations are studied in an abstract framework, through couplings of the corresponding stochastic processes. In the perturbative regime, the equation is proven to admit a unique equilibrium, toward which the process converges exponentially fast. Similarly, in this case, the associated particle system is proven to converge toward its equilibrium at a rate independent from the number of particles.
Consider a system of interacting particles indexed by the nodes of a graph whose vertices are equipped with marks representing parameters of the model such as the environment or initial data. Each particle takes values in a countable state space and evolves according to a (possibly non-Markovian) continuous-time pure jump process whose jump intensities depend only on its own state (or history) and marks as well as the states (or histories) and marks of particles and edges in its neighborhood in the graph. Under mild conditions on the jump intensities, it is shown that the trajectories of the i…
This note is based on Wonham \cite{Wonham}. The differences between this note and [Wonham] are discussed in Section VIII.
Consider on a manifold the solution $X$ of a stochastic differential equation driven by a Lévy process without Brownian part. Sufficient conditions for the smoothness of the law of $X_t$ are given, with particular emphasis on noncompact manifolds. The result is deduced from the case of affine spaces by means of a localisation technique. The particular cases of Lie groups and homogeneous spaces are discussed.
We consider a class of continuous time Markov chains on a compact metric space that admit an invariant measure strictly positive on open sets together with absorbing states. We prove the joint large deviation principle for the empirical measure and flow. Due to the lack of uniform ergodicity, the zero level set of the rate function is not a singleton. As corollaries, we obtain the Donsker-Varadhan rate function for the empirical measure and a variational expression of the rate function for the empirical flow.
In this study, we consider a class of backward SDE driven by jump Markov process. An existence and uniqueness result to this kind of equations is obtained in a locally Lipschitz case. We essentially approximate the initial problem by constructing a convenient sequence of globally Lipschitz BSDEs having the existence and the uniqueness propriety. Then, we show, by passing to the limits, the existence, and uniqueness of a solution to the initial problem. After that, a stability theorem is also proved in the local Lipschitz setting. Applying the aforementioned result, we give an application to Eu…
The large deviations principle for the empirical measure for both continuous and discrete time Markov processes is well known. Various expressions are available for the rate function, but these expressions are usually as the solution to a variational problem, and in this sense not explicit. An interesting class of continuous time, reversible processes was identified in the original work of Donsker and Varadhan for which an explicit expression is possible. While this class includes many (reversible) processes of interest, it excludes the case of continuous time pure jump processes, such as a re…
In this paper we prove a version of the Berman-Konsowa principle for reversible Markov jump processes on Polish spaces. The Berman-Konsowa principle provides a variational formula for the capacity of a pair of disjoint measurable sets. There are two versions, one involving a class of probability measures for random finite paths from one set to the other, the other involving a class of finite unit flows from one set to the other. The Berman-Konsowa principle complements the Dirichlet principle and the Thomson principle, and turns out to be especially useful for obtaining sharp estimates on cros…
This paper studies three ways to construct a nonhomogeneous jump Markov process: (i) via a compensator of the random measure of a multivariate point process, (ii) as a minimal solution of the backward Kolmogorov equation, and (iii) as a minimal solution of the forward Kolmogorov equation. The main conclusion of this paper is that, for a given measurable transition intensity, commonly called a Q-function, all these constructions define the same transition function. If this transition function is regular, that is, the probability of accumulation of jumps is zero, then this transition function is…
The Markov chain embedding problem in a low jump frequency context
本文研究低跳跃频率条件下连续时间马尔可夫链的嵌入问题，证明条件嵌入方法对非零对角转移矩阵可唯一确定强度矩阵，从而避免识别阶段与正则化，并与Jarrow的生成元近似进行比较。
In this note, we study the directed first passage percolation introduced in [F. Comets, R. Fukushima, S. Nakajima and N. Yoshida: Journal of Statistical Physics, 161-(3), 577-597 (2015)]. It is proved that the shortest path from the origin to the $n$-th hyperplane makes a jump larger than a small power of $\log n$. Some numerical results are also provided, which indicates that the maximal jump size is much larger in a certain parameter region.
This paper considers adiabatic reduction in a model of stochastic gene expression with bursting transcription considered as a jump Markov process. In this model, the process of gene expression with auto-regulation is described by fast/slow dynamics. The production of mRNA is assumed to follow a compound Poisson process occurring at a rate depending on protein levels (the phenomena called bursting in molecular biology) and the production of protein is a linear function of mRNA numbers. When the dynamics of mRNA is assumed to be a fast process (due to faster mRNA degradation than that of protein…
Markov Process Jump Times and Their Cox Construction
本文证明Cox构造的停时与Feller过程跳跃时间本质相同，并指出可预测停时可表示为连续过程到达零的时刻。
We study a one-dimensional Markov modulated random walk with jumps. It is assumed that amplitudes of jumps as well as a chosen velocity regime are random and depend on a time spent by the process at a previous state of the underlying Markov process. Equations for the distribution and equations for its moments are derived. We characterise the martingale distributions in terms of observable proportions between jump and velocity regimes.
For integer valued random variables, the translated Poisson distributions form a flexible family for approximation in total variation, in much the same way that the normal family is used for approximation in Kolmogorov distance. Using the Stein--Chen method, approximation can often be achieved with error bounds of the same order as those for the CLT. In this paper, an analogous theory, again based on Stein's method, is developed in the multivariate context. The approximating family consists of the equilibrium distributions of a collection of Markov jump processes, whose analogues in one dimens…
Consider a Markov chain with finite state space and suppose you wish to change time replacing the integer step index $n$ with a random counting process $N(t)$. What happens to the mixing time of the Markov chain? We present a partial reply in a particular case of interest in which $N(t)$ is a counting renewal process with power-law distributed inter-arrival times of index $β$. We then focus on $β\in (0,1)$, leading to infinite expectation for inter-arrival times and further study the situation in which inter-arrival times follow the Mittag-Leffler distribution of order $β$.
Hitting probabilities in a Markov additive process with linear movements and upward jumps: applications to risk and queueing processes
受正、负保险费率风险过程的启发，考虑了具有多个背景状态的实值马尔可夫可加过程。该加法过程在背景状态不变时线性增加或减少，并且在背景状态的过渡时刻可能具有向上跳跃。已知该可加过程在较低水平的命中概率具有矩阵指数形式。本文研究了一般情况下不具有矩阵指数形式的高层命中概率。这些概率用风险过程的术语给出了破产概率。我们的主要兴趣是在轻尾条件下的跳跃大小的解析表达式和他们的渐近行为时，击中水平走向无穷大。为了得到这些结果，我们对命中概率使用了一定的对偶性，这可能具有独立的兴趣，因为它不需要任何马尔可夫假设。
We review some developments concerning Markov and Feller processes with jumps in geometric settings. These include stochastic differential equations in Markus canonical form, the Courrège theorem on Lie groups, and invariant Markov processes on manifolds under both transitive and more general Lie group actions.
Optimal stopping for Markov processes with positive jumps
本文研究实值Markov过程的贴现最优停止问题，基于Dynkin特征和Green核给出价值函数表示公式，并利用Fourier变换求解了电力市场中Levy驱动的Ornstein-Uhlenbeck过程的最优停止实例。
We study optimal investment strategies that maximize expected utility from consumption and terminal wealth in a pure-jump asset price model with Markov-modulated (regime switching) jump-size distributions. We give sufficient conditions for existence of optimal policies and find closed-form expressions for the optimal value function for agents with logarithmic and fractional power (CRRA) utility in the case of two-state Markov chains. The main tools are convex duality techniques, stochastic calculus for pure-jump processes and explicit formulae for the moments of telegraph processes with Markov…
It is well-known that 0 is the absorbing state for a branching system. Each particle in the system lives a random long time and gives a random number of new particles at its death time. It stops when the system has no particle. This paper is devoted to studying the fixed range crossing numbers until any time t. The joint probability distribution of fixed range crossing numbers of such processes until time t is obtained by using a new method. In particular, the probability distribution of total death number is given for Markov branching processes until time t.
Markov approximation for controlled Hawkes Jump-Diffusions with general kernels
本文提出了一种针对具有一般核的Hawkes跳扩散的Markov逼近方法，通过用指数函数线性组合逼近核，证明其可由Markov跳扩散逼近，并应用于随机控制问题验证了实用性。
We extend some methods developed by Albeverio, Brzeźniak and Wu and we show how to apply them in order to prove existence of global strong solutions of stochastic differential equations with jumps, under a local one-sided Lipschitz condition on the drift (also known as a monotonicity condition) and a local Lipschitz condition on the diffusion and jump coefficients, while an additional global one-sided linear growth assumption is satisfied. Then we use these methods to prove existence of invariant measures for a broad class of such equations.
The objective of this paper is to study the filtering problem for a system of partially observable processes $(X, Y)$, where $X$ is a non-Markovian pure-jump process representing the signal and $Y$ is a general jump-diffusion which provides observations. Our model covers the case where both processes are not necessarily quasi left-continuous, allowing them to jump at predictable stopping times. By introducing the Markovian version of the signal, we are able to compute an explicit equation for the filtering process via the innovations approach.
For a refracted spectrally negative Levy process, we find some new and fantastic formulas for its q-potential measures without killing. Unlike previous results, which are written in terms of the known q-scale functions, our formulas are free of the q-scale functions. This makes our results become extremely important since it is likely that our formulas also hold for a general refracted Levy process.
Modern methods of simulating molecular systems are based on the mathematical theory of Markov operators with a focus on autonomous equilibrated systems. However, non-autonomous physical systems or non-autonomous simulation processes are becoming more and more important. We present a representation of non-autonomous Markov jump processes as autonomous Markov chains on space-time. Augmenting the spatial information of the embedded Markov chain by the temporal information of the associated jump times, we derive the so-called augmented jump chain. The augmented jump chain inherits the sparseness o…
Markov chain approximations for symmetric jump processes
研究了对称跳过程的马尔可夫链逼近。建立了紧性结果和一个中心极限定理。此外，给出了状态空间为$\mathbbm{R}^d$的对称跳过程的生成元，并明确地构造了近似马尔可夫链。作为一个副产品，我们得到了定义的索伯列夫空间$H^{α/2}(\mathbbm{R}^d)$，$α\in (0,2)$，这是等价的标准。
Inverting the Markovian projection for pure jump processes
本文研究了纯跳过程的马尔可夫投影逆向问题，旨在构建用于信用风险的局部随机强度模型。
We provide transition rates for Markov counting systems subject to correlated environmental noises motivated by multi-strain disease models. Such noises induce simultaneous counts, which can help model infinitesimal count correlation (regardless of whether such correlation is due to correlated noises).
We construct a non-decreasing pure jump Markov process, whose jump measure heavily depends on the values taken by the process. We determine the singularity spectrum of this process, which turns out to be random and to depend locally on the values taken by the process. The result relies on fine properties of the distribution of Poisson point processes and on ubiquity theorems.
Markovian projections for Itô semimartingales with jumps
本文为带跳 Itô 半鞅构造了匹配一维边际分布的 Markovian 投影，证明其边际分布流为非局部 FPKEs 的解，并展示了其在构建兼具局部与随机特征的校准扩散/跳跃模型中的应用。
扫码添加微信好友，提出您的宝贵建议 👇
💡 备注请填写：网站反馈
发表机构由 AI 从论文文本抽取，如发现错误，欢迎反馈修正建议。