We work out some relations between duality and intertwining in the context of discrete Markov chains, fixing up the background of previous relations first established for birth and death chains and their Siegmund duals. In view of the results, the monotone properties resulting from the Siegmund dual of birth and death chains are revisited in some detail, with emphasis on the non neutral Moran model. We also introduce an ultrametric type dual extending the Siegmund kernel. Finally we discuss the sharp dual, following closely the Diaconis-Fill study.
We study properties of truncations in the dual and intertwining process in the monotone case. The main properties are stated for the time-reversed process and the time of absorption of the truncated intertwining process.
We present a theorem which elucidates the connection between self-duality of Markov processes and representation theory of Lie algebras. In particular, we identify sufficient conditions such that the intertwining function between two representations of a certain Lie algebra is the self-duality function of a (Markov) operator. In concrete terms, the two representations are associated to two operators in interwining relation. The self-dual operator, which arise from an appropriate symmetric linear combination of them, is the generator of a Markov process. The theorem is applied to a series of ex…
Markovian intertwining relations between two Markov semigroups are related to the partial inclusion of the spectra of their generators, at least for finite ergodic processes. We check the limitations of this observation by investigating the Markov intertwining relations between the Ehrenfest, Yule and Ornstein-Uhlenbeck processes, whose spectra are all included into -$\mathbb{Z}_+$. As a by-product, we offer a clarification of an intertwining relation found in Biane [2] between the Yule and the Ornstein-Uhlenbeck processes.
We develop a systematic matrix-analytic approach, based on intertwinings of Markov semigroups, for proving theorems about hitting-time distributions for finite-state Markov chains -- an approach that (sometimes) deepens understanding of the theorems by providing corresponding sample-path-by-sample-path stochastic constructions. We employ our approach to give new proofs and constructions for two theorems due to Mark Brown, theorems giving two quite different representations of hitting-time distributions for finite-state Markov chains started in stationarity. The proof, and corresponding constru…
In this paper we derive intertwining relations for a broad class of conservative particle systems both in discrete and continuous setting. Using the language of point process theory, we are able to derive a natural framework in which duality and intertwining can be formulated. We prove falling factorial and orthogonal polynomial intertwining relations in a general setting. These intertwinings unite the previously found classical and orthogonal self-dualities in the context of discrete particle systems and provide new dualities for several interacting systems in the continuum. We also introduce…
We continue our investigation of the intertwining relations for Markov semigroups and extend the results of [9] to multi-dimensional diffusions. In particular these formulae entail new functional inequalities of Brascamp-Lieb type for log-concave distributions and beyond. Our results are illustrated by some classical and less classical examples.
We obtain an intertwining relation between some Riemann-Liouville operators of order a in (1,2) connecting through a certain multiplicative identity in law the one-dimensional marginals of reflected completely asymmetric a-stable Lévy processes. An alternative approach based on recurrent extensions of positive self-similar Markov processes and exponential functionals of Lévy processes is also discussed.
There are two open problem on the analysis of continuous paths on a Riemannian manifold, the Markov uniqueness and the independence of the closure of the differential operator $d$ on its initial domain. The operator $d$ acts naturally on $BC^1$ functions, one is concerned with its extensions to the $L^2$ spaces. With a suitable choice of an initial domain we denote by $D^{2,1}$ its closure under the graph norm. For the Wiener space, the domain of $d$ can be classified, as a consequence its extension is unique whether the initial domain is smooth cylindrical or in $BC^1$ etc. This has not shown…
The Markov commutator associated to a finite Markov kernel P is the convex semigroup consisting of all Markov kernels commuting with P. Its interest comes from its relation with the hypergroup property and with the notion of Markovian duality by intertwining. In particular, it is shown that the discrete analogue of the Achour-Trim{è}che's theorem, asserting the preservation of non-negativity by the wave equations associated to certain Metropolis birth and death transition kernels, cannot be extended to all convex potentials. But it remains true for symmetric and monotone convex potentials. Key…
In this paper, we start by showing that the intertwining relationship between two minimal Markov semigroups acting on Hilbert spaces implies that any recurrent extensions, in the sense of Itô, of these semigroups satisfy the same intertwining identity. Under mild additional assumptions on the intertwining operator, we prove that the converse also holds. This connection, which relies on the representation of excursion quantities as developed by Fitzsimmons and Getoor, enables us to give an interesting probabilistic interpretation of intertwining relationships between Markov semigroups via excur…
We explore the consequences of the so-called intertwinings between gradients and Markov diffusion operators on $R^d$ in terms of second-order Brascamp-Lieb inequalities for log-concave distributions and beyond, extending our inequalities established in a previous paper. As a result, we derive some convenient lower bounds on the $(d+1)^{th}$ positive eigenvalue depending on the spectral gap of the dual Markov diffusion operator given by the intertwining. To see the relevance of our approach, we apply our spectral results in the case of perturbed product measures, freeing us from Helffer's class…
We prove intertwining relations by twisted gradients for Markov semi-groups. These relations are applied to Brascamp-Lieb type inequalities and spectral gap results. It generalizes the results of [1] from the Euclidean space to Riemannian manifolds and to non symmetric twisted operators.
Consider the Aldous Markov chain on the space of rooted binary trees with $n$ labeled leaves in which at each transition a uniform random leaf is deleted and reattached to a uniform random edge. Now, fix $1\le k < n$ and project the leaf mass onto the subtree spanned by the first $k$ leaves. This yields a binary tree with edge weights that we call a "decorated $k$-tree with total mass $n$." We introduce label swapping dynamics for the Aldous chain so that, when it runs in stationarity, the decorated $k$-trees evolve as Markov chains themselves, and are projectively consistent over $k\le n$. Th…
It is known that the time until a birth and death process reaches a certain level is distributed as a sum of independent exponential random variables. Diaconis, Miclo and Swart gave a probabilistic proof of this fact by coupling the birth and death process with a pure birth process such that the two processes reach the given level at the same time. Their coupling is of a special type called intertwining of Markov processes. We apply this technique to couple the Wright-Fisher diffusion with reflection at 1/2 and a pure birth process. We show that in our coupling the time of absorption of the di…
We raise a question on whether a dynamical system driven by Markov process is Markovian, for which we are able to propose a criterion and examples of positive case. This investigation leads us to develop (i) a general construction of intertwining dual via Liggett duality, and (ii) a realization of $Λ$-linked coupling in a form of dynamical system. We show this construction of intertwining dual and $Λ$-linked coupling for an $n$-dimensional drifting Brownian motion when it is a characteristic diffusion. In particular, it includes an extension of Pitman's $2M-W$ theorem by Rogers and Pitman as a…
The paper is devoted to a systematic study of the duality of processes in the sense that $E f(X_t^x,y)=E f (x, Y_t^y)$ for a certain $f$. This classical topic has well known applications in interacting particles, intertwining, superprocesses, stochastic monotonicity, exit - entrance laws, ruin probabilities in finances, etc. Aiming mostly at the case of $f$ depending on the difference of its arguments, we shall give a systematic study of duality via the analysis of the generators of dual Markov processes leading to various results and insights.
Recently there has been significant interest in constructing ordered analogues of Petrov's two-parameter extension of Ethier and Kurtz's infinitely-many-neutral-alleles diffusion model. One method for constructing these processes goes through taking an appropriate diffusive limit of Markov chains on integer compositions called ordered Chinese Restaurant Process up-down chains. The resulting processes are diffusions whose state space is the set of open subsets of the open unit interval. In this paper we begin to study nontrivial aspects of the order structure of these diffusions. In particular,…
Processes having the same bridges are said to belong to the same reciprocal class. In this article we analyze reciprocal classes of Markov counting processes by identifying their reciprocal invariants and we characterize them as the set of counting processes satisfying some duality formula.
The theory of monotonicity and duality is developed for general one-dimensional Feller processes. Moreover it is shown that local monotonicity conditions (conditions on the Lévy kernel) are sufficient to prove the well-posedness of the corresponding Markov semigroup and process, including unbounded coefficients and processes on the half-line.
For Markov chains with a partially ordered finite state space we show strong stationary duality under the condition of Möbius monotonicity of the chain. We show relations of Möbius monotonicity to other definitions of monotone chains. We give examples of dual chains in this context which have transitions only upwards. We illustrate general theory by an analysis of nonsymmetric random walks on the cube with an application to networks of queues.
This is the first part of a possible monograph on the duality of Markov processes. It contains a proof of Fitzsimmons' existence theorem of a moderate Markov dual process relative to an excessive measure, m, together with the necessary preliminary material. Then this is applied to prove the correspondence between optional copredictable homogenous random measures and sigma finite measures not charging m-exceptional sets again following Fitzsimmons. The second part which may never be written would deal with duality proper including results from, but not limited to, my joint paper with P. J. Fitz…
We show that the multi-species higher spin stochastic vertex model, also called the U_q(A_n^{(1)}) vertex model, satisfies a duality where the indicator function has the form {η^x_{[1,n]} \geq ξ^x_{[1,n]} }. In other words, for every particle in the ξconfiguration of species i at vertex x, there must be a particle of species j > i at vertex x in the ηconfiguration. The proof follows by applying charge reversal to previously discovered duality functions, which also results in open boundary conditions. As a corollary, we recover the duality for the stochastic six vertex model recently found by Y…
We construct strong stationary dual chains for Ising model on a circle, non-symmetric random walk on square lattice and a random walk on hypercube. The strong stationary dual chains are all sharp and have the same state space as original chains. We use Möbius monotonicity of these chains with respect to natural orderings of the corresponding state spaces. This method provides an easy way to find eigenvalues in the Ising model and for a random walk on hypercube. Keywords: Markov chains; stochastic monotonicity; eigenvalues; Möbius monotonicity; strong stationary duality; strong stationary times…
One of the key ingredients to successfully apply Stein's method for distributional approximation are solutions to the Stein equations and their derivatives. Using Barbour's generator approach, one can solve for the solutions to the Stein equation in terms of the semi-group of a Markov process, which is typically a diffusion process if it is a continuous distribution. For an arbitrary diffusion it can a difficult task to evaluate the semi-group and its derivatives. In this paper, for polynomial test functions, instead of calculating the semi-group of a diffusion, via a duality argument, we inst…
We propose a new method for performing multiscale analysis of functions defined on the vertices of a finite connected weighted graph. Our approach relies on a random spanning forest to downsample the set of vertices, and on approximate solutions of Markov intertwining relation to provide a subgraph structure and a filter bank leading to a wavelet basis of the set of functions. Our construction involves two parameters q and q'. The first one controls the mean number of kept vertices in the downsampling, while the second one is a tuning parameter between space localization and frequency localiza…
CMAP, Ecole Polytechnique（巴黎综合理工学院 CMAP）；Laboratoire Analyse, Géométrie & Applications, Université Sorbonne Paris Nord（索邦巴黎北大学 分析与几何实验室）；Department of Mathematics, Faculty of Mathematics and Physics, University of Ljubljana（卢布尔雅那大学数学与物理学院数学系）；Institute of Mathematics, Physics and Mechanics, Ljubljana, Slovenia（斯洛文尼亚卢布尔雅那数学、物理和力学研究所）
We show that any $\mathbb{R}^d\setminus\{0\}$-valued self-similar Markov process $X$, with index $α>0$ can be represented as a path transformation of some Markov additive process (MAP) $(θ,ξ)$ in $S_{d-1}\times\mathbb{R}$. This result extends the well known Lamperti transformation. Let us denote by $\widehat{X}$ the self-similar Markov process which is obtained from the MAP $(θ,-ξ)$ through this extended Lamperti transformation. Then we prove that $\widehat{X}$ is in weak duality with $X$, with respect to the measure $π(x/\|x\|)\|x\|^{α-d}dx$, if and only if $(θ,ξ)$ is reversible with respect …
We provide a systematic study of the notion of duality of Markov processes with respect to a function. We discuss the relation of this notion with duality with respect to a measure as studied in Markov process theory and potential theory and give functional analytic results including existence and uniqueness criteria and a comparison of the spectra of dual semi-groups. The analytic framework builds on the notion of dual pairs, convex geometry, and Hilbert spaces. In addition, we formalize the notion of pathwise duality as it appears in population genetics and interacting particle systems. We d…
We develop the theory of strong stationary duality for diffusion processes on compact intervals. We analytically derive the generator and boundary behavior of the dual process and recover a central tenet of the classical Markov chain theory in the diffusion setting by linking the separation distance in the primal diffusion to the absorption time in the dual diffusion. We also exhibit our strong stationary dual as the natural limiting process of the strong stationary dual sequence of a well chosen sequence of approximating birth-and-death Markov chains, allowing for simultaneous numerical simul…
We prove that Schütz's ASEP Markov duality functional is also a Markov duality functional for the stochastic six vertex model. We introduce a new method that uses induction on the number of particles to prove the Markov duality.
This survey article gives an elementary introduction to the algebraic approach to Markov process duality, as opposed to the pathwise approach. In the algebraic approach, a Markov generator is written as the sum of products of simpler operators, which each have a dual with respect to some duality function. We discuss at length the recent suggestion by Giardinà, Redig, and others, that it may be a good idea to choose these simpler operators in such a way that they form an irreducible representation of some known Lie algebra. In particular, we collect the necessary background on representations o…
We show that quantum Schur-Weyl duality leads to Markov duality for a variety of asymmetric interacting particle systems. In particular, we consider three cases: (1) Using a Schur-Weyl duality between a two-parameter quantum group and a two-parameter Hecke algebra from arXiv:math/0108038, we recover the Markov self-duality of multi-species ASEP previously discovered in arXiv:1605.00691 and arXiv:1606.04587. (2) From a Schur-Weyl duality between a co-ideal subalgebra of a quantum group and a Hecke algebra of type B arXiv:1609.01766, we find a Markov duality for a multi-species open ASEP on the …
Consider a system $X = ((x_ξ(t)), ξ\in Ω_N)_{t \geq 0}$ of interacting Fleming-Viot diffusions with mutation and selection which is a strong Markov process with continuous paths and state space $(\CP(\I))^{Ω_N}$, where $\I$ is the type space, ${Ω_N}$ the geographic space is assumed to be a countable group and $\CP$ denotes the probability measures. We establish various duality relations for this process. These dualities are function-valued processes which are driven by a coalescing-branching random walk, that is, an evolving particle system which in addition exhibits certain changes in the fun…
In 2013, Lu and Ren \cite {luren} considered anticipated backward stochastic differential equations driven by finite state, continuous time Markov chain noise and established the existence and uniqueness of the solutions of these equations and a scalar comparison theorem. In this paper, we provide an estimate for their solutions and study the duality between these equations and stochastic differential delayed equations with Markov chain noise. Finally we derive another comparison theorem for these solutions depending only on the two drivers.
The central result of this paper is an analytic duality relation for real-valued Lévy processes killed upon exiting a half-line. By Nagasawa's theorem, this yields a remarkable time-reversal identity involving the Lévy process conditioned to stay positive. As examples of applications, we construct a version of the Lévy process indexed by the entire real line and started from $-\infty$ which enjoys a natural spatial-stationarity property, and point out that the latter leads to a natural Lamperti-type representation for self-similar Markov processes in $(0,\infty)$ started from the entrance poin…
Inspired by the recent work of Bertini and Posta, who introduced the boundary driven Brownian gas on $[0,1]$, we study boundary driven systems of independent particles in a general setting, including particles jumping on finite graphs and diffusion processes on bounded domains in $\mathbb{R}^d$. We prove duality with a dual process that is absorbed at the boundaries, thereby creating a general framework that unifies dualities for boundary driven systems in the discrete and continuum setting. We use duality first to show that from any initial condition the systems evolve to the unique invariant…
This paper develops a systematic treatment of monotonicity-based pathwise dualities for Markov processes taking values in partially ordered sets. We show that every Markov process that takes values in a finite partially ordered set and whose generator can be represented in monotone maps has a pathwise dual process. In the special setting of attractive spin systems this has been discovered earlier by Gray. We show that the dual simplifies a lot when the state space is a lattice (in the order-theoretic meaning of the word) and all monotone maps satisfy an additivity condition. This leads to a un…
We prove a intertwining relation (or Markov duality) between the $(q,μ,ν)$-Boson process and $(q,μ,ν)$-TASEP, two discrete time Markov chains introduced by Povolotsky. Using this and a variant of the coordinate Bethe ansatz we compute nested contour integral formulas for expectations of a family of observables of the $(q,μ,ν)$-TASEP when started from step initial data. We then utilize these to prove a Fredholm determinant formula for distribution of the location of any given particle.
The first aim of this paper is to introduce a class of Markov chains on $\mathbb{Z}_+$ which are discrete self-similar in the sense that their semigroups satisfy an invariance property expressed in terms of a discrete random dilation operator. After showing that this latter property requires the chains to be upward skip-free, we first establish a gateway relation, a concept introduced in [26], between the semigroup of such chains and the one of spectrally negative self-similar Markov processes on $\mathbb{R}_+$. As a by-product, we prove that each of these Markov chains, after an appropriate s…
Interweaving relations are introduced and studied here in a general Markovian setting as a strengthening of usual intertwining relations between semigroups, obtained by adding a randomized delay feature. They provide a new classification scheme of the set of Markovian semigroups which enables to transfer from a reference semigroup and up to an independent warm-up time, some ergodic, analytical and mixing properties including the $φ$-entropy convergence to equilibrium, the hyperboundedness and when the warm-up time is deterministic the cut-off phenomena. We also present several useful transform…
This paper is concerned with a characterization of the observability for a continuous-time hidden Markov model where the state evolves as a general continuous-time Markov process and the observation process is modeled as nonlinear function of the state corrupted by the Gaussian measurement noise. The main technical tool is based on the recently discovered duality relationship between minimum variance estimation and stochastic optimal control: The observability is defined as a dual of the controllability for a certain backward stochastic differential equation. Based on the dual formulation, a t…
We study self-duality for interacting particle systems, where the particles move as continuous time random walkers having either exclusion interaction or inclusion interaction. We show that orthogonal self-dualities arise from unitary symmetries of the Markov generator. For these symmetries we provide two equivalent expressions that are related by the Baker-Campbell-Hausdorff formula. The first expression is the exponential of an anti Hermitian operator and thus is unitary by inspection; the second expression is factorized into three terms and is proved to be unitary by using generating functi…
