A simple explicit construction is provided of a partition-valued fragmentation process whose distribution on partitions of $[n]=\{1,...,n\}$ at time $θ\ge 0$ is governed by the Ewens sampling formula with parameter $θ$. These partition-valued processes are exchangeable and consistent, as $n$ varies. They can be derived by uniform sampling from a corresponding mass fragmentation process defined by cutting a unit interval at the points of a Poisson process with intensity $θx^{-1} \diff x$ on ${\mathbb R}_+$, arranged to be intensifying as $θ$ increases.
The Ewens sampling formula was firstly introduced in the context of population genetics by Warren John Ewens in 1972, and has appeared in a lot of other scientific fields. There are abundant approximation results associated with the Ewens sampling formula especially when one of the parameters, the sample size $n$ or the mutation parameter $θ$ which denotes the scaled mutation rate, tends to infinity while the other is fixed. By contrast, the case that $θ$ grows with $n$ has been considered in a relatively small number of works, although this asymptotic setup is also natural. In this paper, whe…
The Ewens-Pitman sampling model (EP-SM) is a distribution for random partitions of the set $\{1,\ldots,n\}$, with $n\in\mathbb{N}$, which is index by real parameters $α$ and $θ$ such that either $α\in[0,1)$ and $θ>-α$, or $α<0$ and $θ=-mα$ for some $m\in\mathbb{N}$. For $α=0$ the EP-SM reduces to the celebrated Ewens sampling model (E-SM), which admits a well-known compound Poisson perspective in terms of the log-series compound Poisson sampling model (LS-CPSM). In this paper, we consider a generalization of the LS-CPSM, which is referred to as the negative Binomial compound Poisson sampling m…
Several results of large deviations are obtained for distributions that are associated with the Poisson--Dirichlet distribution and the Ewens sampling formula when the parameter $θ$ approaches infinity. The motivation for these results comes from a desire of understanding the exact meaning of $θ$ going to infinity. In terms of the law of large numbers and the central limit theorem, the limiting procedure of $θ$ going to infinity in a Poisson--Dirichlet distribution corresponds to a finite allele model where the mutation rate per individual is fixed and the number of alleles going to infinity. …
We introduce a universality theorem for functionals of measures on partitions which "behave like" the Ewens measure. Various limit theorems for the Ewens measure, most notably the Poisson-Dirichlet limit for the longest parts, the functional central limit theorem for the number of parts, and the Erdos-Turan limit for the product of parts, extend to these asymptotically Ewens measures as easy corollaries. Our major contributions are: (1) extending the classes of measures for which these limit theorems hold; (2) characterising universality by a single, easily-checked criterion; and (3) greatly s…
We provide a general theorem bounding the error in the approximation of a random measure of interest--for example, the empirical population measure of types in a Wright-Fisher model--and a Dirichlet process, which is a measure having Poisson-Dirichlet distributed atoms with i.i.d. labels from a diffuse distribution. The implicit metric of the approximation theorem captures the sizes and locations of the masses, and so also yields bounds on the approximation between the masses of the measure of interest and the Poisson-Dirichlet distribution. We apply the result to bound the error in the approx…
We study the number of random permutations needed to invariably generate the symmetric group, $S_n$, when the distribution of cycle counts has the strong $α$-logarithmic property. The canonical example is the Ewens sampling formula, for which the number of $k$-cycles relates to a conditioned Poisson random variable with mean $α/k$. The special case $α=1$ corresponds to uniformly random permutations, for which it was recently shown that exactly four are needed. For strong $α$-logarithmic measures, and almost every $α$, we show that precisely $\left\lceil ( 1- α\log 2 )^{-1} \right\rceil$ permut…
Consider a population of individuals belonging to an infinity number of types, and assume that type proportions follow the two-parameter Poisson-Dirichlet distribution. A sample of size n is selected from the population. The total number of different types and the number of types appearing in the sample with a fixed frequency are important statistics. In this paper we establish the moderate deviation principles for these quantities. The corresponding rate functions are explicitly identified, which help revealing a critical scale and understanding the exact role of the parameters. Conditional, …
Kingman derived the Ewens sampling formula for random partitions from the genealogy model defined by a Poisson process of mutations along lines of descent governed by a simple coalescent process. Möhle described the recursion which determines the generalization of the Ewens sampling formula when the lines of descent are governed by a coalescent with multiple collisions. In a recent work by Dong, Gnedin and Pitman, authors exploit an analogy with the theory of regenerative composition and partition structures, and provide various characterizations of the associated exchangeable random partition…
In this paper we give a new example of duality between fragmentation and coagulation operators. Consider the space of partitions of mass (i.e., decreasing sequences of nonnegative real numbers whose sum is 1) and the two-parameter family of Poisson--Dirichlet distributions $\operatorname {PD}(α,θ)$ that take values in this space. We introduce families of random fragmentation and coagulation operators $\mathrm {Frag}_α$ and $\mathrm {Coag}_{α,θ}$, respectively, with the following property: if the input to $\mathrm {Frag}_α$ has $\operatorname {PD}(α,θ)$ distribution, then the output has $\opera…
We show that for $0<α<1$ and $θ>-α$, the Poisson-Dirichlet distribution with parameter $(α, θ)$ is the unique reversible distribution of a rather natural fragmentation-coalescence process. This completes earlier results in the literature for certain split and merge transformations and the parameter $α=0$.
Kingman derived the Ewens sampling formula for random partitions describing the genetic variation in a neutral mutation model defined by a Poisson process of mutations along lines of descent governed by a simple coalescent process, and observed that similar methods could be applied to more complex models. M{ö}hle described the recursion which determines the generalization of the Ewens sampling formula in the situation when the lines of descent are governed by a $Λ$-coalescent, which allows multiple mergers. Here we show that the basic integral representation of transition rates for the $Λ$-coa…
In this paper we define and study self-similar ranked fragmentations. We first show that any ranked fragmentation is the image of some partition-valued fragmentation, and that there is in fact a one-to-one correspondence between the laws of these two types of fragmentations. We then give an explicit construction of homogeneous ranked fragmentations in terms of Poisson point processes. Finally we use this construction and classical results on records of Poisson point processes to study the small-time behavior of a ranked fragmentation.
We consider Markov chains on the space of (countable) partitions of the interval $[0,1]$, obtained first by size biased sampling twice (allowing repetitions) and then merging the parts with probability $β_m$ (if the sampled parts are distinct) or splitting the part with probability $β_s$ according to a law $σ$ (if the same part was sampled twice). We characterize invariant probability measures for such chains. In particular, if $σ$ is the uniform measure then the Poisson-Dirichlet law is an invariant probability measure, and it is unique within a suitably defined class of ``analytic'' invarian…
Pitman~(1999) describes a duality relationship between fragmentation and coagulation operators. An explicit relationship is described for the two-parameter Poisson-Dirichlet laws, with parameters {\footnotesize $(α,θ)$} and $(β,θ/α)$, wherein $PD(α, θ)$ is coagulated by $PD(β,θ/α)$ for $0<α<1$, $0 \leqβ<1$ and $-β<θ/α$. This remarkable explicit agreement was obtained by combinatorial methods via exchangeable partition probability functions~(EPPF). This work discusses an alternative analysis which can feasibly extend the characterizations above to more general models of $PD(α,θ)$ coagulated wit…
We consider the height process of a Levy process with no negative jumps, and its associated continuous tree representation. Using Levy snake tools developed by Duquesne and Le Gall, with an underlying Poisson process, we construct a fragmentation process, which in the stable case corresponds to the self-similar fragmentation described by Miermont. For the general fragmentation process we compute a family of dislocation measures as well as the law of the size of a tagged fragment. We also give a special Markov property for the snake which is interesting in itself.
Gibbs partitions of the integers generated by stable subordinators of index $α\in(0,1)$ form remarkable classes of random partitions where in principle much is known about their properties, including practically effortless obtainment of otherwise complex asymptotic results potentially relevant to applications in general combinatorial stochastic processes, random tree/graph growth models and Bayesian statistics. This class includes the well-known models based on the two-parameter Poisson-Dirichlet distribution which forms the bulk of explicit applications. This work continues efforts to provide…
Network dynamics with point-process-based interactions are of paramount modeling interest. Unfortunately, most relevant dynamics involve complex graphs of interactions for which an exact computational treatment is impossible. To circumvent this difficulty, the replica-mean-field approach focuses on randomly interacting replicas of the networks of interest. In the limit of an infinite number of replicas, these networks become analytically tractable under the so-called "Poisson Hypothesis". However, in most applications, this hypothesis is only conjectured. Here, we establish the Poisson Hypothe…
In this paper we study random partitions of 1,...n, where every cluster of size j can be in any of w\_j possible internal states. The Gibbs (n,k,w) distribution is obtained by sampling uniformly among such partitions with k clusters. We provide conditions on the weight sequence w allowing construction of a partition valued random process where at step k the state has the Gibbs (n,k,w) distribution, so the partition is subject to irreversible fragmentation as time evolves. For a particular one-parameter family of weight sequences w\_j, the time-reversed process is the discrete Marcus-Lushnikov …
Exchangeable sequences of random probability measures (partitions of mass) and their corresponding exchangeable bridges play an important role in a variety of areas in probability, statistics and related areas, including Bayesian statistics, physics, finance and machine learning. An area of theoretical as well as practical interest, is the study of coagulation and fragmentation operators on partitions of mass. In this regard, an interesting but formidable question is the identification of operators and distributional families on mass partitions that exhibit interesting duality relations. In th…
Pitman(2003)(and subsequently Gnedin and Pitman (2006) showed that a large class of random partitions of the integers derived from a stable subordinator of index $α\in(0,1)$ have infinite Gibbs (product) structure as a characterizing feature. The most notable case are random partitions derived from the two-parameter Poisson-Dirichlet distribution, $\mathrm{PD}(α,θ)$, which are induced by mixing over variables with generalized Mittag-Leffler distributions, denoted by $\mathrm{ML}(α,θ).$ Our aim in this work is to provide indications on the utility of the wider class of Gibbs partitions as it re…
Fractional Poisson processes, a rapidly growing area of non-Markovian stochastic processes, are useful in statistics to describe data from counting processes when waiting times are not exponentially distributed. We show that the fractional Kolmogorov-Feller equations for the probabilities at time t can be representated by an infinite linear system of ordinary differential equations of first order in a transformed time variable. These new equations resemble a linear version of the discrete coagulation-fragmentation equations, well-known from the non-equilibrium theory of gelation, cluster-dynam…
We develop some theory of spinal decompositions of discrete and continuous fragmentation trees. Specifically, we consider a coarse and a fine spinal integer partition derived from spinal tree decompositions. We prove that for a two-parameter Poisson--Dirichlet family of continuous fragmentation trees, including the stable trees of Duquesne and Le Gall, the fine partition is obtained from the coarse one by shattering each of its parts independently, according to the same law. As a second application of spinal decompositions, we prove that among the continuous fragmentation trees, stable trees a…
We consider fragmentations of an R-tree $T$ driven by cuts arriving according to a Poisson process on $T \times [0, \infty)$, where the first co-ordinate specifies the location of the cut and the second the time at which it occurs. The genealogy of such a fragmentation is encoded by the so-called cut-tree, which was introduced by Bertoin and Miermont for a fragmentation of the Brownian continuum random tree. The cut-tree was generalised by Dieuleveut to a fragmentation of the $α$-stable trees, $α\in (1, 2)$, and by Broutin and Wang to the inhomogeneous continuum random trees of Aldous and Pitm…
We use a natural ordered extension of the Chinese Restaurant Process to grow a two-parameter family of binary self-similar continuum fragmentation trees. We provide an explicit embedding of Ford's sequence of alpha model trees in the continuum tree which we identified in a previous article as a distributional scaling limit of Ford's trees. In general, the Markov branching trees induced by the two-parameter growth rule are not sampling consistent, so the existence of compact limiting trees cannot be deduced from previous work on the sampling consistent case. We develop here a new approach to es…
NICTA（澳大利亚国家信息与通信技术研究院）；Australian National University（澳大利亚国立大学）
The two parameter Poisson-Dirichlet Process (PDP), a generalisation of the Dirichlet Process, is increasingly being used for probabilistic modelling in discrete areas such as language technology, bioinformatics, and image analysis. There is a rich literature about the PDP and its derivative distributions such as the Chinese Restaurant Process (CRP). This article reviews some of the basic theory and then the major results needed for Bayesian modelling of discrete problems including details of priors, posteriors and computation. The PDP allows one to build distributions over countable partitions…
These notes give a mathematical introduction to two seemingly unrelated topics: (i) quantum spin systems and their cycle and loop representations, due to Tóth and Aizenman-Nachtergaele; (ii) coagulation-fragmentation stochastic processes. These topics are nonetheless related, as we argue that the lengths of cycles and loops satisfy an effective coagulation-fragmentation process. This suggests that their joint distribution is Poisson-Dirichlet. These ideas are far from being proved, but they are backed by several rigorous results, notably of Dyson-Lieb-Simon and Schramm.
Consider a critical Erdös-Rényi random graph: $n$ is the number of vertices, each one of the $\binom{n}{2}$ possible edges is kept in the graph independently from the others with probability $n^{-1}+λn^{-4/3}$, $λ$ being a fixed real number. When $n$ goes to infinity, Addario-Berry, Broutin and Goldschmidt have shown that the collection of connected components, viewed as suitably normalized measured compact metric spaces, converges in distribution to a continuous limit $\mathcal{G}_λ$ made of random real graphs. In this paper, we consider notably the dynamical percolation on critical Erdös-Rén…
