Consider a population of individuals belonging to an infinity number of types, and assume that type proportions follow the two-parameter Poisson-Dirichlet distribution. A sample of size n is selected from the population. The total number of different types and the number of types appearing in the sample with a fixed frequency are important statistics. In this paper we establish the moderate deviation principles for these quantities. The corresponding rate functions are explicitly identified, which help revealing a critical scale and understanding the exact role of the parameters. Conditional, or posterior, counterparts of moderate deviation principles are also established.
Let $M_{l,n}$ be the number of blocks with frequency $l$ in the exchangeable random partition induced by a sample of size $n$ from the Ewens-Pitman sampling model. We show that, as $n$ tends to infinity, $n^{-1}M_{l,n}$ satisfies a large deviation principle and we characterize the corresponding rate function. A conditional counterpart of this large deviation principle is also presented. Specifically, given an initial sample of size $n$ from the Ewens-Pitman sampling model, we consider an additional sample of size $m$. For any fixed $n$ and as $m$ tends to infinity, we establish a large deviati…
The Ewens-Pitman sampling model (EP-SM) is a distribution for random partitions of the set $\{1,\ldots,n\}$, with $n\in\mathbb{N}$, which is index by real parameters $α$ and $θ$ such that either $α\in[0,1)$ and $θ>-α$, or $α<0$ and $θ=-mα$ for some $m\in\mathbb{N}$. For $α=0$ the EP-SM reduces to the celebrated Ewens sampling model (E-SM), which admits a well-known compound Poisson perspective in terms of the log-series compound Poisson sampling model (LS-CPSM). In this paper, we consider a generalization of the LS-CPSM, which is referred to as the negative Binomial compound Poisson sampling m…
Ewens-Pitman model has been successfully applied to various fields including Bayesian statistics. There are four important estimators $K_{n},M_{l,n}$,$K_{m}^{(n)},M_{l,m}^{(n)}$. In particular, $M_{1,n}, M_{1,m}^{(n)}$ are related to discovery probability. Their asymptotic behavior, such as large deviation principle, has already been discussed in [4],[1] and [2]. Moderate deviation principle is also discussed in [3] with some speed restriction. In this article, we will apply complex asymptotic analysis to show that this speed restriction is unnecessary.
Generalized Chinese restaurant construction of exchangeable Gibbs partitions and related results
借助于可交换随机分拆的序列构造（Pitman，2006），并利用关于广义Stirling数的一些已知事实，我们得到了$α$型可交换Gibbs分拆的广义中餐厅过程构造（Gnedin and Pitman，2006）.我们的建设代表了自然的理论概率框架，其中嵌入一些最近的结果贝叶斯非参数处理的估计问题，在遗传实验吉布斯，物种抽样，模型先验。
We introduce a continuous-time Markov chain describing dynamic allelic partitions which extends the branching process construction of the Pitman sampling formula in Pitman (2006) and the birth-and-death process with immigration studied in Karlin and McGregor (1967), in turn related to the celebrated Ewens sampling formula. A biological basis for the scheme is provided in terms of a population of individuals grouped into families, that evolves according to a sequence of births, deaths and immigrations. We investigate the asymptotic behaviour of the chain and show that, as opposed to the birth-a…
Asymptotic behaviour of conditional $α$ diversity for the two-parameter Poisson-Dirichlet partition model and for the normalized generalized Gamma model has been recently investigated in Favaro et al. (2009, 2011) with a view to possible applications in Bayesian treatment of species richness estimation. Here we generalize those results to the larger class of mixed Poisson-Kingman species sampling models driven by the stable subordinator (Pitman, 2003).
We obtain some approximation results for the weights appearing in the exchangeable partition probability function identifying Gibbs partition models of parameter $α\in (0,1)$, as introduced in Gnedin and Pitman (2006). We rely on approximation results for central and non-central generalized Stirling numbers and on known results for conditional and unconditional $α$ diversity. We provide an application to an approximate Bayesian nonparametric estimation of discovery probability in species sampling problems under normalized inverse Gaussian priors.
We prove a long-standing conjecture which characterises the Ewens-Pitman two-parameter family of exchangeable random partitions, plus a short list of limit and exceptional cases, by the following property: for each $n = 2,3, >...$, if one of $n$ individuals is chosen uniformly at random, independently of the random partition $π_n$ of these individuals into various types, and all individuals of the same type as the chosen individual are deleted, then for each $r > 0$, given that $r$ individuals remain, these individuals are partitioned according to $π_r'$ for some sequence of random partitions …
This paper is concerned with the study of the random variable $K_n$ denoting the number of distinct elements in a random sample $(X_1, \dots, X_n)$ of exchangeable random variables driven by the two parameter Poisson-Dirichlet distribution, $PD(α,θ)$. For $α\in(0,1)$, Theorem 3.8 in \cite{Pit(06)} shows that $\frac{K_n}{n^α}\stackrel{\text{a.s.}}{\longrightarrow} S_{α,θ}$ as $n\rightarrow+\infty$. Here, $S_{α,θ}$ is a random variable distributed according to the so-called scaled Mittag-Leffler distribution. Our main result states that $$ \sup_{x \geq 0} \Big| \ppsf\Big[\frac{K_n}{n^α} \leq x \…
Gibbs-type exchangeable random partitions, which is a class of multiplicative measures on the set of positive integer partitions, appear in various contexts, including Bayesian statistics, random combinatorial structures, and stochastic models of diversity in various phenomena. Some distributional results on ordered sizes in the Gibbs partition are established by introducing associated partial Bell polynomials and analysis of the generating functions. The combinatorial approach is applied to derive explicit results on asymptotic behavior of the extreme sizes in the Gibbs partition. Especially,…
Exchangeable sequences of random probability measures (partitions of mass) and their corresponding exchangeable bridges play an important role in a variety of areas in probability, statistics and related areas, including Bayesian statistics, physics, finance and machine learning. An area of theoretical as well as practical interest, is the study of coagulation and fragmentation operators on partitions of mass. In this regard, an interesting but formidable question is the identification of operators and distributional families on mass partitions that exhibit interesting duality relations. In th…
The Generalized Chinese Restaurant Process (GCRP) describes a sequence of exchangeable random partitions of the numbers $\{1,\dots,n\}$. This process is related to the Ewens sampling model in Genetics and to Bayesian nonparametric methods such as topic models. In this paper, we study the GCRP in a regime where the number of parts grows like $n^α$ with $α>0$. We prove a non-asymptotic concentration result for the number of parts of size $k=o(n^{α/(2α+4)}/(\log n)^{1/(2+α)})$. In particular, we show that these random variables concentrate around $c_{k}\,V_*\,n^α$ where $V_*\,n^α$ is the asymptot…
This article offers a simplified approach to the distribution theory of randomly weighted averages or $P$-means $M_P(X):= \sum_{j} X_j P_j$, for a sequence of i.i.d.random variables $X, X_1, X_2, \ldots$, and independent random weights $P:= (P_j)$ with $P_j \ge 0$ and $\sum_{j} P_j = 1$. The collection of distributions of $M_P(X)$, indexed by distributions of $X$, is shown to encode Kingman's partition structure derived from $P$. For instance, if $X_p$ has Bernoulli$(p)$ distribution on $\{0,1\}$, the $n$th moment of $M_P(X_p)$ is a polynomial function of $p$ which equals the probability gener…
Gibbs partition models are the largest class of infinite exchangeable partitions of the positive integers generalizing the product form of the probability function of the two-parameter Poisson-Dirichlet family. Recently those models have been investigated in a Bayesian nonparametric approach to species sampling problems as alternatives to the Dirichlet and the Pitman-Yor process priors. Here we derive marginals of conditional and unconditional multivariate distributions arising from exchangeable Gibbs partitions to obtain explicit formulas for joint falling factorial moments of corresponding c…
