Local limit theorems are derived for the number of occupied urns in general finite and infinite urn models under the minimum condition that the variance tends to infinity. Our results represent an optimal improvement over previous ones for normal approximation.
We investigate a specific infinite urn scheme first considered by Karlin (1967). We prove functional central limit theorems for the total number of urns with at least k balls for different k.
We study the infinite urn scheme when the balls are sequentially distributed over an infinite number of urns labelled 1,2,... so that the urn $j$ at every draw gets a ball with probability $p_j$, $\sum_j p_j=1$. We prove functional central limit theorems for discrete time and the poissonised version for the urn occupancies process, for the odd-occupancy and for the missing mass processes extending the known non-functional central limit theorems.
In this work we generalize Polya urn schemes with possibly infinitely many colors and extend the earlier models described in [4, 5, 7]. We provide a novel and unique approach of representing the observed sequence of colors in terms a branching Markov chain on random recursion tree. This enables us to derive fairly general asymptotic for our urn schemes. We then illustrate through several examples that our method can easily derive the classical results for finite urns, as well as, many new results for infinite color urns.
The purpose of this work is to establish a central limit theorem that can be applied to a particular form of Markov chains, including the number of descents in a random permutation of $\mathfrak{S}_n$, two-type generalized P{ó}lya urns, and some other urn models.
We consider Pólya urns with infinitely many colours that are of a random walk type, in two related version. We show that the colour distribution a.s., after rescaling, converges to a normal distribution, assuming only second moments on the offset distribution. This improves results by Bandyopadhyay and Thacker (2014--2017; convergence in probability), and Mailler and Marckert (2017; a.s. convergence assuming exponential moment).
We construct an independent increments Gaussian process associated to a class of multicolor urn models. The construction uses random variables from the urn model which are different from the random variables for which central limit theorems are available in the two color case.
We consider the generalization of the Pólya urn scheme with possibly infinite many colors as introduced in \cite{Th-Thesis, BaTH2014, BaTh2016, BaTh2017}. For countable many colors, we prove almost sure convergence of the urn configuration under \emph{uniform ergodicity} assumption on the associated Markov chain. The proof uses a stochastic coupling of the sequence of chosen colors with a \emph{branching Markov chain} on a weighted \emph{random recursive tree} as described in \cite{BaTh2017, Sv_2018}. Using this coupling we estimate the covariance between any two selected colors. In particular…
For the plain Polya urn with two colors, black and white, we prove a functional central limit theorem for the number of white balls assuming that the initial number of black balls is large. Depending on the initial number of white balls, the limit is either a pure birth process or a diffusion. We also prove analogous results for the q-Polya urn, which is an urn where, when picking a ball, the balls of one color have priority over those of the other.
In this work we consider the \emph{infinite color urn model} associated with a bounded increment random walk on $\Zbold^d$. This model was first introduced by Bandyopadhyay and Thacker (2013). We prove that the rate of convergence of the expected configuration of the urn at time $n$ with appropriate centering and scaling is of the order ${\mathcal O}\left(\frac{1}{\sqrt{\log n}}\right)$. Moreover we derive bounds similar to the classical Berry-Essen bound. Further we show that for the expected configuration a \emph{large deviation principle (LDP)} holds with a good rate function and speed $\lo…
We investigate the randomized Karlin model with parameter $β\in(0,1)$, which is based on an infinite urn scheme. It has been shown before that when the randomization is bounded, the so-called odd-occupancy process scales to a fractional Brownian motion with Hurst index $β/2\in(0,1/2)$. We show here that when the randomization is heavy-tailed with index $α\in(0,2)$, then the odd-occupancy process scales to a $(β/α)$-self-similar symmetric $α$-stable process with stationary increments.
The asymptotic behaviour of a generalised Pólya--Eggenberger urn is well--known to depend on the spectrum of its replacement matrix: If its dominant eigenvalue $r$ is simple and no other eigenvalue is `large' in the sense that its real part is greater than $r/2$, the normalized urn composition is asymptotically normally distributed. However, if there is more than one large eigenvalue, the first few random draws have a non--negligible effect on the evolution of the urn process and almost sure random tendencies of order larger than $\sqrt{n}$ typically prevent a classical central limit theorem. …
We consider a model of N two-colors urns in which the reinforcement of each urn depends also on the content of all the other urns. This interaction is of mean-field type and it is tuned by a parameter $α$ in [0,1]; in particular, for $α=0$ the N urns behave as N independent Polya's urns. As shown in [9], for $α>0$ urns synchronize, in the sense that the fraction of balls of a given color converges a.s. to the same (random) limit in all urns. In this paper we study fluctuations around this synchronized regime. The scaling of these fluctuations depends on the parameter $α$. In particular the sta…
The generalized Pòlya urn (GPU) models and their variants have been investigated in several disciplines. However, typical assumptions made with respect to the GPU do not include urn models with diagonal replacement matrix, which arise in several applications, specifically in clinical trials. To facilitate mathematical analyses of models in these applications, we introduce an adaptive randomly reinforced urn model that uses accruing statistical information to adaptively skew the urn proportion toward specific targets. We study several probabilistic aspects that are important in implementing the…
We study an urn process containing red and blue balls and two different strategies to reinforce the urn. Namely, a generalized Pólya-type strategy versus an i.i.d. one. At each step, one of the two reinforcement strategies is chosen by flipping a coin. We study the asymptotic behaviour of this urn model, and prove a law of large numbers, a central limit theorem and a functional limit theorem for the proportion of balls into the urn. A phase transition is also stated.
In this work we introduce a new type of urn model with infinite but countable many colors indexed by an appropriate infinite set. We mainly consider the indexing set of colors to be the $d$-dimensional integer lattice and consider balanced replacement schemes associated with bounded increment random walks on it. We prove central and local limit theorems for the random color of the $n$-th selected ball and show that irrespective of the null recurrent or transient behavior of the underlying random walks, the asymptotic distribution is Gaussian after appropriate centering and scaling. We show tha…
An urn model of Diaconis and some generalizations are discussed. A convergence theorem is proved that implies for Diaconis' model that the empirical distribution of balls in the urn converges with probability one to the uniform distribution.
In this paper, we prove functional limit theorems for Pólya urn processes whose number of draws and initial number of balls tend to infinity together. This is motivated by recent work of Borovkov [5], where they prove a functional limit theorem for this model when the urn has identity replacement rule. We generalize this result to arbitrary balanced replacement rules (the total number of balls added to the urn is deterministic). Three asymptotic regimes are possible depending on how one lets the number of initial balls scale with the number of draws of the urn. In each regime, we show a first …
The Generalized Pólya Urn (GPU) is a popular urn model which is widely used in many disciplines. In particular, it is extensively used in treatment allocation schemes in clinical trials. In this paper, we propose a sequential estimation-adjusted urn model (a nonhomogeneous GPU) which has a wide spectrum of applications. Because the proposed urn model depends on sequential estimations of unknown parameters, the derivation of asymptotic properties is mathematically intricate and the corresponding results are unavailable in the literature. We overcome these hurdles and establish the strong consis…
We study the joint asymptotics of forward and backward processes of numbers of non-empty urns in an infinite urn scheme. The probabilities of balls hitting the urns are assumed to satisfy the conditions of regular decrease. We prove weak convergence to a two-dimensional Gaussian process. Its covariance function depends only on exponent of regular decrease of probabilities. We obtain parameter estimates that have a normal asymototics for its joint distribution together with forward and backward processes. We use these estimates to construct statistical tests for the homogeneity of the urn schem…
We investigate a special case of infinite urn schemes first considered by Karlin (1967), especially its occupancy and odd-occupancy processes. We first propose a natural randomization of these two processes and their decompositions. We then establish functional central limit theorems, showing that each randomized process and its components converge jointly to a decomposition of certain self-similar Gaussian process. In particular, the randomized occupancy process and its components converge jointly to the decomposition of a time-changed Brownian motion $\mathbb B(t^α), α\in(0,1)$, and the rand…
We study first order linear partial differential equations that appear, for example, in the analysis of dimishing urn models with the help of the method of characteristics and formulate sufficient conditions for a central limit theorem.
We consider systems of interacting Generalized Friedman's Urns (GFUs) having irreducible mean replacement matrices. The interaction is modeled through the probability to sample the colors from each urn, that is defined as convex combination of the urn proportions in the system. From the weights of these combinations we individuate subsystems of urns evolving with different behaviors. We provide a complete description of the asymptotic properties of urn proportions in each subsystem by establishing limiting proportions, convergence rates and Central Limit Theorems. The main proofs are based on …
We study a Pólya-type urn model defined as follows. Start at time 0 with a single ball of some colour. Then, at each time n>0, choose a ball from the urn uniformly at random. With probability 1/2<p<1, return the ball to the urn along with another ball of the same colour. With probability 1-p, recolour the ball to a new colour and then return it to the urn. This is equivalent to the supercritical case of a random graph model studied by Backhausz and Móri, and Thörnblad. We prove that, with probability 1, there is a dominating colour, in the sense that, after some random but finite time, there i…
We prove a Central Limit Theorem for the sequence of random compositions of a two-color randomly reinforced urn. As a consequence, we are able to show that the distribution of the urn limit composition has no point masses.
This is a research endeavor in two parts. We study a class of balanced urn schemes on balls of two colours (say white and black). At each drawing, a sample of size $m\ge 1$ is drawn from the urn, and ball addition rules are applied. We consider these multiple drawings under sampling with or without replacement. We further classify ball addition matrices according to the structure of the expected value into affine and nonaffine classes. We give a necessary and sufficient condition for a scheme to be in the affine subclass. For the affine subclass, we get explicit results for the expected value …
We give a central limit theorem, which has applications to Bayesian statistics and urn problems. The latter are investigated, by paying special attention to multicolor randomly reinforced generalized Polya urns.
An urn contains balls of d colors. At each time, a ball is drawn and then replaced together with a random number of balls of the same color. Assuming that some colors are dominated by others, we prove central limit theorems. Some statistical applications are discussed.
In two recent works, Kuba and Mahmoud (arXiv:1503.090691 and arXiv:1509.09053) introduced the family of two-color affine balanced Polya urn schemes with multiple drawings. We show that, in large-index urns (urn index between $1/2$ and $1$) and triangular urns, the martingale tail sum for the number of balls of a given color admits both a Gaussian central limit theorem as well as a law of the iterated logarithm. The laws of the iterated logarithm are new even in the standard model when only one ball is drawn from the urn in each step (except for the classical Polya urn model). Finally, we prove…
In this paper we are concerned with a family of $N$-urn branching processes, where some particles are put into $N$ urns initially and then each particle gives birth to several new particles in some urn when dies. This model includes the $N$-urn Ehrenfest model and the $N$-urn branching random walk as special cases. We show that the scaling limit of the process is driven by a $C(\mathbb{T})$-valued linear ordinary differential equation and the fluctuation of the process is driven by a generalized Ornstein-Uhlenbeck process in the dual of $C^\infty(\mathbb{T})$, where $\mathbb{T}=(0, 1]$ is the …
We take a unified approach to central limit theorems for a class of irreducible urn models with constant replacement matrix. Depending on the eigenvalue, we consider appropriate linear combinations of the number of balls of different colors. Then under appropriate norming the multivariate distribution of the weak limits of these linear combinations is obtained and independence and dependence issues are investigated.
In this paper we are concerned with hydrodynamics of a class of $N$-urn linear systems, which include voter models, pair-symmetric exclusion processes and binary contact path processes on $N$ urns as special cases. We show that the hydrodynamic limit of our process is driven by a $\left(C[0,1]\right)^\prime$-valued linear ordinary differential equation and the fluctuation of our process, i.e, central limit theorem from the hydrodynamic limit, is driven by a $\left(C[0, 1]\right)^\prime$-valued Ornstein-Uhlenbeck process. To derive above main results, we need several replacement lemmas. An exte…
In this paper, we consider a new type of urn scheme, where the selection probabilities are proportional to a weight function, which is linear but decreasing in the proportion of existing colours. We refer to it as the \emph{negatively reinforced} urn scheme. We establish almost sure limit of the random configuration for any \emph{balanced} replacement matrix $R$. In particular, we show that the limiting configuration is uniform on the set of colours, if and only if, $R$ is a \emph{doubly stochastic} matrix. We further establish almost sure limit of the vector of colour counts and prove central…
Motivated by mathematical tissue growth modelling, we consider the problem of approximating the dynamics of multicolor Pólya urn processes that start with large numbers of balls of different colors and run for a long time. Using strong approximation theorems for empirical and quantile processes, we establish Gaussian process approximations for the Pólya urn processes. The approximating processes are sums of a multivariate Brownian motion process and an independent linear drift with a random Gaussian coefficient. Which of the two terms dominates depends on the ratio of the number of time steps …
Let X be a non-deterministic infinite exchangeable sequence with values in {0,1}. We show that X is Hoeffding-decomposable if, and only if, X is either an i.i.d. sequence or a Polya sequence. This completes the results established in Peccati [2004]. The proof uses several combinatorial implications of the correspondence between Hoeffding decomposability and weak independence. Our results must be compared with previous characterizations of i.i.d. and Polya sequences given by Hill et al. [1987] and Diaconis and Yilvisaker [1979].
We consider a variant of the randomly reinforced urn where more balls can be simultaneously drawn out and balls of different colors can be simultaneously added. More precisely, at each time-step, the conditional distribution of the number of extracted balls of a certain color given the past is assumed to be hypergeometric. We prove some central limit theorems in the sense of stable convergence and of almost sure conditional convergence, which are stronger than convergence in distribution. The proven results provide asymptotic confidence intervals for the limit proportion, whose distribution is…
We introduce a general two colour interacting urn model on a finite directed graph, where each urn at a node, reinforces all the urns in its out-neighbours according to a fixed, non-negative and balanced reinforcement matrix. We show that the fraction of balls of either colour converges almost surely to a deterministic limit if either the reinforcement is not of Pólya type or if the graph is such that every vertex with non-zero in-degree can be reached from some vertex with zero in-degree. We also obtain joint central limit theorems, with appropriate scaling, around the vector of limiting prop…
Consider an urn initially containing $b$ black and $w$ white balls. Select a ball at random and observe its color. If it is black, stop. Otherwise, return the white ball together with another white ball to the urn. Continue selecting at random, each time adding a white ball, until a black ball is selected. Let $T_{b,w}$ denote the number of draws until this happens. Surprisingly, the expectation of $T_{b,w}$ is infinite for the "fair" initial scenario $b =w=1$, but finite if $b=2$ and $w=10^9$. In fact, $\mathbb{E}[T_{b,w}]$ is finite if and only if $b\ge 2$, and the variance of $T_{b,w}$ is f…
Stochastic approximation algorithms have been the subject of an enormous body of literature, both theoretical and applied. Recently, Laruelle and Pagès (2013) presented a link between the stochastic approximation and response-adaptive designs in clinical trials based on randomized urn models investigated in Bai and Hu (1999, 2005), and derived the asymptotic normality or central limit theorem for the normalized procedure using a central limit theorem for the stochastic approximation algorithm. However, the classical central limit theorem for the stochastic approximation algorithm does not incl…
Triggered urn models for frequently asked questions (FAQ)
IMT School for Advanced Studies(IMT高等研究院);Università degli Studi di Milano-Bicocca(米兰比可卡大学);Damascus University(大马士革大学);The George Washington University(乔治华盛顿大学)
This is the second part of a two-part investigation. We continue the study of a class of balanced urn schemes on balls of two colors (white and black). At each drawing, a sample of size $m\ge 1$ is drawn from the urn and ball addition rules are applied; the special case $m=1$ of sampling only a single ball coincides with ordinary balanced urn models. We consider these multiple drawings under sampling with or without replacement. For the class of affine conditional expected value, we study the number of white balls after $n$ steps. The affine class is parametrized by $Λ$, specified by the ratio…
In this paper we are concerned with a generalized $N$-urn Ehrenfest model, where balls keeps independent random walks between $N$ boxes uniformly laid on $[0, 1]$. After a proper scaling of the transition rates function of the aforesaid random walk, we derive the hydrodynamic limit of the model, i.e., the law of large numbers which the empirical measure of the model follows, under an assumption where the initial number of balls in each box independently follows a Poisson distribution. We show that the empirical measure of the model converges weakly to a deterministic measure with density drive…
Consider a balanced non triangular two-color Pólya-Eggenberger urn process, assumed to be large which means that the ratio sigma of the replacement matrix eigenvalues satisfies 1/2<sigma <1. The composition vector of both discrete time and continuous time models admits a drift which is carried by the principal direction of the replacement matrix. In the second principal direction, this random vector admits also an almost sure asymptotics and a real-valued limit random variable arises, named WDT in discrete time and WCT in continous time. The paper deals with the distributions of both W. Appear…
We prove a Gaussian process approximation for the sequence of random compositions of a two-color randomly reinforced urn for both the cases with the equal and unequal reinforcement means. By using the Gaussian approximation, the law of the iterated logarithm and the functional limit central limit theorem in both the stable convergence sense and the almost-sure conditional convergence sense are established. Also as a consequence, we are able to to prove that the distribution of the urn composition has no points masses both when the reinforcement means are equal and unequal under the assumption …
We prove a central limit theorem applicable to one dimensional stochastic approximation algorithms that converge to a point where the error terms of the algorithm do not vanish. We show how this applies to a certain class of these algorithms that in particular covers a generalized Pólya urn model, which is also discussed. In addition, we show how to scale these algorithms in some cases where we cannot determine the limiting distribution but expect it to be non-normal.
We mathematically model the supertask, introduced by Hansen, in which an infinity of gods together select a random natural number by each randomly removing a finite number of balls from an urn, leaving one final ball. We show that this supertask is highly underdetermined, i.e. there are many scenarios consistent with the supertask. In particular we show that the notion of uniformity for finitely additive probability measures on the natural numbers emerging from this supertask is unreasonably weak.
The inductive size bias coupling technique and Stein's method yield a Berry-Esseen theorem for the number of urns having occupancy $d \ge 2$ when $n$ balls are uniformly distributed over $m$ urns. In particular, there exists a constant $C$ depending only on $d$ such that $$ \sup_{z \in \mathbb{R}}|P(W_{n,m} \le z) -P(Z \le z)| \le C \left( \frac{1+(\frac{n}{m})^3}{σ_{n,m}} \right) \quad \mbox{for all $n \ge d$ and $m \ge 2$,} $$ where $W_{n,m}$ and $σ_{n,m}^2$ are the standardized count and variance, respectively, of the number of urns with $d$ balls, and $Z$ is a standard normal random variab…