The Friedman's urn model is a popular urn model which is widely used in many disciplines. In particular, it is extensively used in treatment allocation schemes in clinical trials. In this paper, we prove that both the urn composition process and the allocation proportion process can be approximated by a multi-dimensional Gaussian process almost surely for a multi-color generalized Friedman's urn model with non-homogeneous generating matrices. The Gaussian process is a solution of a stochastic differential equation. This Gaussian approximation together with the properties of the Gaussian process is important for the understanding of the behavior of the urn process and is also useful for statistical inferences. As an application, we obtain the asymptotic properties including the asymptotic normality and the law of the iterated logarithm for a multi-color generalized Friedman's urn model as well as the randomized-play-the-winner rule as a special case.
An urn contains balls of d colors. At each time, a ball is drawn and then replaced together with a random number of balls of the same color. Assuming that some colors are dominated by others, we prove central limit theorems. Some statistical applications are discussed.
We prove a Central Limit Theorem for the sequence of random compositions of a two-color randomly reinforced urn. As a consequence, we are able to show that the distribution of the urn limit composition has no point masses.
We consider a variant of the randomly reinforced urn where more balls can be simultaneously drawn out and balls of different colors can be simultaneously added. More precisely, at each time-step, the conditional distribution of the number of extracted balls of a certain color given the past is assumed to be hypergeometric. We prove some central limit theorems in the sense of stable convergence and of almost sure conditional convergence, which are stronger than convergence in distribution. The proven results provide asymptotic confidence intervals for the limit proportion, whose distribution is…
This paper illustrates asymptotic properties for a response-adaptive design generated by a two-color, randomly reinforced urn model. The design considered is optimal in the sense that it assigns patients to the best treatment, with probability converging to one. An approach to show the joint asymptotic normality of the estimators of the mean responses to the treatments is provided in spite of the fact that allocation proportions converge to zero and one. Results on the rate of convergence of the number of patients assigned to each treatment are also obtained. Finally, we study the asymptotic b…
We take a unified approach to central limit theorems for a class of irreducible urn models with constant replacement matrix. Depending on the eigenvalue, we consider appropriate linear combinations of the number of balls of different colors. Then under appropriate norming the multivariate distribution of the weak limits of these linear combinations is obtained and independence and dependence issues are investigated.
We complete the study of the model introduced in [11]. It is a two-color urn model with multiple drawing and random (non-balanced) time-dependent reinforcement matrix. The number of sampled balls at each time-step is random. We identify the exact rates at which the number of balls of each color grows to infinity and define two strongly consistent estimators for the limiting reinforcement averages. Then we prove a Central Limit Theorem, which allows to design a statistical test for such averages.
We consider an urn model with multiple drawing and random time-dependent addition matrix. The model is very general with respect to previous literature: the number of sampled balls at each time-step is random, the addition matrix has general random entries. For the proportion of balls of a given color, we prove almost sure convergence results and fluctuation theorems (through CLTs in the sense of stable convergence and of almost sure conditional convergence, which are stronger than convergence in distribution). Asymptotic confidence intervals are given for the limit proportion, whose distribut…
Though widely used in applications, reinforced random walk on graphs have never been the subject of a valid statistical inference. We develop in this paper a statistical framework for a general two-colored urn model. The probability to draw a ball at each step depends on the number of balls of each color and on a multidimensional parameter $θ$ through a function $f$, called a choice function. We introduce two estimators of $θ$: the maximum likelihood estimator and a weighted least squares estimator which is less efficient, but is closer to the calibration techniques used in the applied literat…
We consider systems of interacting Generalized Friedman's Urns (GFUs) having irreducible mean replacement matrices. The interaction is modeled through the probability to sample the colors from each urn, that is defined as convex combination of the urn proportions in the system. From the weights of these combinations we individuate subsystems of urns evolving with different behaviors. We provide a complete description of the asymptotic properties of urn proportions in each subsystem by establishing limiting proportions, convergence rates and Central Limit Theorems. The main proofs are based on …
Generalized Friedman urn is one of the simplest and most useful models considered in probability theory. Since Athreya and Ney (1972) showed the almost sure convergence of urn proportions in a randomized urn model with irreducible replacement matrix under the $L\log L$ moment assumption, this assumption has been regarded as the weakest moment assumption, but the necessary has never been shown. In this paper, we study the strong and weak convergence of generalized Friedman urns. It is proved that, when the random replacement matrix is irreducible in probability, the sufficient and necessary mom…
We prove a Gaussian process approximation for the sequence of random compositions of a two-color randomly reinforced urn for both the cases with the equal and unequal reinforcement means. By using the Gaussian approximation, the law of the iterated logarithm and the functional limit central limit theorem in both the stable convergence sense and the almost-sure conditional convergence sense are established. Also as a consequence, we are able to to prove that the distribution of the urn composition has no points masses both when the reinforcement means are equal and unequal under the assumption …
In this work we generalize Polya urn schemes with possibly infinitely many colors and extend the earlier models described in [4, 5, 7]. We provide a novel and unique approach of representing the observed sequence of colors in terms a branching Markov chain on random recursion tree. This enables us to derive fairly general asymptotic for our urn schemes. We then illustrate through several examples that our method can easily derive the classical results for finite urns, as well as, many new results for infinite color urns.
We consider a system of urns of Polya-type, with balls of two colors; the reinforcement of each urn depends both on the content of the same urn and on the average content of all urns. We show that the urns synchronize almost surely, in the sense that the fraction of balls of a given color converges almost surely, as the time goes to infinity, to the same limit for all urns. A normal approximation for a large number of urns is also obtained.
We consider the generalization of the Pólya urn scheme with possibly infinite many colors as introduced in \cite{Th-Thesis, BaTH2014, BaTh2016, BaTh2017}. For countable many colors, we prove almost sure convergence of the urn configuration under \emph{uniform ergodicity} assumption on the associated Markov chain. The proof uses a stochastic coupling of the sequence of chosen colors with a \emph{branching Markov chain} on a weighted \emph{random recursive tree} as described in \cite{BaTh2017, Sv_2018}. Using this coupling we estimate the covariance between any two selected colors. In particular…
In two recent works, Kuba and Mahmoud (arXiv:1503.090691 and arXiv:1509.09053) introduced the family of two-color affine balanced Polya urn schemes with multiple drawings. We show that, in large-index urns (urn index between $1/2$ and $1$) and triangular urns, the martingale tail sum for the number of balls of a given color admits both a Gaussian central limit theorem as well as a law of the iterated logarithm. The laws of the iterated logarithm are new even in the standard model when only one ball is drawn from the urn in each step (except for the classical Polya urn model). Finally, we prove…
The aim of this paper is to study the asymptotic behavior of strongly reinforced interacting urns with partial memory sharing. The reinforcement mechanism considered is as follows: draw at each step and for each urn a white or black ball from either all the urns combined (with probability $p$) or the urn alone (with probability $1-p$) and add a new ball of the same color to this urn. The probability of drawing a ball of a certain color is proportional to $w_k$ where $k$ is the number of balls of this color. The higher the $p$, the more memory is shared between the urns. The main results can be…
We collect, survey and develop methods of (one-dimensional) stochastic approximation in a framework that seems suitable to handle fairly broad generalizations of Polya urns. To show the applicability of the results we determine the limiting fraction of balls in an urn with balls of two colors. We consider two models generalizing the Polya urn, in the first one ball is drawn and replaced with balls of (possibly) both colors according to which color was drawn. In the second, two balls are drawn simultaneously and replaced along with balls of (possibly) both colors according to what combination o…
We study an urn model introduced in the paper of Chen and Wei, where at each discrete time step $m$ balls are drawn at random from the urn containing colors white and black. Balls are added to the urn according to the inspected colors, generalizing the well known Pólya-Eggenberger urn model, case m=1. We provide exact expressions for the expectation and the variance of the number of white balls after n draws, and determine the structure of higher moments. Moreover, we discuss extensions to more than two colors. Furthermore, we introduce and discuss a new urn model where the sampling of the m b…
This is the second part of a two-part investigation. We continue the study of a class of balanced urn schemes on balls of two colors (white and black). At each drawing, a sample of size $m\ge 1$ is drawn from the urn and ball addition rules are applied; the special case $m=1$ of sampling only a single ball coincides with ordinary balanced urn models. We consider these multiple drawings under sampling with or without replacement. For the class of affine conditional expected value, we study the number of white balls after $n$ steps. The affine class is parametrized by $Λ$, specified by the ratio…
In this work we consider the \emph{infinite color urn model} associated with a bounded increment random walk on $\Zbold^d$. This model was first introduced by Bandyopadhyay and Thacker (2013). We prove that the rate of convergence of the expected configuration of the urn at time $n$ with appropriate centering and scaling is of the order ${\mathcal O}\left(\frac{1}{\sqrt{\log n}}\right)$. Moreover we derive bounds similar to the classical Berry-Essen bound. Further we show that for the expected configuration a \emph{large deviation principle (LDP)} holds with a good rate function and speed $\lo…
We consider a version of the classical Pólya urn scheme which incorporates innovations. The space $S$ of colors is an arbitrary measurable set. After each sampling of a ball in the urn, one returns $C$ balls of the same color and additional balls of different colors given by some finite point process $ξ$ on $S$. When the number of steps goes to infinity, the empirical distribution of the colors in the urn converges to the normalized intensity measure of $ξ$, and we analyze the fluctuations. The ratio $ρ= E(C)/E(R)$ of the average number of copies to the average total number of balls returned p…
Consider an urn model where at each step one of $q$ colors is sampled according to some probability distribution and a ball of that color is placed in an urn. The distribution of assigning balls to urns may depend on the color of the ball. Collisions occur when a ball is placed in an urn which already contains a ball of different color. Equivalently, this can be viewed as sequentially coloring a complete $q$-partite graph wherein a collision corresponds to the appearance of a monochromatic edge. Using a Poisson embedding technique, the limiting distribution of the first collision time is deter…
Interacting urns with exponential reinforcement were introduced and studied in Launay (2011). As its parameter $ρ$ tends to $\iy$, this reinforcement mechanism converges to the "generalized" reinforcement, in which the probability of draw may be 0 or 1 for some of the colors, depending on the current configuration. For a single urn, the generalized reinforcement is easy to analyse. We introduce and study the generalized interacting urn model with two or more urns and two colors. Our results concern the law of the so-called non-conformist urns, and answer in the asymptotic sense one of the open…
For the plain Polya urn with two colors, black and white, we prove a functional central limit theorem for the number of white balls assuming that the initial number of black balls is large. Depending on the initial number of white balls, the limit is either a pure birth process or a diffusion. We also prove analogous results for the q-Polya urn, which is an urn where, when picking a ball, the balls of one color have priority over those of the other.
Consider an urn model whose replacement matrix is triangular, has all entries nonnegative and the row sums are all equal to one. We obtain the strong laws for the counts of balls corresponding to each color. The scalings for these laws depend on the diagonal elements of a rearranged replacement matrix. We use the strong laws obtained to study further behavior of certain three color urn models.
In this work we introduce a new type of urn model with infinite but countable many colors indexed by an appropriate infinite set. We mainly consider the indexing set of colors to be the $d$-dimensional integer lattice and consider balanced replacement schemes associated with bounded increment random walks on it. We prove central and local limit theorems for the random color of the $n$-th selected ball and show that irrespective of the null recurrent or transient behavior of the underlying random walks, the asymptotic distribution is Gaussian after appropriate centering and scaling. We show tha…
For the most general Polya urn schemes, we establish the almost sure convergence of its composition. The only requirement is that there are always enough balls of both colors, so that the extractions can be indefinitely pursued according to the specifications of the model. We also consider the method for determining the probability of fulfilling this requirement, as a function of the initial number of balls of each color.
Consider the multicolored urn model where, after every draw, balls of the different colors are added to the urn in a proportion determined by a given stochastic replacement matrix. We consider some special replacement matrices which are not irreducible. For three- and four-color urns, we derive the asymptotic behavior of linear combinations of the number of balls. In particular, we show that certain linear combinations of the balls of different colors have limiting distributions which are variance mixtures of normal distributions. We also obtain almost sure limits in certain cases in contrast …
We study a system of interacting reinforced random walks defined on polygons. At each stage, each particle chooses an edge to traverse which is incident to its position. We allow the probability of choosing a given edge to depend on the sum of, the number of times that particle traversed that edge, a quantity which depends on the behaviour of the other particles, and possibly external factors. We study localization properties of this system and our main tool is a new result we establish for a very general class of urn models. More specifically, we study attraction properties of urns composed o…
This paper introduces and analyzes a particular class of Polya urns: balls are of two colors, can only be added (the urns are said to be additive) and at every step the same constant number of balls is added, thus only the color compositions varies (the urns are said to be balanced). These properties make this class of urns ideally suited for analysis from an "analytic combinatorics" point-of-view, following in the footsteps of Flajolet-Dumas-Puyhaubert, 2006. Through an algebraic generating function to which we apply a multiple coalescing saddle-point method, we are able to give precise asymp…
We construct an independent increments Gaussian process associated to a class of multicolor urn models. The construction uses random variables from the urn model which are different from the random variables for which central limit theorems are available in the two color case.
We consider an urn model, whose replacement matrix has all entries nonnegative and is balanced, that is, has constant row sums. We obtain the rates of the counts of balls corresponding to each color for the strong laws to hold. The analysis requires a rearrangement of the colors in two steps. We first reduce the replacement matrix to a block upper triangular one, where the diagonal blocks are either irreducible or the scalar zero. The scalings for the color counts are then given inductively depending on the Perron-Frobenius eigenvalues of the irreducible diagonal blocks. In the second step of …
We study several exactly solvable Polya-Eggenberger urn models with a \emph{diminishing} character, namely, balls of a specified color, say $x$ are completely drawn after a finite number of draws. The main quantity of interest here is the number of balls left when balls of color $x$ are completely removed. We consider several diminishing urns studied previously in the literature such as the pills problem, the cannibal urns and the OK Corral problem, and derive exact and limiting distributions. Our approach is based on solving recurrences via generating functions and partial differential equati…
An urn containing specified numbers of balls of distinct ordered colors is considered. A multiple q-Polya urn model is introduced by assuming that the probability of q-drawing a ball of a specific color from the urn varies geometrically, with rate q, both with the number of drawings and the number of balls of the specific color, together with the total number of balls of the preceded colors, drawn in the previous q-drawings. Then, the joint distributions of the numbers of balls of distinct colors drawn (a) in a specific number of q-drawings and (b) until the occurrence of a specific number of …
We consider a randomized urn model with objects of finitely many colors. The replacement matrices are random, and are conditionally independent of the color chosen given the past. Further, the conditional expectations of the replacement matrices are close to an almost surely irreducible matrix. We obtain almost sure and $L^1$ convergence of the configuration vector, the proportion vector and the count vector. We show that first moment is sufficient for i.i.d.\ replacement matrices independent of past color choices. This significantly improves the similar results for urn models obtained in Athr…
Triggered urn models for frequently asked questions (FAQ)
IMT School for Advanced Studies（IMT高等研究院）；Università degli Studi di Milano-Bicocca（米兰比可卡大学）；Damascus University（大马士革大学）；The George Washington University（乔治华盛顿大学）
In this paper, we consider a multi-drawing urn model with random addition. At each discrete time step, we draw a sample of m balls. According to the composition of the drawn colors, we return the balls together with a random number of balls depending on two discrete random variables X and Y with finite means and variances. Via the stochastic approximation algorithm, we give limit theorems describing the asymptotic behavior of white balls.
Consider a generalized time-dependent Pólya urn process defined as follows. Let $d\in \mathbb{N}$ be the number of urns/colors. At each time $n$, we distribute $σ_n$ balls randomly to the $d$ urns, proportionally to $f$, where $f$ is a valid reinforcement function. We consider a general class of positive reinforcement functions $\mathcal{R}$ assuming some monotonicity and growth condition. The class $\mathcal{R}$ includes convex functions and the classical case $f(x)=x^α$, $α>1$. The novelty of the paper lies in extending stochastic approximation techniques to the $d$-dimensional case and prov…
Motivated by mathematical tissue growth modelling, we consider the problem of approximating the dynamics of multicolor Pólya urn processes that start with large numbers of balls of different colors and run for a long time. Using strong approximation theorems for empirical and quantile processes, we establish Gaussian process approximations for the Pólya urn processes. The approximating processes are sums of a multivariate Brownian motion process and an independent linear drift with a random Gaussian coefficient. Which of the two terms dominates depends on the ratio of the number of time steps …
We study a generalized Pólya urn model with two types of ball. If the drawn ball is red, it is replaced together with a black ball, but if the drawn ball is black it is replaced and a red ball is thrown out of the urn. When only black balls remain, the roles of the colors are swapped and the process restarts. We prove that the resulting Markov chain is transient but that if we throw out a ball every time the colors swap, the process is recurrent. We show that the embedded process obtained by observing the number of balls in the urn at the swapping times has a scaling limit that is essentially …
We study a new class of time inhomogeneous Pólya-type urn schemes and give optimal rates of convergence for the distribution of the properly scaled number of balls of a given color to nearly the full class of generalized gamma distributions with integer parameters, a class which includes the Rayleigh, half-normal and gamma distributions. Our main tool is Stein's method combined with characterizing the generalized gamma limiting distributions as fixed points of distributional transformations related to the equilibrium distributional transformation from renewal theory. We identify special cases …
This paper extends the link between stochastic approximation (SA) theory and randomized urn models developed in Laruelle, Pag{è}s (2013), and their applications to clinical trials introduced in Bai, HU (1999,2005) and Bai, Hu, Shen (2002). We no longer assume that the drawing rule is uniform among the balls of the urn (which contains d colors), but can be reinforced by a function f. This is a way to model risk aversion. Firstly, by considering that f is concave or convex and by reformulating the dynamics of the urn composition as an SA algorithm with remainder, we derive the a.s. convergence a…
Consider a balanced non triangular two-color Pólya-Eggenberger urn process, assumed to be large which means that the ratio sigma of the replacement matrix eigenvalues satisfies 1/2<sigma <1. The composition vector of both discrete time and continuous time models admits a drift which is carried by the principal direction of the replacement matrix. In the second principal direction, this random vector admits also an almost sure asymptotics and a real-valued limit random variable arises, named WDT in discrete time and WCT in continous time. The paper deals with the distributions of both W. Appear…
Stochastic approximation algorithm is a useful technique which has been exploited successfully in probability theory and statistics for a long time. The step sizes used in stochastic approximation are generally taken to be deterministic and same is true for the drift. However, the specific application of urn models with random replacement matrices motivates us to consider stochastic approximation in a setup where both the step sizes and the drift are random, but the sequence is uniformly bounded. The problem becomes interesting when the negligibility conditions on the errors hold only in proba…
The Pólya urn scheme is a discrete-time process concerning the addition and removal of colored balls. There is a known embedding of it in continuous-time, called the Pólya process. We deal with a generalization of this stochastic model, where the initial values and the entries of the transition matrix (corresponding to additions or removals) are not necessarily fixed integer values as in the standard Pólya process. In one of the scenarios, we even allow the entries of the matrix to be random variables. As a result, we no longer have a combinatorial model of "balls in an urn," but a broader int…
