We collect, survey and develop methods of (one-dimensional) stochastic approximation in a framework that seems suitable to handle fairly broad generalizations of Polya urns. To show the applicability of the results we determine the limiting fraction of balls in an urn with balls of two colors. We consider two models generalizing the Polya urn, in the first one ball is drawn and replaced with balls of (possibly) both colors according to which color was drawn. In the second, two balls are drawn simultaneously and replaced along with balls of (possibly) both colors according to what combination of colors were drawn.
For the plain Polya urn with two colors, black and white, we prove a functional central limit theorem for the number of white balls assuming that the initial number of black balls is large. Depending on the initial number of white balls, the limit is either a pure birth process or a diffusion. We also prove analogous results for the q-Polya urn, which is an urn where, when picking a ball, the balls of one color have priority over those of the other.
The present paper aims at describing in details the asymptotic composition of a class of d-colour Pólya urn: namely balanced, tenable and irreducible urns. We decompose the composition vector of such urns according to the Jordan decomposition of their replacement matrix. The projections of the composition vector onto the so-called small Jordan spaces are known to be asymptotically gaussian, but the asymptotic behaviour of the projections onto the large Jordan spaces are not known in full details up to now and are discribed by a limiting random variables called W, depending on the parameters of…
Consider a generalized time-dependent Pólya urn process defined as follows. Let $d\in \mathbb{N}$ be the number of urns/colors. At each time $n$, we distribute $σ_n$ balls randomly to the $d$ urns, proportionally to $f$, where $f$ is a valid reinforcement function. We consider a general class of positive reinforcement functions $\mathcal{R}$ assuming some monotonicity and growth condition. The class $\mathcal{R}$ includes convex functions and the classical case $f(x)=x^α$, $α>1$. The novelty of the paper lies in extending stochastic approximation techniques to the $d$-dimensional case and prov…
We consider a version of the classical Pólya urn scheme which incorporates innovations. The space $S$ of colors is an arbitrary measurable set. After each sampling of a ball in the urn, one returns $C$ balls of the same color and additional balls of different colors given by some finite point process $ξ$ on $S$. When the number of steps goes to infinity, the empirical distribution of the colors in the urn converges to the normalized intensity measure of $ξ$, and we analyze the fluctuations. The ratio $ρ= E(C)/E(R)$ of the average number of copies to the average total number of balls returned p…
Extension of results on generalized Pólya's urns for polynomially self-repelling walks
Baruch College（巴鲁克学院）；Institut de Recherche Mathématique Avancée, UMR 7501 Université de Strasbourg et CNRS（斯特拉斯堡大学与法国国家科学研究中心联合数学前沿研究所）；École Polytechnique Fédérale de Lausanne（洛桑联邦理工学院）；Purdue University（普渡大学）
Consider a Pólya urn with balls of several colours, where balls are drawn sequentially and each drawn ball immediately is replaced together with a fixed number of balls of the same colour. It is well-known that the proportions of balls of the different colours converge in distribution to a Dirichlet distribution. We show that the rate of convergence is $Θ(1/n)$ in the minimal $L_p$ metric for any $p\in[1,\infty]$, extending a result by Goldstein and Reinert; we further show the same rate for the Lévy distance, while the rate for the Kolmogorov distance depends on the parameters, i.e., on the i…
A competition process is a continuous time Markov chain that can be interpreted as a system of interacting birth-and-death processes, the components of which evolve subject to a competitive interaction. This paper is devoted to the study of the long-term behaviour of such a competition process, where a component of the process increases with a linear birth rate and decreases with a rate given by a linear function of other components. A zero is an absorbing state for each component, that is, when a component becomes zero, it stays zero forever (and we say that this component becomes extinct). W…
We study the number of white balls in a classical Pólya urn model with the additional feature that, at random times, a black ball is added to the urn. The number of draws between these random times are i.i.d. and, under certain moment conditions on the inter-arrival distribution, we characterize the limiting distribution of the (properly scaled) number of white balls as the number of draws goes to infinity. The possible limiting distributions obtained in this way vary considerably depending on the inter-arrival distribution and are difficult to describe explicitly. However, we show that the li…
This paper is devoted to a direct martingale approach for P{ó}lya urn models asymptotic behaviour. A P{ó}lya process is said to be small when the ratio of its remplacement matrix eigenvalues is less than or equal to 1/2, otherwise it is called large. We find again some well-known results on the asymptotic behaviour for small and large urns processes. We also provide new almost sure properties for small urns processes.
Pólya urns are urns where at each unit of time a ball is drawn and replaced with some other balls according to its colour. We introduce a more general model: the replacement rule depends on the colour of the drawn ball and the value of the time ($\operatorname{mod} p$). We extend the work of Flajolet et al. on Pólya urns: the generating function encoding the evolution of the urn is studied by methods of analytic combinatorics. We show that the initial partial differential equations lead to ordinary linear differential equations which are related to hypergeometric functions (giving the exact st…
We consider, as proposed and studied in Hofstad et.\ al.\ \cite{HHKR}, a class of graph-based "interacting urn"-type Polya urn model inspired by neuronal processing in the brain where a signal enters the brain at some (randomly) chosen neuron and is transmitted to a (random) single neighbouring neuron with a probability depending on the relative `efficiency' of the synapses connecting the neurons, and in doing so the efficiency of the utilized synapse is improved/reinforced. We study the structures (or architectures) and relative efficiency of the neuronal networks that can arise from repeatin…
In this work we generalize Polya urn schemes with possibly infinitely many colors and extend the earlier models described in [4, 5, 7]. We provide a novel and unique approach of representing the observed sequence of colors in terms a branching Markov chain on random recursion tree. This enables us to derive fairly general asymptotic for our urn schemes. We then illustrate through several examples that our method can easily derive the classical results for finite urns, as well as, many new results for infinite color urns.
We introduce a general two colour interacting urn model on a finite directed graph, where each urn at a node, reinforces all the urns in its out-neighbours according to a fixed, non-negative and balanced reinforcement matrix. We show that the fraction of balls of either colour converges almost surely to a deterministic limit if either the reinforcement is not of Pólya type or if the graph is such that every vertex with non-zero in-degree can be reached from some vertex with zero in-degree. We also obtain joint central limit theorems, with appropriate scaling, around the vector of limiting prop…
In this paper, we explain the connection between the Elephant Random Walk (ERW) and an urn model à la Pólya and derive functional limit theorems for the former. The ERW model was introduced by Schütz and Trimper [2004] to study memory effects in a one-dimensional discrete-time random walk with a complete memory of its past. The influence of the memory is measured in terms of a parameter $p$ between zero and one. In the past years, a considerable effort has been undertaken to understand the large-scale behavior of the ERW, depending on the choice of $p$. Here, we use known results on urns to ex…
In this paper, we prove functional limit theorems for Pólya urn processes whose number of draws and initial number of balls tend to infinity together. This is motivated by recent work of Borovkov [5], where they prove a functional limit theorem for this model when the urn has identity replacement rule. We generalize this result to arbitrary balanced replacement rules (the total number of balls added to the urn is deterministic). Three asymptotic regimes are possible depending on how one lets the number of initial balls scale with the number of draws of the urn. In each regime, we show a first …
We introduce a class of birth-and-death Polya urns, which allow for both sampling and removal of observations governed by an auxiliary inhomogeneous Bernoulli process, and investigate the asymptotic behaviour of the induced allelic partitions. By exploiting some embedded models, we show that the asymptotic regimes exhibit a phase transition from partitions with almost surely infinitely many blocks and independent counts, to stationary partitions with a random number of blocks. The first regime corresponds to limits of Ewens-type partitions and includes a result of Arratia, Barbour and Tavaré (…
A classical Pólya urn scheme is a Markov process whose evolution is encoded by a replacement matrix $(R_{i,j})_{1\leq i,j\leq d}$. At every discrete time-step, we draw a ball uniformly at random, denote its colour $c$, and replace it in the urn together with $R_{c,j}$ balls of colour $j$ (for all $1\leq j\leq d$). We are interested in multi-drawing Pólya urns, where the replacement rule depends on the random drawing of a set of $m$ balls from the urn (with or without replacement). This generalisation has already been studied in the literature, in particular by Kuba & Mahmoud (ArXiv:1503.09069 …
P{ó}lya urns are urns where at each unit of time a ball is drawn and is replaced with some other balls according to its colour. We introduce a more general model: The replacement rule depends on the colour of the drawn ball and the value of the time (mod p). We discuss some intriguing properties of the differential operators associated to the generating functions encoding the evolution of these urns. The initial partial differential equation indeed leads to ordinary linear differential equations and we prove that the moment generating functions are D-finite. For a subclass, we exhibit a closed…
We consider the generalization of the Pólya urn scheme with possibly infinite many colors as introduced in \cite{Th-Thesis, BaTH2014, BaTh2016, BaTh2017}. For countable many colors, we prove almost sure convergence of the urn configuration under \emph{uniform ergodicity} assumption on the associated Markov chain. The proof uses a stochastic coupling of the sequence of chosen colors with a \emph{branching Markov chain} on a weighted \emph{random recursive tree} as described in \cite{BaTh2017, Sv_2018}. Using this coupling we estimate the covariance between any two selected colors. In particular…
In two recent works, Kuba and Mahmoud (arXiv:1503.090691 and arXiv:1509.09053) introduced the family of two-color affine balanced Polya urn schemes with multiple drawings. We show that, in large-index urns (urn index between $1/2$ and $1$) and triangular urns, the martingale tail sum for the number of balls of a given color admits both a Gaussian central limit theorem as well as a law of the iterated logarithm. The laws of the iterated logarithm are new even in the standard model when only one ball is drawn from the urn in each step (except for the classical Polya urn model). Finally, we prove…
We consider a system of urns of Polya-type, with balls of two colors; the reinforcement of each urn depends both on the content of the same urn and on the average content of all urns. We show that the urns synchronize almost surely, in the sense that the fraction of balls of a given color converges almost surely, as the time goes to infinity, to the same limit for all urns. A normal approximation for a large number of urns is also obtained.
We study a new class of time inhomogeneous Pólya-type urn schemes and give optimal rates of convergence for the distribution of the properly scaled number of balls of a given color to nearly the full class of generalized gamma distributions with integer parameters, a class which includes the Rayleigh, half-normal and gamma distributions. Our main tool is Stein's method combined with characterizing the generalized gamma limiting distributions as fixed points of distributional transformations related to the equilibrium distributional transformation from renewal theory. We identify special cases …
Our main result is to prove almost-sure convergence of a stochastic-approximation algorithm defined on the space of measures on a non-compact space. Our motivation is to apply this result to measure-valued Pólya processes (MVPPs, also known as infinitely-many Pólya urns). Our main idea is to use Foster-Lyapunov type criteria in a novel way to generalize stochastic-approximation methods to measure-valued Markov processes with a non-compact underlying space, overcoming in a fairly general context one of the major difficulties of existing studies on this subject. From the MVPPs point of view, our…
We consider systems of interacting Generalized Friedman's Urns (GFUs) having irreducible mean replacement matrices. The interaction is modeled through the probability to sample the colors from each urn, that is defined as convex combination of the urn proportions in the system. From the weights of these combinations we individuate subsystems of urns evolving with different behaviors. We provide a complete description of the asymptotic properties of urn proportions in each subsystem by establishing limiting proportions, convergence rates and Central Limit Theorems. The main proofs are based on …
We study several exactly solvable Polya-Eggenberger urn models with a \emph{diminishing} character, namely, balls of a specified color, say $x$ are completely drawn after a finite number of draws. The main quantity of interest here is the number of balls left when balls of color $x$ are completely removed. We consider several diminishing urns studied previously in the literature such as the pills problem, the cannibal urns and the OK Corral problem, and derive exact and limiting distributions. Our approach is based on solving recurrences via generating functions and partial differential equati…
In [arXiv:1906.10951 (forthcoming on Advances in Applied Probability),arXiv:2011.05933 (published on PLOS ONE)] the authors introduce, study and apply a new variant of the Eggenberger-Polya urn, called the "Rescaled" Polya urn, which, for a suitable choice of the model parameters, is characterized by the following features: (i) a "local" reinforcement, i.e. a reinforcement mechanism mainly based on the last observations, (ii) a random persistent fluctuation of the predictive mean, and (iii) a long-term almost sure convergence of the empirical mean to a deterministic limit, together with a chi-…
The stochastic models investigated in this paper describe the evolution of a set of $F_N$ identical balls scattered into $N$ urns connected by an underlying symmetrical graph with constant degree $h_N$. After some random amount of time {\em all the balls} of any urn are redistributed locally, among the $h_N$ urns of its neighborhood. The allocation of balls is done at random according to a set of weights which depend on the state of the system. The main original features of this context is that the cardinality $h_N$ of the range of interaction is not necessarily linear with respect to $N$ as i…
The Pólya urn scheme is a discrete-time process concerning the addition and removal of colored balls. There is a known embedding of it in continuous-time, called the Pólya process. We deal with a generalization of this stochastic model, where the initial values and the entries of the transition matrix (corresponding to additions or removals) are not necessarily fixed integer values as in the standard Pólya process. In one of the scenarios, we even allow the entries of the matrix to be random variables. As a result, we no longer have a combinatorial model of "balls in an urn," but a broader int…
In this paper, we consider a new type of urn scheme, where the selection probabilities are proportional to a weight function, which is linear but decreasing in the proportion of existing colours. We refer to it as the \emph{negatively reinforced} urn scheme. We establish almost sure limit of the random configuration for any \emph{balanced} replacement matrix $R$. In particular, we show that the limiting configuration is uniform on the set of colours, if and only if, $R$ is a \emph{doubly stochastic} matrix. We further establish almost sure limit of the vector of colour counts and prove central…
In this article we establish central limit theorems for multilevel Polyak-Ruppert averaged stochastic approximation schemes. We work under very mild technical assumptions and consider the slow regime in wich typical errors decay like $N^{-δ}$ with $δ\in(0,\frac 12)$ and the critical regime in which errors decay of order $N^{-1/2}\sqrt{\log N}$ in the runtime $N$ of the algorithm.
