'Rich get richer' rule comforts previously often chosen actions. What is happening to the evolution of individual inclinations to choose an action when agents do interact ? Interaction tends to homogenize while each individual dynamics tends to reinforce its own position. Interacting stochastic systems of reinforced processes were recently considered in many papers, where the asymptotic behavior was proven to exhibit a.s. synchronization. We consider in this paper models where, even if interaction among agents is present, absence of synchronization may happen due to the choice of an individual non-linear reinforcement. We show how these systems can naturally be considered as models for coordination games, technological or opinion dynamics.
Randomly evolving systems composed by elements which interact among each other have always been of great interest in several scientific fields. This work deals with the synchronization phenomenon, that could be roughly defined as the tendency of different components to adopt a common behavior. We continue the study of a model of interacting stochastic processes with reinforcement, that recently has been introduced in Crimaldi et al. (2016, arXiv:1602.06217). Generally speaking, by reinforcement we mean any mechanism for which the probability that a given event occurs has an increasing dependen…
We obtain Central Limit Theorems in Functional form for a class of time-inhomogeneous interacting random walks on the simplex of probability measures over a finite set. Due to a reinforcement mechanism, the increments of the walks are correlated, forcing their convergence to the same, possibly random, limit. Random walks of this form have been introduced in the context of urn models and in stochastic approximation. We also propose an application to opinion dynamics in a random network evolving via preferential attachment. We study, in particular, random walks interacting through a mean-field r…
We consider a class of multi-particle reinforced interacting random walks. In this model, there are some (finite or infinite) particles performing random walks on a given (finite or infinite) connected graph, so that each particle has higher probability to visit neighboring vertices or edges which have been seldom visited by the other particles. Specifically we investigate two particles' vertex-reinforced interacting random walks on finite complete graphs. By a dynamical approach we prove that the two particles' occupation measure asymptotically has small joint support almost surely if the rei…
Using an approximation by a set-valued dynamical system, this paper studies a class of non Markovian and non homogeneous stochastic processes on a finite state space. It provides an unified approach to simulated annealing type processes. It permits to study new models of vertex reinforced random walks and new models of learning in games including Markovian fictitious play.
Consider a negatively drifted one dimensional Brownian motion starting at positive initial position, its first hitting time to 0 has the inverse Gaussian law. Moreover, conditionally on this hitting time, the Brownian motion up to that time has the law of a 3- dimensional Bessel bridge. In this paper, we give a generalization of this result to a family of Brownian motions with interacting drifts, indexed by the vertices of a conductance network. The hitting times are equal in law to the inverse of a random potential that appears in the analysis of a self-interacting process called the Vertex R…
We study a system of interacting reinforced random walks defined on polygons. At each stage, each particle chooses an edge to traverse which is incident to its position. We allow the probability of choosing a given edge to depend on the sum of, the number of times that particle traversed that edge, a quantity which depends on the behaviour of the other particles, and possibly external factors. We study localization properties of this system and our main tool is a new result we establish for a very general class of urn models. More specifically, we study attraction properties of urns composed o…
We propose two numerical schemes for approximating quasi-stationary distributions (QSD) of finite state Markov chains with absorbing states. Both schemes are described in terms of certain interacting chains in which the interaction is given in terms of the total time occupation measure of all particles in the system and has the impact of reinforcing transitions, in an appropriate fashion, to states where the collection of particles has spent more time. The schemes can be viewed as combining the key features of the two basic simulation-based methods for approximating QSD originating from the wo…
This work deals with a system of interacting reinforced stochastic processes, where each process $X^j=(X_{n,j})_n$ is located at a vertex $j$ of a finite weighted direct graph, and it can be interpreted as the sequence of "actions" adopted by an agent $j$ of the network. The interaction among the dynamics of these processes depends on the weighted adjacency matrix $W$ associated to the underlying graph: indeed, the probability that an agent $j$ chooses a certain action depends on its personal "inclination" $Z_{n,j}$ and on the inclinations $Z_{n,h}$, with $h\neq j$, of the other agents accordi…
We consider a system of urns of Polya-type, with balls of two colors; the reinforcement of each urn depends both on the content of the same urn and on the average content of all urns. We show that the urns synchronize almost surely, in the sense that the fraction of balls of a given color converges almost surely, as the time goes to infinity, to the same limit for all urns. A normal approximation for a large number of urns is also obtained.
We describe a model for $m$ vertex reinforced interacting random walks on complete graphs with $d\geq 2$ vertices. The transition probability of a random walk to a given vertex depends exponentially on the proportion of visits made by all walks to that vertex. The individual proportion of visits is modulated by a strength parameter that can be set equal to any real number. This model covers a large variety of interactions including different vertex repulsion and attraction strengths between any two random walks as well as self-reinforced interactions. We show that the process of empirical vert…
The models surveyed include generalized Pólya urns, reinforced random walks, interacting urn models, and continuous reinforced processes. Emphasis is on methods and results, with sketches provided of some proofs. Applications are discussed in statistics, biology, economics and a number of other areas.
This work deals with systems of interacting reinforced stochastic processes, where each process $X^j=(X_{n,j})_n$ is located at a vertex $j$ of a finite weighted direct graph, and it can be interpreted as the sequence of "actions" adopted by an agent $j$ of the network. The interaction among the evolving dynamics of these processes depends on the weighted adjacency matrix $W$ associated to the underlying graph: indeed, the probability that an agent $j$ chooses a certain action depends on its personal "inclination" $Z_{n,j}$ and on the inclinations $Z_{n,h}$, with $h\neq j$, of the other agents…
We consider a model of N two-colors urns in which the reinforcement of each urn depends also on the content of all the other urns. This interaction is of mean-field type and it is tuned by a parameter $α$ in [0,1]; in particular, for $α=0$ the N urns behave as N independent Polya's urns. As shown in [9], for $α>0$ urns synchronize, in the sense that the fraction of balls of a given color converges a.s. to the same (random) limit in all urns. In this paper we study fluctuations around this synchronized regime. The scaling of these fluctuations depends on the parameter $α$. In particular the sta…
We derive a perturbation expansion for general self-interacting random walks, where steps are made on the basis of the history of the path. Examples of models where this expansion applies are reinforced random walk, excited random walk, the true (weakly) self-avoiding walk, loop-erased random walk, and annealed random walk in random environment. In this paper we show that the expansion gives rise to useful formulae for the speed and variance of the random walk, when these quantities are known to exist. The results and formulae of this paper have been used elsewhere by the authors to prove mono…
We analyze a non-reversible mean-field jump dynamics for discrete q-valued rotators and show in particular that it exhibits synchronization. The dynamics is the mean-field analogue of the lattice dynamics investigated by the same authors in [26] which provides an example of a non-ergodic interacting particle system on the basis of a mechanism suggested by Maes and Shlosman [32]. Based on the correspondence to an underlying model of continuous rotators via a discretization transformation we show the existence of a locally attractive periodic orbit of rotating measures. We also discuss global at…
We investigate reinforced non-linear urns with interacting types, and show that where there are three interacting types there are phenomena which do not occur with two types. In a model with three types where the interactions between the types are symmetric, we show the existence of a double phase transition with three phases: as well as a phase with an almost sure limit where each of the three colours is equally represented and a phase with almost sure convergence to an asymmetric limit, which both occur with two types, there is also an intermediate phase where both symmetric and asymmetric l…
We consider a stochastic model of clock synchronization in a wireless network consisting of N sensors interacting with one dedicated accurate time server. For large N we find an estimate of the final time sychronization error for global and relative synchronization. Main results concern a behavior of the network on different time scales $t=t_N \to \infty$, $N \to \infty$. We discuss existence of phase transitions and find exact time scales on which an effective clock synchronization of the system takes place.
This paper introduces a class of stochastic models of interacting neurons with emergent dynamics similar to those seen in local cortical populations, and compares them to very simple reduced models driven by the same mean excitatory and inhibitory currents. Discrepancies in firing rates between network and reduced models were investigated, and mechanisms leading to these discrepancies were identified. Chief among them is correlations in spiking, or partial synchronization, working in concert with "nonlinearities" in the time evolution of membrane potentials. Additionally, simple random walk mo…
