Mesoscopic structure conditions the emergence of cooperation on social networks
Sergi Lozano, Alex Arenas, Angel Sanchez
备注：
Largely improved version, includes an artificial network model that fully confirms the explanation of the results in terms of inter- and intra-community structure
We study the evolutionary Prisoner's Dilemma on two social networks obtained from actual relational data. We find very different cooperation levels on each of them that can not be easily understood in terms of global statistical properties of both networks. We claim that the result can be understood at the mesoscopic scale, by studying the community structure of the networks. We explain the dependence of the cooperation level on the temptation parameter in terms of the internal structure of the communities and their interconnections. We then test our results on community-structured, specifically designed artificial networks, finding perfect agreement with the observations in the real networks. Our results support the conclusion that studies of evolutionary games on model networks and their interpretation in terms of global properties may not be sufficient to study specific, real social systems. In addition, the community perspective may be helpful to interpret the origin and behavior of existing networks as well as to design structures that show resilient cooperative behavior.
Predicting how cooperative behavior arises in the thermodynamic limit is one of the outstanding problems in evolutionary game theory. For two player games, cooperation is seldom the Nash equilibrium. However, in the thermodynamic limit cooperation is the natural recourse regardless of whether we are dealing with humans or animals. In this work, we use the analogy with the Ising model to predict how cooperation arises in the thermodynamic limit.
We study the problem of the emergence of cooperation in the spatial Prisoner's Dilemma. The pioneering work by Nowak and May showed that large initial populations of cooperators can survive and sustain cooperation in a square lattice with imitate-the-best evolutionary dynamics. We revisit this problem in a cost-benefit formulation suitable for a number of biological applications. We show that if a fixed-amount reward is established for cooperators to share, a single cooperator can invade a population of defectors and form structures that are resilient to re-invasion even if the reward mechanis…
According to evolutionary game theory, cooperation in public goods games is eliminated by free-riders, yet in nature, cooperation is ubiquitous. Artificial models resolve this contradiction via the mechanism of network reciprocity. However, existing research only addresses pre-existing networks and does not specifically consider their origins. Further, much work has focused on scale-free networks and so pre-supposes attachment mechanisms which may not exist in nature. We present a coevolutionary model of public goods games in networks, growing by random attachment, from small founding populati…
Understanding the emergence and sustainability of cooperation is a fundamental problem in evolutionary biology and is frequently studied by the framework of evolutionary game theory. A very powerful mechanism to promote cooperation is network reciprocity, where the interaction patterns and opportunities for strategy spread of agents are constrained to limited sets of permanent interactions partners. Cooperation survives because it is possible for close-knit communities of cooperation to be shielded from invasion by defectors. Here we show that parameter ranges in which cooperation can survive …
Evolutionary game theory is one of the key paradigms behind many scientific disciplines from science to engineering. Previous studies proposed a strategy updating mechanism, which successfully demonstrated that the scale-free network can provide a framework for the emergence of cooperation. Instead, individuals in random graphs and small-world networks do not favor cooperation under this updating rule. However, a recent empirical result shows the heterogeneous networks do not promote cooperation when humans play a Prisoner's Dilemma. In this paper, we propose a strategy updating rule with payo…
We explore the emergence of cooperation in the framework of evolutionary game theory. First we introduce the cooperation problem in a novel way that we believe it have important consequences in how problem is addressed. Then we present a minimal model for the emergence of cooperation in growing systems with cultural reproduction where topological structure and the evolution of strategies are decoupled instead a coevolution dynamic. We show that when system grows, there exists cultural reproduction and a nonzero probability that individuals take cooperation as first strategy; there are conditio…
We study in detail the role of short-cuts in promoting the emergence of cooperation in a network of agents playing the Prisoner's Dilemma Game (PDG). We introduce a model whose topology interpolates between the one-dimensional euclidean lattice (a ring) and the complete graph by changing the value of one parameter (the probability p to add a link between two nodes not already connected in the euclidean configuration). We show that there is a region of values of p in which cooperation is largely enhanced, whilst for smaller values of p only a few cooperators are present in the final state, and …
Cooperation is observed widely in nature and is thought an essential component of many evolutionary processes, yet the mechanisms by which it arises and persists are still unclear. Among several theories, network reciprocity -- a model of inhomogeneous social interactions -- has been proposed as an enabling mechanism to explain the emergence of cooperation. Existing evolutionary models of this mechanism have tended to focus on highly heterogeneous (scale-free) networks, hence typically assume preferential attachment mechanisms, and consequently the prerequisite that individuals have global net…
Emergence of cooperation: A reputation-modulated reinforcement learning
School of Physics, East China Normal University（华东师范大学物理系）；School of Physics, Ningxia University（宁夏大学物理学院）；School of Physics and Information Technology, Shaanxi Normal University（陕西师范大学物理与信息工程学院）
It is known that the small-world structure constitutes sufficient conditions to sustain cooperation and thus enhances cooperation. On the contrary, the network with a very long average distance is usually thought of as suppressing the emergence of the cooperation. In this paper we show that the fractal structure, of which the average distance is very long, does not always play a negative role in the organization of cooperation. Compared to regular networks, the fractal structure might even facilitate the emergence of cooperation. This mainly depends on the existence of locally compact clusters…
The hypothesis that living systems can benefit from operating at the vicinity of critical points has gained momentum in recent years. Criticality may confer an optimal balance between exceedingly ordered and too noisy states. We here present a model, based on information theory and statistical mechanics, illustrating how and why a community of agents aimed at understanding and communicating with each other converges to a globally coherent state in which all individuals are close to an internal critical state, i.e. at the borderline between order and disorder. We study --both analytically and c…
The evolutionary dynamics of the Public Goods game addresses the emergence of cooperation within groups of individuals. However, the Public Goods game on large populations of interconnected individuals has been usually modeled without any knowledge about their group structure. In this paper, by focusing on collaboration networks, we show that it is possible to include the mesoscopic information about the structure of the real groups by means of a bipartite graph. We compare the results with the projected (coauthor) and the original bipartite graphs and show that cooperation is enhanced by the …
Emergence of cooperation in nonlinear higher-order public goods games
Institute for Cross-disciplinary Physics and Complex Systems IFISC (CSIC-UIB)（交叉物理与复杂系统研究所）；Department of Network and Data Science, Central European University Vienna（中欧大学维也纳网络与数据科学系）；Human Evolutionary Ecology Group, Department of Evolutionary Anthropology, University of Zurich（苏黎世大学生物人类学系人类进化生态组）；Center for Networks and Complexity, Luiss University of Rome（罗马LUISS大学网络与复杂性中心）；Department of AI, Data and Decision Sciences, Luiss University of Rome（罗马LUISS大学人工智能、数据与决策科学系）
In a recent Letter [F.C. Santos and J. M. Pacheco Phys. Rev. Lett. \textbf{95}, 098104 (2005)], the scale-free networks are found to be advantageous for the emergence of cooperation. In the present work an evolutionary prisoner's dilemma game with players located on Barabási-Albert scale-free networks is studied in detail. The players are pure strategist and can follow two strategies: either to defect or to cooperate. Serval alternative update rules determining the evolution of each player's strategy are considered. Using systematic Monte Carlo simulations we have calculated the average densit…
Much research has been carried out to understand the emergence of cooperation in simulated social networks of competing individuals. Such research typically implements a population as a single connected network. Here we adopt a more realistic premise; namely that populations consist of multiple networks, whose members migrate from one to another. Specifically, we isolate the key elements of the scenario where a minority of members from a cooperative network migrate to a network populated by defectors. Using the public goods game to model group-wise cooperation, we find that under certain circu…
We consider the problem of explaining the emergence and evolution of cooperation in dynamic network-structured populations. Building on seminal work by Poncela et al, which shows how cooperation (in one-shot prisoner's dilemma) is supported in growing populations by an evolutionary preferential attachment (EPA) model, we investigate the effect of fluctuations in the population size. We find that the fluctuating model is more robust than Poncela et al's in that cooperation flourishes for a wide variety of initial conditions. In terms of both the temptation to defect, and the types of strategies…
Assessing quantitatively the state and dynamics of a social system is a very difficult problem. It is of great importance for both practical and theoretical reasons such as establishing the efficiency of social action programs, detecting possible community needs or allocating resources. In this paper we propose a new general theoretical framework for the study of social complexity, based on the relation of complexity and entropy in combination with evolutionary dynamics to asses the dynamics of the system. Imposing the second law of thermodynamics, we study the conditions under which cooperati…
We present insights and empirical results from an extensive numerical study of the evolutionary dynamics of the iterated prisoner's dilemma. Fixation probabilities for Moran processes are obtained for all pairs of 164 different strategies including classics such as TitForTat, zero determinant strategies, and many more sophisticated strategies. Players with long memories and sophisticated behaviours outperform many strategies that perform well in a two player setting. Moreover we introduce several strategies trained with evolutionary algorithms to excel at the Moran process. These strategies ar…
The evolutionary Prisoner's Dilemma Game (PDG) and the Snowdrift Game (SG) with preferential learning mechanism are studied in the Barabási-Albert network. Simulation results demonstrate that the preferential learning of individuals remarkably promotes the cooperative behavior for both two games over a wide range of payoffs. To understand the effect of preferential learning on the evolution of the systems, we investigate the time series of the cooperator density for different preferential strength and payoffs. It is found that in some specific cases two games both show the $1/f$-scaling behavi…
We study the evolution of cooperation in the prisoner's dilemma game, whereby a coevolutionary rule is introduced that molds the random topology of the interaction network in two ways. First, existing links are deleted whenever a player adopts a new strategy or its degree exceeds a threshold value, and second, new links are added randomly after a given number of game iterations. These coevolutionary processes correspond to the generic formation of new and deletion of existing links that, especially in human societies, appear frequently as a consequence of ongoing socialization, change of lifes…
By means of extensive computer simulations, the authors consider the entangled coevolution of actions and social structure in a new version of a spatial Prisoner's Dilemma model that naturally gives way to a process of social differentiation. Diverse social roles emerge from the dynamics of the system: leaders are individuals getting a large payoff who are imitated by a considerable fraction of the population, conformists are unsatisfied cooperative agents that keep cooperating, and exploiters are defectors with a payoff larger than the average one obtained by cooperators. The dynamics generat…
Game theory research on the snowdrift game has showed that gradual evolution of the continuously varying level of cooperation in joint enterprises can demonstrate evolutionary merging as well as evolutionary branching. However, little is known about the consequences of changes in diversity at the cooperation level. In the present study I consider effects of costly rewards on the continuous snowdrift game. I show that not evolutionary merging but evolutionary branching can promote the emergence of pool reward, which can then enhance social welfare.
The emergence and prevalence of cooperative behavior within a group of selfish individuals remains a puzzle for \text{evolutionary game theory} precisely because it conflicts directly with the central idea of natural selection. Accordingly, in recent years, the search for an understanding of how cooperation can be stimulated, even when it conflicts with individual interest, has intensified. We investigate the emergence of cooperation in an age-structured evolutionary spatial game. In it, players age with time and the payoff that they receive after each round \text{depends on} their age. \text{…
We outline a model to study the evolution of cooperation in a population of agents playing the prisoner's dilemma in signed networks. We highlight that if only dyadic interactions are taken into account, cooperation never evolves. However, when triadic considerations are introduced, a window of opportunity for emergence of cooperation as a stable behaviour emerges.
Models of cooperation grounded on social networks and on the ability of individuals to choose actions and partners aim to describe human social behavior. Extensive computer simulations of these models give important insight in the social mechanisms behind emerging collective behavior. We consider the entangled co-evolution of actions and social structure in a new version of a spatial Prisoner's Dilemma model that naturally gives way to a process of social differentiation. Diverse social roles emerge from the dynamics of the system: leaders -individuals getting a large payoff who are imitated b…
The emergence and promotion of cooperation are two of the main issues in evolutionary game theory, as cooperation is amenable to exploitation by defectors, which take advantage of cooperative individuals at no cost, dooming them to extinction. It has been recently shown that the existence of purely destructive agents (termed jokers) acting on the common enterprises (public goods games) can induce stable limit cycles among cooperation, defection, and destruction when infinite populations are considered. These cycles allow for time lapses in which cooperators represent a relevant fraction of the…
The emergence of cooperation among self-interested agents has been a key concern of the multi-agent systems community for decades. With the increased importance of network-mediated interaction, researchers have shifted the attention on the impact of social networks and their dynamics in promoting or hindering cooperation, drawing various context-dependent conclusions. For example, some lines of research, theoretical and experimental, suggest the existence of a threshold effect in the ratio of timescales of network evolution, after which cooperation will emerge, whereas other lines dispute this…
Peer punishment of free-riders (defectors) is a key mechanism for promoting cooperation in society. However, it is highly unstable since some cooperators may contribute to a common project but refuse to punish defectors. Centralized sanctioning institutions (for example, tax-funded police and criminal courts) can solve this problem by punishing both defectors and cooperators who refuse to punish. These institutions have been shown to emerge naturally through social learning and then displace all other forms of punishment, including peer punishment. However, this result provokes a number of que…
Social structure affects the emergence and maintenance of cooperation. Here we study the evolutionary dynamics of cooperation in fragmented societies, and show that conjoining segregated cooperation-inhibiting groups, if done properly, rescues the fate of collective cooperation. We highlight the essential role of inter-group ties, that sew the patches of the social network together and facilitate cooperation. We point out several examples of this phenomenon in actual settings. We explore random and non-random graphs, as well as empirical networks. In many cases we find a marked reduction of th…
In explaining altruistic cooperation and punishment, the challenging riddle is how transcendental rules can emerge within the empirical world. Game-theoretical studies showed that pool punishment, particularly second-order punishment, plays a key role in understanding the evolution of cooperation. Second-order pool punishment, however, is tautological in nature; the punishment system itself is caused by its own effects. The emergence of pool punishment poses a logical conundrum that, to date, has been overlooked in the study of the evolution of social norms and institutions. Here, we tackle th…
We study the problem of the emergence of cooperation in dynamic signed networks where agent strategies coevolve with relational signs and network topology. Running simulations based on an agent-based model, we compare results obtained in a regular lattice initialization with those obtained on a comparable random network initialization. We show that the increased degree heterogeneity at the outset enlarges the parametric conditions in which cooperation survives in the long run. Furthermore, we show how the presence of sign-dependent emotional strategies catalyze the evolution of cooperation wit…
We compare the likelihood of different socially relevant features to allow the evolutionary emergence and maintenance of cooperation in a generalized variant of the iterated Prisoners Dilemma game. Results show that the average costs/benefit balance of cooperation is the primary constraint for its establishment and maintenance. Behavior increasing inclusive fitness such as assortation, homophily, kin-selection and tagging of individuals, is second in importance. Networks characteristics were the least important in favoring the establishment and maintenance of cooperation, despite being the mos…
We study an evolutionary spatial prisoner's dilemma game where the fitness of the players is determined by both the payoffs from the current interaction and their history. We consider the situation where the selection timescale is slower than the interaction timescale. This is done by implementing probabilistic reproduction on an individual level. We observe that both too fast and too slow reproduction rates hamper the emergence of cooperation. In other words, there exists an intermediate selection timescale that maximizes cooperation. Another factor we find to promote cooperation is a diversi…
The network reciprocity is an important dynamic rule fostering the emergence of cooperation among selfish individuals. This was reported firstly in the seminal work of Nowak and May, where individuals were arranged on the regular lattice network, and played the prisoner's dilemma game (PDG). In the standard PDG, one often assumes that the players have perfect rationality. However, in reality, we human are far from rational agents, as we often make mistakes, and behave irrationally. Accordingly, in this work, we introduce the element of noise into the measurement of fitness, which is determined…
In the evolutionary Prisoner's Dilemma (PD) game, agents play with each other and update their strategies in every generation according to some microscopic dynamical rule. In its spatial version, agents do not play with every other but, instead, interact only with their neighbors, thus mimicking the existing of a social or contact network that defines who interacts with whom. In this work, we explore evolutionary, spatial PD systems consisting of two types of agents, each with a certain update (reproduction, learning) rule. We investigate two different scenarios: in the first case, update rule…
In this Brief Report we study the evolutionary dynamics of the Public Goods Game in a population of mobile agents embedded in a 2-dimensional space. In this framework, the backbone of interactions between agents changes in time, allowing us to study the impact that mobility has on the emergence of cooperation in structured populations. We compare our results with a static case in which agents interact on top of a Random Geometric Graph. Our results point out that a low degree of mobility enhances the onset of cooperation in the system while a moderate velocity favors the fixation of the full-c…
In this manuscript we explore the onset of cooperative traits in the Public Goods game. This well-known game involves N-agent interactions and thus reproduces a large number of social scenarios in which cooperation appears to be essential. Many studies have recently addressed how the structure of the interaction patterns influences the emergence of cooperation. Here we study how information about the payoffs collected by each individual in the different groups it participates in, influences the decisions made by its group partners. Our results point out that cross-information plays a fundament…
In many social dilemmas, individuals tend to generate a situation with low payoffs instead of a system optimum ("tragedy of the commons"). Is the routing of traffic a similar problem? In order to address this question, we present experimental results on humans playing a route choice game in a computer laboratory, which allow one to study decision behavior in repeated games beyond the Prisoner's Dilemma. We will focus on whether individuals manage to find a cooperative and fair solution compatible with the system-optimal road usage. We find that individuals tend towards a user equilibrium with …
The effects of networking on the extent of cooperation emerging in a competitive setting are studied. The evolutionary snowdrift game, which represents a realistic alternative to the well-known Prisoner's Dilemma, is studied in the Watts-Strogatz network that spans the regular, small-world, and random networks through random re-wiring. Over a wide range of payoffs, a re-wired network is found to suppress cooperation when compared with a well-mixed or fully connected system. Two extinction payoffs, that characterize the emergence of a homogeneous steady state, are identified. It is found that, …
Large-scale cooperation underpins the evolution of ecosystems and the human society, and the collective behaviors by self-organization of multi-agent systems are the key for understanding. As artificial intelligence (AI) prevails in almost all branches of science, it would be of great interest to see what new insights of collective behavior could be obtained from a multi-agent AI system. Here, we introduce a typical reinforcement learning (RL) algorithm -- Q learning into evolutionary game dynamics, where agents pursue optimal action on the basis of the introspectiveness rather than the birth-…
We address the issue of the effects of considering a network of contacts on the emergence of cooperation on social dilemmas under myopic best response dynamics. We begin by summarizing the main features observed under less intellectually demanding dynamics, pointing out their most relevant general characteristics. Subsequently we focus on the new framework of best response. By means of an extensive numerical simulation program we show that, contrary to the rest of dynamics considered so far, best response is largely unaffected by the underlying network, which implies that, in most cases, no pr…
We study the evolutionary Prisoner's Dilemma game on scale-free networks for different initial distributions. We consider three types of initial distributions for cooperators and defectors: initially random distribution with different frequencies of defectors; intentional organization with defectors initially occupying the most connected nodes with different fractions of defectors; intentional assignment for cooperators occupying the most connected nodes with different proportions of defectors at the beginning. It is shown that initial configurations for cooperators and defectors can influence…
We propose to reformulate the payoff matrix structure of Prisoner's Dilemma Game, by introducing threat and greed factors, and show their effect on the co-evolution of memory and cooperation. Our findings are as follows. (i) Memory protects cooperation. (ii) To our surprise, greater memory size is unfavorable to evolutionary success when there is no threat. In the absence of threat, subsequent generations lose their memory and are consequently invaded by defectors. (iii) In contrast, the presence of an appropriate level of threat triggers the emergence of a self-protection mechanism for cooper…
Cooperation is crucial for the remarkable evolutionary success of the human species. Not surprisingly, some individuals are willing to bare additional costs in order to punish defectors. Current models assume that, once set, the fine and cost of punishment do not change over time. Here we show that relaxing this assumption by allowing players to adapt their sanctioning efforts in dependence on the success of cooperation can explain both, the spontaneous emergence of punishment, as well as its ability to deter defectors and those unwilling to punish them with globally negligible investments. By…
