Classical studies on aspiration-based dynamics suggest that a dissatisfied individual changes strategy without taking into account the success of others. This promotes defection spreading. The imitation-based dynamics allow individuals to imitate successful strategies without taking into account their own-satisfactions. In this article, we propose to study a dynamic based on aspiration which takes into account imitation of successful strategies for dissatisfied individuals. This helps cooperative members to resist. Individuals compare their success to their desired satisfaction level before making a decision to update their strategies. This mechanism helps individuals with a minimum of self-satisfaction to maintain their strategies. If an individual is dissatisfied, it will learn from others by choosing successful strategies. We derive an exact expression of the fixation probability in well-mixed populations as in structured populations in networks. As a result, we show that selection may favor cooperation more than defection in well-mixed populations as in populations ranged over a regular graph. We show that the best scenario is a graph with small connectivity.
Evolutionary game theory has been widely used to study the evolution of cooperation in social dilemmas where imitation-led strategy updates are typically assumed. However, results of recent behavioral experiments are not compatible with the predictions based on the imitation dynamics, casting doubts on the assumption of the imitation-led updates and calling for alternative mechanisms of strategy updates. An aspiration-led update is often considered as an alternative to the imitation-led one. While details of update rules can have significant impacts on the evolutionary outcomes and many variat…
Repeated interaction between individuals is the main mechanism for maintaining cooperation in social dilemma situations. Variants of tit-for-tat (repeating the previous action of the opponent) and the win-stay lose-shift strategy are known as strong competitors in iterated social dilemma games. On the other hand, real repeated interaction generally allows plasticity (i.e., learning) of individuals based on the experience of the past. Although plasticity is relevant to various biological phenomena, its role in repeated social dilemma games is relatively unexplored. In particular, if experience-…
To be the fittest is central to proliferation in evolutionary games. Individuals thus adopt the strategies of better performing players in the hope of successful reproduction. In structured populations the array of those that are eligible to act as strategy sources is bounded to the immediate neighbors of each individual. But which one of these strategy sources should potentially be copied? Previous research dealt with this question either by selecting the fittest or by selecting one player uniformly at random. Here we introduce a parameter $u$ that interpolates between these two extreme optio…
The emergence and maintenance of cooperation has attracted intensive scholarly interest and has been analysed within the framework of evolutionary game theory. The role of innovation, which introduces novel strategies into the population, is a relatively understudied aspect of evolutionary game theory. Here, we investigate the effects of two sources of innovation---mutation and heterogeneous updating rules. These mechanisms allow agents to adopt strategies that do not rely on the imitation of other individuals. The model introduces---in addition to canonical imitation-based strategy updating--…
Humans and other animals can adapt their social behavior in response to environmental cues including the feedback obtained through experience. Nevertheless, the effects of the experience-based learning of players in evolution and maintenance of cooperation in social dilemma games remain relatively unclear. Some previous literature showed that mutual cooperation of learning players is difficult or requires a sophisticated learning model. In the context of the iterated Prisoner's Dilemma, we numerically examine the performance of a reinforcement learning model. Our model modifies those of Karand…
Migration is a fundamental trait in humans and animals. Recent studies investigated the effect of migration on the evolution of cooperation, showing that contingent migration favors cooperation in spatial structures. In those studies, only local migration to immediate neighbors was considered, while long-range migration has not been considered yet, partly because the long-range migration has been generally regarded as harmful for cooperation as it would bring the population to a well-mixed state that favors defection. Here, we studied the effects of adaptive long-range migration on the evoluti…
Cooperation is ubiquitous in nature, but explaining its existence remains a central interdisciplinary challenge. Cooperation is most difficult to explain in the Prisoner's Dilemma game, where cooperators always lose in direct competition with defectors despite increasing mean fitness. Here we demonstrate how spatial population expansion, a widespread natural phenomenon, promotes the evolution of cooperation. We engineer an experimental Prisoner's Dilemma game in the budding yeast Saccharomyces cerevisiae to show that, despite losing to defectors in nonexpanding conditions, cooperators increase…
Understanding the emergence and sustainability of cooperation is a fundamental problem in evolutionary biology and is frequently studied by the framework of evolutionary game theory. A very powerful mechanism to promote cooperation is network reciprocity, where the interaction patterns and opportunities for strategy spread of agents are constrained to limited sets of permanent interactions partners. Cooperation survives because it is possible for close-knit communities of cooperation to be shielded from invasion by defectors. Here we show that parameter ranges in which cooperation can survive …
Complex social behaviors lie at the heart of many of the challenges facing evolutionary biology, sociology, economics, and beyond. For evolutionary biologists in particular the question is often how such behaviors can arise \textit{de novo} in a simple evolving system. How can group behaviors such as collective action, or decision making that accounts for memories of past experience, emerge and persist? Evolutionary game theory provides a framework for formalizing these questions and admitting them to rigorous study. Here we develop such a framework to study the evolution of sustained collecti…
The public goods game is one of the most famous models for studying the evolution of cooperation in sizable groups. The multiplication factor in this game can characterize the investment return from the public good, which may be variable depending on the interactive environment in realistic situations. Instead of using the same universal value, here we consider that the multiplication factor in each group is updated based on the differences between the local and global interactive environments in the spatial public goods game, but meanwhile limited to within a certain range. We find that the a…
In the study of the evolution of cooperation, resource limitations are usually assumed just to provide a finite population size. Recently, however, it has been pointed out that resource limitation may also generate dynamical payoffs able to modify the original structure of the games. Here we study analytically a phase transition from a homogeneous population of defectors when resources are abundant to the survival of unconditional cooperators when resources reduce below a threshold. To this end, we introduce a model of simple agents, with no memory or ability of recognition, interacting in wel…
Established already in the Biblical times, the Matthew effect stands for the fact that in societies rich tend to get richer and the potent even more powerful. Here we investigate a game theoretical model describing the evolution of cooperation on structured populations where the distribution of public goods is driven by the reproductive success of individuals. Phase diagrams reveal that cooperation is promoted irrespective of the uncertainty by strategy adoptions and the type of interaction graph, yet the complete dominance of cooperators is elusive due to the spontaneous emergence of super-pe…
Evolutionary games are studied where the teaching activity of players can evolve in time. Initially all players following either the cooperative or defecting strategy are distributed on a square lattice. The rate of strategy adoption is determined by the payoff difference and a teaching activity characterizing the donor's capability to enforce its strategy on the opponent. Each successful strategy adoption process is accompanied with an increase in the donor's teaching activity. By applying an optimum value of the increment this simple mechanism spontaneously creates relevant inhomogeneities i…
In a world of hardening borders, nations may deprive themselves of enjoying the benefits of cooperative immigrants. Here, we analyze the effect of efficient cooperative immigrants on a population playing public goods games. We considered a population structured on a square lattice with individuals playing public goods games with their neighbors. The demographics are determined by stochastic birth, death, and migration. The strategies spread through imitation dynamics. Our model shows that cooperation among natives can emerge due to social contagion of good role-model agents that can provide be…
Social hierarchy is important that can not be ignored in human socioeconomic activities and in the animal world. Here we incorporate this factor into the evolutionary game to see what impact it could have on the cooperation outcome. The probabilistic strategy adoption between two players is then not only determined by their payoffs, but also by their hierarchy difference -- players in the high rank are more likely to reproduce their strategies than the peers in the low rank. Through simulating the evolution of Prisoners' dilemma game with three hierarchical distributions, we find that the leve…
Whether or not to change strategy depends not only on the personal success of each individual, but also on the success of others. Using this as motivation, we study the evolution of cooperation in games that describe social dilemmas, where the propensity to adopt a different strategy depends both on individual fitness as well as on the strategies of neighbors. Regardless of whether the evolutionary process is governed by pairwise or group interactions, we show that plugging into the "wisdom of groups" strongly promotes cooperative behavior. The more the wider knowledge is taken into account th…
ETH Zürich（苏黎世联邦理工学院）；Complexity Science Hub Vienna（维也纳复杂性科学中心）；University of Maribor（马里博尔大学）；China Medical University Hospital, China Medical University（中国医药大学附设医院，中国医药大学）；Alma Mater Europaea（欧洲母校大学）
In a non-sustainable, "over-populated" world, what might the use of nanotechnology-based targeted, autonomous weapons mean for the future of humanity? In order to gain some insights, we make a simplified game-theoretical thought experiment. We consider a population where agents play the public goods game, and where in parallel an epidemic unfolds. Agents that are infected defectors are killed with a certain probability and replaced by susceptible cooperators. We show that such "nanowars", even if aiming to promote good behavior and planetary health, fail not only to promote cooperation, but th…
Previous research has highlighted the importance of strong heterogeneity for the successful evolution of cooperation in games governed by pairwise interactions. Here we determine to what extent this is true for games governed by group interactions. We therefore study the evolution of cooperation in the public goods game on the square lattice, the triangular lattice and the random regular graph, whereby the payoffs are distributed either uniformly or exponentially amongst the players by assigning to them individual scaling factors that determine the share of the public good they will receive. W…
Cooperation is ubiquitous in biological and social systems. Previous studies revealed that a preference toward similar appearance promotes cooperation, a phenomenon called tag-mediated cooperation or communitarian cooperation. This effect is enhanced when a spatial structure is incorporated, because space allows agents sharing an identical tag to regroup to form locally cooperative clusters. In spatially distributed settings, one can also consider migration of organisms, which has a potential to further promote evolution of cooperation by facilitating spatial clustering. However, it has not ye…
In times of plenty expectations rise, just as in times of crisis they fall. This can be mathematically described as a Win-Stay-Lose-Shift strategy with dynamic aspiration levels, where individuals aspire to be as wealthy as their average neighbor. Here we investigate this model in the realm of evolutionary social dilemmas on the square lattice and scale-free networks. By using the master equation and Monte Carlo simulations, we find that cooperators coexist with defectors in the whole phase diagram, even at high temptations to defect. We study the microscopic mechanism that is responsible for …
Cooperation is fundamental to the evolution of human society. We regularly observe cooperative behaviour in everyday life and in controlled experiments with anonymous people, even though standard economic models predict that they should deviate from the collective interest and act so as to maximise their own individual payoff. However, there is typically heterogeneity across subjects: some may cooperate, while others may not. Since individual factors promoting cooperation could be used by institutions to indirectly prime cooperation, this heterogeneity raises the important question of who thes…
Rewarding cooperation is in many ways expected behaviour from social players. However, strategies that promote antisocial behaviour are also surprisingly common, not just in human societies, but also among eusocial insects and bacteria. Examples include sanctioning of individuals who behave prosocially, or rewarding of freeriders who do not contribute to collective enterprises. We therefore study the public goods game with antisocial and prosocial pool rewarding in order to determine the potential negative consequences on the effectiveness of positive incentives to promote cooperation. Contrar…
Evolution of cooperation in the prisoner's dilemma and the public goods game is studied, where initially players belong to two independent structured populations. Simultaneously with the strategy evolution, players whose current utility exceeds a threshold are rewarded by an external link to a player belonging to the other population. Yet as soon as the utility drops below the threshold, the external link is terminated. The rewarding of current evolutionary fitness thus introduces a time-varying interdependence between the two populations. We show that, regardless of the details of the evoluti…
Population structure and spatial heterogeneity are integral components of evolutionary dynamics, in general, and of evolution of cooperation, in particular. Structure can promote the emergence of cooperation in some populations and suppress it in others. Here, we provide results for weak selection to favor cooperation on regular graphs for any configuration, meaning any arrangement of cooperators and defectors. Our results extend previous work on fixation probabilities of single, randomly placed mutants. We find that for any configuration cooperation is never favored for birth-death (BD) updat…
Holding on to one's strategy is natural and common if the later warrants success and satisfaction. This goes against widespread simulation practices of evolutionary games, where players frequently consider changing their strategy even though their payoffs may be marginally different than those of the other players. Inspired by this observation, we introduce an aspiration-based win-stay-lose-learn strategy updating rule into the spatial prisoner's dilemma game. The rule is simple and intuitive, foreseeing strategy changes only by dissatisfied players, who then attempt to adopt the strategy of o…
Diffusion-induced instabilities promote cooperation in eco-evolutionary networks
Bagchi School of Public Health, Ahmedabad University（艾哈迈达巴德大学巴吉公共卫生学院）；Department of Physical Sciences, Indian Institute of Science Education and Research Kolkata（印度科学教育与研究学院加尔各答分校物理科学系）；Department of Mathematics and Namur Institute for Complex Systems - naXys, University of Namur（南纳尔大学数学与南纳尔复杂系统研究所-naXys）；Faculty of Natural Sciences and Mathematics, University of Maribor（马里博尔大学自然科学与数学学院）；Community Healthcare Center Dr. Adolf Drolc Maribor（马里博尔阿道夫·德罗尔克博士社区健康中心）；Department of Physics, Kyung Hee University（庆熙大学物理系）；University College, Korea University（韩国大学综合研究生院）；Physics and Applied Mathematics Unit, Indian Statistical Institute（印度统计物理学与应用数学单元）
We study the combined influence of selection and random fluctuations on the evolutionary dynamics of two-strategy ("cooperation" and "defection") games in populations comprising cooperation facilitators. The latter are individuals that support cooperation by enhancing the reproductive potential of cooperators relative to the fitness of defectors. By computing the fixation probability of a single cooperator in finite and well-mixed populations that include a fixed number of facilitators, and by using mean field analysis, we determine when selection promotes cooperation in the important classes …
Pro-social punishment, whereby cooperators punish defectors, is often suggested as a mechanism that maintains cooperation in large human groups. Importantly, models that support this idea have to date only allowed defectors to be the target of punishment. However, recent empirical work has demonstrated the existence of anti-social punishment in public goods games. That is, individuals that defect have been found to also punish cooperators. Some recent theoretical studies have found that such anti-social punishment can prevent the evolution of pro-social punishment and cooperation. However, the…
Range expansion is a universal process in biological systems, and therefore plays a part in biological evolution. Using a quantitative individual-based method based on the stochastic process, we identify that enhancing the inherent self-proliferation advantage of cooperators relative to defectors is a more effective channel to promote the evolution of cooperation in range expansion than weakening the benefit acquisition of defectors from cooperators. With this self-proliferation advantage, cooperators can rapidly colonize virgin space and establish spatial segregation more readily, which acts …
In this paper, we investigate the effect of "heterogeneity of link weight", heterogeneity of the frequency or amount of interactions among individuals, on the evolution of cooperation. Based on an analysis of the evolutionary prisoner's dilemma game on a weighted one-dimensional lattice network with "intra-individual heterogeneity", we confirm that moderate level of link-weight heterogeneity can facilitate cooperation. Furthermore, we identify two key mechanisms by which link-weight heterogeneity promotes the evolution of cooperation: mechanisms for spread and maintenance of cooperation. We al…
How producers of public goods persist in microbial communities is a major question in evolutionary biology. Cooperation is evolutionarily unstable, since cheating strains can reproduce quicker and take over. Spatial structure has been shown to be a robust mechanism for the evolution of cooperation. Here we study how spatial assortment might emerge from native dynamics and show that fluid flow shear promotes cooperative behavior. Social structures arise naturally from our advection-diffusion-reaction model as self-reproducing Turing patterns. We computationally study the effects of fluid advect…
Cooperative behavior is widespread in nature, even though cooperating individuals always run the risk to be exploited by free-riders. Population structure effectively promotes cooperation given that a threshold in the level of cooperation was already reached. However, the question how cooperation can emerge from a single mutant, which cannot rely on a benefit provided by other cooperators, is still puzzling. Here, we investigate this question for a well-defined but generic situation based on typical life-cycles of microbial populations where individuals regularly form new colonies followed by …
We study the emergence of cooperation in structured populations with any arrangement of cooperators and defectors on the evolutionary graph. Using structure coefficients defined for configurations describing such arrangements of any number of mutants, we provide results for weak selection to favor cooperation over defection on any regular graph with $N \leq 14$ vertices. Furthermore, the properties of graphs that particularly promote cooperation are analyzed. It is shown that the number of graph cycles of certain length is a good predictor for the values of the structure coefficient, and thus …
Cooperators forgo their interest to benefit others. Thus cooperation should not be favored by natural selection. It challenges the evolutionists, since cooperation is widespread. As one of the resolutions, information spreading has been revealed to play a key role in the emergence of cooperation. Individuals, however, are typically assumed to be passive in the information spreading. Here we assume that individuals are active to spread the information via self-recommendation. Individuals with higher intensities of self-recommendation are likely to have more neighbors. We find that i) eloquent c…
We establish a theoretical framework to address evolutionary dynamics of spatial games under strong selection. As the selection intensity tends to infinity, strategy competition unfolds in the deterministic way of winners taking all. We rigorously prove that the evolutionary process soon or later either enters a cycle and from then on repeats the cycle periodically, or stabilizes at some state almost everywhere. This conclusion holds for any population graph and a large class of finite games. This framework suffices to reveal the underlying mathematical rationale for the kaleidoscopic cooperat…
Cooperation is ubiquitous ranging from multicellular organisms to human societies. Population structures indicating individuals' limited interaction ranges are crucial to understand this issue. But it is still at large to what extend multiple interactions involving nonlinearity in payoff play a role on cooperation in structured populations. Here we show a rule, which determines the emergence and stabilization of cooperation, under multiple discounted, linear, and synergistic interactions. The rule is validated by simulations in homogenous and heterogenous structured populations. We find that t…
More often than not, bad decisions are bad regardless of where and when they are made. Information sharing might thus be utilized to mitigate them. Here we show that sharing the information about strategy choice between players residing on two different networks reinforces the evolution of cooperation. In evolutionary games the strategy reflects the action of each individual that warrants the highest utility in a competitive setting. We therefore assume that identical strategies on the two networks reinforce themselves by lessening their propensity to change. Besides network reciprocity workin…
I study two mechanisms based on punishment to promote cooperation in the two-population snowdrift game. The first mechanism follows the traditional approach in the literature and is based on the inclusion of a third additional strategy in the payoff matrix of the stage-game. The second mechanism consists of letting cooperators to punish defectors with a given exogenous frequency. While both mechanisms share the same result regarding the minimum required level of punishment in order to eliminate defectors in both populations, stability in the mechanism following the second approach is more robu…
Microbes providing public goods are widespread in nature despite running the risk of being exploited by free-riders. However, the precise ecological factors supporting cooperation are still puzzling. Following recent experiments, we consider the role of population growth and the repetitive fragmentation of populations into new colonies mimicking simple microbial life-cycles. Individual-based modeling reveals that demographic fluctuations, which lead to a large variance in the composition of colonies, promote cooperation. Biased by population dynamics these fluctuations result in two qualitativ…
Configurational arrangement of network architecture and interaction character of individuals are two most influential factors on the mechanisms underlying the evolutionary outcome of cooperation, which is explained by the well-established framework of evolutionary game theory. In the current study, not only qualitatively but also quantitatively, we measure Moran-evolution of cooperation to support an analytical agreement based on the consequences of the replicator equation in a finite population. The validity of the measurement has been double-checked in the well-mixed network by the Langevin …
The spatial arrangement of individuals is thought to overcome the dilemma of cooperation: When cooperators engage in clusters they might share the benefit of cooperation while being more protected against non-cooperating individuals, which benefit from cooperation but save the cost of cooperation. This is paradigmatically shown by the spatial prisoner's dilemma model. Here, we study this model in one and two spatial dimensions, but explicitly take into account that in biological setups fitness collection and selection are separated processes occurring mostly on vastly different time scales. Th…
The world in which we are living is a huge network of networks and should be described by interdependent networks. The interdependence between networks significantly affects the evolutionary dynamics of cooperation on them. Meanwhile, due to the diversity and complexity of social and biological systems, players on different networks may not interact with each other by the same way, which should be described by multiple models in evolutionary game theory, such as the Prisoner's Dilemma and Snowdrift Game. We therefore study the evolutionary dynamics of cooperation on two interdependent networks…
How cooperation emerges in human societies is both an evolutionary enigma, and a practical problem with tangible implications for societal health. Population structure has long been recognized as a catalyst for cooperation because local interactions enable reciprocity. Analysis of this phenomenon typically assumes bi-directional social interactions, even though real-world interactions are often uni-directional. Uni-directional interactions -- where one individual has the opportunity to contribute altruistically to another, but not conversely -- arise in real-world populations as the result of …
We study the problem of the emergence of cooperation in the spatial Prisoner's Dilemma. The pioneering work by Nowak and May showed that large initial populations of cooperators can survive and sustain cooperation in a square lattice with imitate-the-best evolutionary dynamics. We revisit this problem in a cost-benefit formulation suitable for a number of biological applications. We show that if a fixed-amount reward is established for cooperators to share, a single cooperator can invade a population of defectors and form structures that are resilient to re-invasion even if the reward mechanis…
We present a novel approach allowing the study of rare events like fixation under fluctuating environments, modeled as extrinsic noise, in evolutionary processes characterized by the dominance of one species. Our treatment consists of mapping the system onto an auxiliary model, exhibiting metastable species coexistence, that can be analyzed semiclassically. This approach enables us to study the interplay between extrinsic and demographic noise on the statistics of interest. We illustrate our theory by considering the paradigmatic prisoner's dilemma game whose evolution is described by the prob…
Spatial reciprocity is a well known tour de force of cooperation promotion. A thorough understanding of the effects of different population densities is therefore crucial. Here we study the evolution of cooperation in social dilemmas on different interaction graphs with a certain fraction of vacant nodes. We find that sparsity may favor the resolution of social dilemmas, especially if the population density is close to the percolation threshold of the underlying graph. Regardless of the type of the governing social dilemma as well as particularities of the interaction graph, we show that under…
Indirect reciprocity is a mechanism for cooperation in social dilemma situations, in which an individual is motivated to help another to acquire a good reputation and receive help from others afterwards. Ingroup favoritism is another aspect of human cooperation, whereby individuals help members in their own group more often than those in other groups. Ingroup favoritism is a puzzle for the theory of cooperation because it is not easily evolutionarily stable. In the context of indirect reciprocity, ingroup favoritism has been shown to be a consequence of employing a double standard when assigni…
