The cooperation-defection evolution on social networks
Bijan Sarkar
备注：
A scientific explanation can be accomplished through a simple easier logical procedure. A time consuming trick can also be replaced by an elegant trick
发表信息：
Physica A: Statistical Mechanics and its Applications, Volume 584, 15 December 2021, 126381
Without contributing, defectors take more benefit from social resources than cooperators which is the reflection of a specific character of individuals. However, natural physical mechanisms of our society promote cooperation. Thus, in the long run, the evolution about genetic variation is something more than the social evolution about fitness. The loci of evolutionary paths of the cooperation and the defection are correlated, but not a full complement of each other. Yet, the only single specific mechanism which is operated by some rules explains the enhancement of cooperation where the independent analysis of defect evolutionary mechanism is ignored. Moreover, the execution of a particular evolutionary rule through algorithm method over the long time encounters highly sensitive influence of the model parameters. Theoretically, biodiversity of two types relatively persists rarely. Here I describe the evolutionary outcome in the demographic fluctuation. Using both analytical procedure and algorithm method the article concludes that the intratype fitness of individual species is the key factor for not only surviving, but thriving. In consideration of the random drift, the experimental outcomes show that dominant enhancement of cooperation over defection is qualitatively independent of environmental scenario. Collectively, the set of the rules becomes an evolutionary principle to cooperation enhancement.
The prisoner's dilemma describes a conflict between a pair of players, in which defection is a dominant strategy whereas cooperation is collectively optimal. The iterated version of the dilemma has been extensively studied to understand the emergence of cooperation. In the evolutionary context, the iterated prisoner's dilemma is often combined with population dynamics, in which a more successful strategy replicates itself with a higher growth rate. Here, we investigate the replicator dynamics of three representative strategies, i.e., unconditional cooperation, unconditional defection, and tit-…
We study the evolution of cooperation in the spatial prisoner's dilemma game, where besides unconditional cooperation and defection, tit-for-tat, win-stay-lose-shift and extortion are the five competing strategies. While pairwise imitation fails to sustain unconditional cooperation and extortion regardless of game parametrization, myopic updating gives rise to the coexistence of all five strategies if the temptation to defect is sufficiently large or if the degree distribution of the interaction network is heterogeneous. This counterintuitive evolutionary outcome emerges as a result of an unex…
Established already in the Biblical times, the Matthew effect stands for the fact that in societies rich tend to get richer and the potent even more powerful. Here we investigate a game theoretical model describing the evolution of cooperation on structured populations where the distribution of public goods is driven by the reproductive success of individuals. Phase diagrams reveal that cooperation is promoted irrespective of the uncertainty by strategy adoptions and the type of interaction graph, yet the complete dominance of cooperators is elusive due to the spontaneous emergence of super-pe…
We consider two-player iterated survival games in which players may switch from a more cooperative behavior to a less cooperative one at some step of the game. Payoffs are survival probabilities and lone individuals have to finish the game on their own. We explore the potential of these games to support cooperation, focusing on the case in which each single step is a Prisoner's Dilemma. We find that incentives for or against cooperation depend on the number of defections at the end of the game, as opposed to the number of steps in the game. Broadly, cooperation is supported when the survival p…
We study the combined influence of selection and random fluctuations on the evolutionary dynamics of two-strategy ("cooperation" and "defection") games in populations comprising cooperation facilitators. The latter are individuals that support cooperation by enhancing the reproductive potential of cooperators relative to the fitness of defectors. By computing the fixation probability of a single cooperator in finite and well-mixed populations that include a fixed number of facilitators, and by using mean field analysis, we determine when selection promotes cooperation in the important classes …
It has been an old unsolved puzzle to evolutionary theorists on which mechanisms would increase large-scale cooperation in human societies. Thus, how such mechanisms operate in a biological network is still not very understood. This study addresses these questions with empirical evidence from agent-based models designed to understand these network interactions. Repeated Prisoner's Dilemma games were designed to study how costly punishment, diversity, and density of connectivity interact to influence cooperation in a biological network. There are 1000 rounds in each game made up of 18 players e…
Pro-social punishment, whereby cooperators punish defectors, is often suggested as a mechanism that maintains cooperation in large human groups. Importantly, models that support this idea have to date only allowed defectors to be the target of punishment. However, recent empirical work has demonstrated the existence of anti-social punishment in public goods games. That is, individuals that defect have been found to also punish cooperators. Some recent theoretical studies have found that such anti-social punishment can prevent the evolution of pro-social punishment and cooperation. However, the…
This paper investigates the evolution of strategic play where players drawn from a finite well-mixed population are offered the opportunity to play in a public goods game. All players accept the offer. However, due to the possibility of unforeseen circumstances, each player has a fixed probability of being unable to participate in the game, unlike similar models which assume voluntary participation. We first study how prescribed stochastic opting-out affects cooperation in finite populations. Moreover, in the model, cooperation is favored by natural selection over both neutral drift and defect…
In the framework of the paradigmatic prisoner's dilemma, we investigate the evolutionary dynamics of social dilemmas in the presence of "cooperation facilitators". In our model, cooperators and defectors interact as in the classical prisoner's dilemma game, where selection favors defection. However, here the presence of a small number of cooperation facilitators enhances the fitness (reproductive potential) of cooperators, while it does not alter that of defectors. In a finite population of size N, the dynamics of the prisoner's dilemma with facilitators is characterized by the probability tha…
In a community-structured population, public goods games (PGG) occur both within and between communities. Such type of PGG is referred as multilevel public goods games (MPGG). We propose a minimalist evolutionary model of the MPGG and analytically study the evolution of cooperation. We demonstrate that in the case of sufficiently large community size and community number, if the imitation strength within community is weak, i.e., an individual imitates another one in the same community almost randomly, cooperation as well as punishment are more abundant than defection in the long run; if the im…
Cooperation and defection may be considered as two extreme responses to a social dilemma. Yet the reality is much less clear-cut. Between the two extremes lies an interval of ambivalent choices, which may be captured theoretically by means of continuous strategies defining the extent of the contributions of each individual player to the common pool. If strategies are chosen from the unit interval, where 0 corresponds to pure defection and 1 corresponds to the maximal contribution, the question is what is the characteristic level of individual investments to the common pool that emerges if the …
Recent experimental results with humans involved in social dilemma games suggest that cooperation may be a contagious phenomenon and that the selection pressure operating on evolutionary dynamics (i.e., mimicry) is relatively weak. I propose an evolutionary dynamics model that links these experimental findings and evolution of cooperation. By assuming a small fraction of (imperfect) zealous cooperators, I show that a large fraction of cooperation emerges in evolutionary dynamics of social dilemma games. Even if defection is more lucrative than cooperation for most individuals, they often mimic…
Rewards and penalties are common practical tools that can be used to promote cooperation in social institutions. The evolution of cooperation under reward and punishment incentives in joint enterprises has been formalized and investigated, mostly by using compulsory public good games. Recently, Sasaki et al. (2012, Proc Natl Acad Sci USA 109:1165-1169) considered optional participation as well as institutional incentives and described how the interplay between these mechanisms affects the evolution of cooperation in public good games. Here, we present a full classification of these evolutionar…
Emergence of cooperation: A reputation-modulated reinforcement learning
School of Physics, East China Normal University（华东师范大学物理系）；School of Physics, Ningxia University（宁夏大学物理学院）；School of Physics and Information Technology, Shaanxi Normal University（陕西师范大学物理与信息工程学院）
The environment has a strong influence on a population's evolutionary dynamics. Driven by both intrinsic and external factors, the environment is subject to continual change in nature. To capture an ever-changing environment, we consider a model of evolutionary dynamics with game transitions, where individuals' behaviors together with the games they play in one time step influence the games to be played next time step. Within this model, we study the evolution of cooperation in structured populations and find a simple rule: weak selection favors cooperation over defection if the ratio of the b…
How cooperation emerges in human societies is both an evolutionary enigma, and a practical problem with tangible implications for societal health. Population structure has long been recognized as a catalyst for cooperation because local interactions enable reciprocity. Analysis of this phenomenon typically assumes bi-directional social interactions, even though real-world interactions are often uni-directional. Uni-directional interactions -- where one individual has the opportunity to contribute altruistically to another, but not conversely -- arise in real-world populations as the result of …
Recent studies on the evolutionary dynamics of the Prisoner's Dilemma game in scale-free networks have demonstrated that the heterogeneity of the network interconnections enhances the evolutionary success of cooperation. In this paper we address the issue of how the characterization of the asymptotic states of the evolutionary dynamics depends on the initial concentration of cooperators. We find that the measure and the connectedness properties of the set of nodes where cooperation reaches fixation is largely independent of initial conditions, in contrast with the behavior of both the set of n…
We study the emergence of cooperation in structured populations with any arrangement of cooperators and defectors on the evolutionary graph. Using structure coefficients defined for configurations describing such arrangements of any number of mutants, we provide results for weak selection to favor cooperation over defection on any regular graph with $N \leq 14$ vertices. Furthermore, the properties of graphs that particularly promote cooperation are analyzed. It is shown that the number of graph cycles of certain length is a good predictor for the values of the structure coefficient, and thus …
Migration is a fundamental trait in humans and animals. Recent studies investigated the effect of migration on the evolution of cooperation, showing that contingent migration favors cooperation in spatial structures. In those studies, only local migration to immediate neighbors was considered, while long-range migration has not been considered yet, partly because the long-range migration has been generally regarded as harmful for cooperation as it would bring the population to a well-mixed state that favors defection. Here, we studied the effects of adaptive long-range migration on the evoluti…
This paper discusses the role of opportunistic punisher who may act selfishly to free-ride cooperators or not to be exploited by defectors. To consider opportunistic punisher, we make a change to the sequence of one-shot public good game; instead of putting action choice first before punishment, the commitment of punishment is declared first before choosing the action of each participant. In this commitment-first setting, punisher may use information about her team, and may defect to increase her fitness in the team. Reversing sequence of public good game can induce different behavior of punis…
We study the evolution of cooperation in structured populations within popular models of social dilemmas, whereby simple coevolutionary rules are introduced that may enhance players abilities to enforce their strategy on the opponent. Coevolution thus here refers to an evolutionary process affecting the teaching activity of players that accompanies the evolution of their strategies. Particularly, we increase the teaching activity of a player after it has successfully reproduced, yet we do so depending on the disseminated strategy. We separately consider coevolution affecting either only the co…
Cooperation among individuals has been key to sustaining societies. However, natural selection favors defection over cooperation. Cooperation can be favored when the mobility of individuals allows cooperators to form a cluster (or group). Mobility patterns of animals sometimes follow a Lévy flight. A Lévy flight is a kind of random walk but it is composed of many small movements with a few big movements. The role of Lévy flights for cooperation has been studied by Antonioni and Tomassini. They showed that Lévy flights promoted cooperation combined with conditional movements triggered by neighb…
In this paper, we numerically investigate the robustness of cooperation clusters in prisoner's dilemma played on scale-free networks, where the network topologies change by continuous removal and addition of nodes. Each removal and addition can be either random or intentional. We therefore have four different strategies in changing network topology: random removal and random addition (RR), random removal and preferential addition (RP), targeted removal and random addition (TR), and targeted removal and preferential addition (TP). We find that cooperation clusters are most fragile against TR, w…
The emergence and promotion of cooperation are two of the main issues in evolutionary game theory, as cooperation is amenable to exploitation by defectors, which take advantage of cooperative individuals at no cost, dooming them to extinction. It has been recently shown that the existence of purely destructive agents (termed jokers) acting on the common enterprises (public goods games) can induce stable limit cycles among cooperation, defection, and destruction when infinite populations are considered. These cycles allow for time lapses in which cooperators represent a relevant fraction of the…
In multi-agent systems, cooperative behavior is largely determined by the network structure which dictates the interactions among neighboring agents. These interactions often exhibit multidimensional features, either as relationships of different types or temporal dynamics, both of which may be modeled as a "multiplex" network. Against this background, here we advance the research on cooperation models inspired by generalized reciprocity, a simple pay-it-forward behavioral mechanism, by considering a multidimensional networked society. Our results reveal that a multiplex network structure can …
We compare the likelihood of different socially relevant features to allow the evolutionary emergence and maintenance of cooperation in a generalized variant of the iterated Prisoners Dilemma game. Results show that the average costs/benefit balance of cooperation is the primary constraint for its establishment and maintenance. Behavior increasing inclusive fitness such as assortation, homophily, kin-selection and tagging of individuals, is second in importance. Networks characteristics were the least important in favoring the establishment and maintenance of cooperation, despite being the mos…
Extensive cooperation among biologically unrelated individuals is uniquely human and much current research attempts to explain this fact. We draw upon social, cultural, and psychological aspects of human uniqueness to present an integrated theory of human cooperation that explains aspects of human cooperation that are problematic for other theories (e.g., defector invasion avoidance, preferential assortment to exclude free riders, and the second order free rider problem). We propose that the evolution of human cooperative behavior required (1) a capacity for self-sustained, self-referential th…
Evolutionary Prisoner's Dilemma games with quenched inhomogeneities in the spatial dynamical rules are considered. The players following one of the two pure strategies (cooperation or defection) are distributed on a two-dimensional lattice. The rate of strategy adoption from a randomly chosen neighbors are controlled by the payoff difference and a two-value pre-factor $w$ characterizing the players whom the strategy learned from. The reduced teaching activity of players is distributed randomly with concentrations $ν$ at the beginning and fixed further on. Numerical and analytical calculations …
Studies of cooperation have traditionally focused on discrete games such as the well-known prisoner's dilemma, in which players choose between two pure strategies: cooperation and defection. Increasingly, however, cooperation is being studied in continuous games that feature a continuum of strategies determining the level of cooperative investment. For the continuous snowdrift game, it has been shown that a gradually evolving monomorphic population may undergo evolutionary branching, resulting in the emergence of a defector strategy that coexists with a cooperator strategy. This phenomenon has…
Varying environmental conditions affect relations between interacting individuals in social dilemmas, thus affecting also the evolution of cooperation. Oftentimes these environmental variations are seasonal and can therefore be mathematically described as periodic changes. Accordingly, we here study how periodic shifts between different manifestations of social dilemmas affect cooperation. We observe a non-trivial interplay between the inherent spatiotemporal dynamics that characterizes the spreading of cooperation in a particular social dilemma type and the frequency of payoff changes. In par…
In human societies the probability of strategy adoption from a given person may be affected by the personal features. Now we investigate how an artificially imposed restricted ability to reproduce, overruling ones fitness, affects an evolutionary process. For this purpose we employ the evolutionary prisoner's dilemma game on different complex graphs. Reproduction restrictions can have a facilitative effect on the evolution of cooperation that sets in irrespective of particularities of the interaction network. Indeed, an appropriate fraction of less fertile individuals may lead to full supremac…
Strategy changes are an essential part of evolutionary games. Here we introduce a simple rule that, depending on the value of a single parameter $w$, influences the selection of players that are considered as potential sources of the new strategy. For positive $w$ players with high payoffs will be considered more likely, while for negative $w$ the opposite holds. Setting $w$ equal to zero returns the frequently adopted random selection of the opponent. We find that increasing the probability of adopting the strategy from the fittest player within reach, i.e. setting $w$ positive, promotes the …
We study the evolution of cooperation in a finite population interacting according to a simple model of like-with-like assortment. Evolution proceeds as a Moran process, and payoffs from the underlying cooperator-defector game are translated to positive fitnesses by an exponential transformation. These evolutionary dynamics can arise, for example, in a nest-structured population with rare migration. The use of the exponential transformation, rather than the usual linear one, is appropriate when interactions have multiplicative fitness effects, and allows for a tractable characterization of the…
In social-ecological systems (SESs), social and biophysical dynamics interact within and between structural levels separated by spatial and temporal scales. Cross-scale interactions (CSIs) are interdependences between processes at different scales, generating behaviour unpredictable at single scales. Understanding CSIs is important for improving SES governance but they remain understudied. Theoretical models are needed, which capture essential features while being simple enough to yield insights into mechanisms. In a stylised model, we study CSIs in a two-level system of weakly interacting com…
Social hierarchy is important that can not be ignored in human socioeconomic activities and in the animal world. Here we incorporate this factor into the evolutionary game to see what impact it could have on the cooperation outcome. The probabilistic strategy adoption between two players is then not only determined by their payoffs, but also by their hierarchy difference -- players in the high rank are more likely to reproduce their strategies than the peers in the low rank. Through simulating the evolution of Prisoners' dilemma game with three hierarchical distributions, we find that the leve…
Cooperative behaviour has been extensively studied as a choice between cooperation and defection. However, the possibility to not participate is also frequently available. This type of problem can be studied through the optional public goods game. The introduction of the "Loner" strategy, allows players to withdraw from the game, which leads to a cooperator-defector-loner cycle. While prosocial punishment can help increase cooperation, anti-social punishment -- where defectors punish cooperators -- causes its downfall in both experimental and theoretical studies. In this paper, we introduce so…
Population structure and spatial heterogeneity are integral components of evolutionary dynamics, in general, and of evolution of cooperation, in particular. Structure can promote the emergence of cooperation in some populations and suppress it in others. Here, we provide results for weak selection to favor cooperation on regular graphs for any configuration, meaning any arrangement of cooperators and defectors. Our results extend previous work on fixation probabilities of single, randomly placed mutants. We find that for any configuration cooperation is never favored for birth-death (BD) updat…
Spatial reciprocity is a well known tour de force of cooperation promotion. A thorough understanding of the effects of different population densities is therefore crucial. Here we study the evolution of cooperation in social dilemmas on different interaction graphs with a certain fraction of vacant nodes. We find that sparsity may favor the resolution of social dilemmas, especially if the population density is close to the percolation threshold of the underlying graph. Regardless of the type of the governing social dilemma as well as particularities of the interaction graph, we show that under…
Cooperation in one-shot anonymous interactions is a widely documented aspect of human behaviour. Here we shed light on the motivations behind this behaviour by experimentally exploring cooperation in a one-shot continuous-strategy Prisoner's Dilemma (i.e. one-shot two-player Public Goods Game). We examine the distribution of cooperation amounts, and how that distribution varies based on the benefit-to-cost ratio of cooperation (b/c). Interestingly, we find a trimodal distribution at all b/c values investigated. Increasing b/c decreases the fraction of participants engaging in zero cooperation …
The evolution of cooperation has been a perennial problem for evolutionary biology because cooperation is undermined by selfish cheaters (or "free riders") that profit from cooperators but do not invest any resources themselves. In a purely "selfish" view of evolution, those cheaters should be favored. Evolutionary game theory has been able to show that under certain conditions, cooperation nonetheless evolves stably. One of these scenarios utilizes the power of punishment to suppress free riders, but only if players interact in a structured population where cooperators are likely to be surrou…
Cooperators benefit others with paying costs. Evolution of cooperation crucially depends on the cost-benefit ratio of cooperation, denoted as $c$. In this work, we investigate the infinitely repeated prisoner's dilemma for various values of $c$ with four of the representative memory-one strategies, i.e., unconditional cooperation, unconditional defection, tit-for-tat, and win-stay-lose-shift. We consider replicator dynamics which deterministically describes how the fraction of each strategy evolves over time in an infinite-sized well-mixed population in the presence of implementation error and…
The diversity in wealth and social status is present not only among humans, but throughout the animal world. We account for this observation by generating random variables that determ ine the social diversity of players engaging in the prisoner's dilemma game. Here the term social diversity is used to address extrinsic factors that determine the mapping of game pay offs to individual fitness. These factors may increase or decrease the fitness of a player depending on its location on the spatial grid. We consider different distributions of extrin sic factors that determine the social diversity …
How cooperation can evolve between players is an unsolved problem of biology. Here we use Hamiltonian dynamics of models of the Ising type to describe populations of cooperating and defecting players to show that the equilibrium fraction of cooperators is given by the expectation value of a thermal observable akin to a magnetization. We apply the formalism to the Public Goods game with three players, and show that a phase transition between cooperation and defection occurs that is equivalent to a transition in one-dimensional Ising crystals with long-range interactions. We then investigate the…
Interactions among individuals in natural populations often occur in a dynamically changing environment. Understanding the role of environmental variation in population dynamics has long been a central topic in theoretical ecology and population biology. However, the key question of how individuals, in the middle of challenging social dilemmas (e.g., the "tragedy of the commons"), modulate their behaviors to adapt to the fluctuation of the environment has not yet been addressed satisfactorily. Utilizing evolutionary game theory and stochastic games, we develop a game-theoretical framework that…
The Prisoner's Dilemma, a 2-person game in which the players can either cooperate or defect, is a common paradigm for studying the evolution of cooperation, when individuals exhibit variable degrees of cooperation. It is known that in the presence of spatial structure, when individuals ``play against'' their neighbours, and ``compare to'' them, cooperative investments can evolve to considerable levels. Here we examine the effect of increasing the neighbourhood size: we find that the mean-field limit of no cooperation is reached for a critical neighbourhood size of about five neighbours. We als…
Cooperation is ubiquitous in nature, but explaining its existence remains a central interdisciplinary challenge. Cooperation is most difficult to explain in the Prisoner's Dilemma game, where cooperators always lose in direct competition with defectors despite increasing mean fitness. Here we demonstrate how spatial population expansion, a widespread natural phenomenon, promotes the evolution of cooperation. We engineer an experimental Prisoner's Dilemma game in the budding yeast Saccharomyces cerevisiae to show that, despite losing to defectors in nonexpanding conditions, cooperators increase…
We introduce a framework for studying social dilemmas in networked societies where individuals follow a simple state-based behavioral mechanism based on generalized reciprocity, which is rooted in the principle "help anyone if helped by someone". Within this general framework, which applies to a wide range of social dilemmas including, among others, public goods, donation and snowdrift games, we study the cooperation dynamics on a variety of complex network examples. By interpreting the studied model through the lenses of nonlinear dynamical systems, we show that cooperation through generalize…
Indirect reciprocity is a foundational mechanism of human cooperation. Existing models of indirect reciprocity fail to robustly support social cooperation: image scoring models fail to provide robust incentives, while social standing models are not informationally robust. Here we provide a new model of indirect reciprocity based on simple, decentralized records: each individual's record depends on their own past behavior alone, and not on their partners' past behavior or their partners' partners' past behavior. When social dilemmas exhibit a coordination motive (or strategic complementarity), …
