Pro-social punishment, whereby cooperators punish defectors, is often suggested as a mechanism that maintains cooperation in large human groups. Importantly, models that support this idea have to date only allowed defectors to be the target of punishment. However, recent empirical work has demonstrated the existence of anti-social punishment in public goods games. That is, individuals that defect have been found to also punish cooperators. Some recent theoretical studies have found that such anti-social punishment can prevent the evolution of pro-social punishment and cooperation. However, the evolution of anti-social punishment in group-structured populations has not been formally addressed. Previous work has informally argued that group-structure must favour pro-social punishment. Here we formally investigate how two demographic factors, group size and dispersal frequency, affect selection pressures on pro- and anti-social punishment. Contrary to the suggestions of previous work, we find that anti-social punishment can prevent the evolution of pro-social punishment and cooperation under a range of group structures. Given that anti-social punishment has now been found in all studied extant human cultures, the claims of previous models showing the co-evolution of pro-social punishment and cooperation in group-structured populations should be re-evaluated.
It has been an old unsolved puzzle to evolutionary theorists on which mechanisms would increase large-scale cooperation in human societies. Thus, how such mechanisms operate in a biological network is still not very understood. This study addresses these questions with empirical evidence from agent-based models designed to understand these network interactions. Repeated Prisoner's Dilemma games were designed to study how costly punishment, diversity, and density of connectivity interact to influence cooperation in a biological network. There are 1000 rounds in each game made up of 18 players e…
Incomplete Reputation Information and Punishment in Indirect Reciprocity
Pukyong National University（釜庆国立大学）；RIKEN Center for Interdisciplinary Theoretical and Mathematical Science (iTHEMS)（理化学研究所交叉理论数学科学中心（iTHEMS））；RIKEN Center for Computational Science（理化学研究所计算科学中心）
Punishment may deter antisocial behavior. Yet to punish is costly, and the costs often do not offset the gains that are due to elevated levels of cooperation. However, the effectiveness of punishment depends not only on how costly it is, but also on the circumstances defining the social dilemma. Using the snowdrift game as the basis, we have conducted a series of economic experiments to determine whether severe punishment is more effective than mild punishment. We have observed that severe punishment is not necessarily more effective, even if the cost of punishment is identical in both cases. …
This paper discusses the role of opportunistic punisher who may act selfishly to free-ride cooperators or not to be exploited by defectors. To consider opportunistic punisher, we make a change to the sequence of one-shot public good game; instead of putting action choice first before punishment, the commitment of punishment is declared first before choosing the action of each participant. In this commitment-first setting, punisher may use information about her team, and may defect to increase her fitness in the team. Reversing sequence of public good game can induce different behavior of punis…
Cooperative behaviour has been extensively studied as a choice between cooperation and defection. However, the possibility to not participate is also frequently available. This type of problem can be studied through the optional public goods game. The introduction of the "Loner" strategy, allows players to withdraw from the game, which leads to a cooperator-defector-loner cycle. While prosocial punishment can help increase cooperation, anti-social punishment -- where defectors punish cooperators -- causes its downfall in both experimental and theoretical studies. In this paper, we introduce so…
We study the evolution of cooperation in spatial public goods games where, besides the classical strategies of cooperation (C) and defection (D), we consider punishing cooperators (PC) or punishing defectors (PD) as an additional strategy. Using a minimalist modeling approach, our goal is to separately clarify and identify the consequences of the two punishing strategies. Since punishment is costly, punishing strategies loose the evolutionary competition in case of well-mixed interactions. When spatial interactions are taken into account, however, the outcome can be strikingly different, and c…
Established already in the Biblical times, the Matthew effect stands for the fact that in societies rich tend to get richer and the potent even more powerful. Here we investigate a game theoretical model describing the evolution of cooperation on structured populations where the distribution of public goods is driven by the reproductive success of individuals. Phase diagrams reveal that cooperation is promoted irrespective of the uncertainty by strategy adoptions and the type of interaction graph, yet the complete dominance of cooperators is elusive due to the spontaneous emergence of super-pe…
In a community-structured population, public goods games (PGG) occur both within and between communities. Such type of PGG is referred as multilevel public goods games (MPGG). We propose a minimalist evolutionary model of the MPGG and analytically study the evolution of cooperation. We demonstrate that in the case of sufficiently large community size and community number, if the imitation strength within community is weak, i.e., an individual imitates another one in the same community almost randomly, cooperation as well as punishment are more abundant than defection in the long run; if the im…
Reputation is one of key mechanisms to maintain human cooperation, but its analysis gets complicated if we consider the possibility that reputation does not reach consensus because of erroneous assessment. The difficulty is alleviated if we assume that reputation and cooperation do not take binary values but have continuous spectra so that disagreement over reputation can be analysed in a perturbative way. In this work, we carry out the analysis by expanding the dynamics of reputation to the second order of perturbation under the assumption that everyone initially cooperates with good reputati…
The evolution of cooperation has been a perennial problem for evolutionary biology because cooperation is undermined by selfish cheaters (or "free riders") that profit from cooperators but do not invest any resources themselves. In a purely "selfish" view of evolution, those cheaters should be favored. Evolutionary game theory has been able to show that under certain conditions, cooperation nonetheless evolves stably. One of these scenarios utilizes the power of punishment to suppress free riders, but only if players interact in a structured population where cooperators are likely to be surrou…
Cooperation is crucial for the remarkable evolutionary success of the human species. Not surprisingly, some individuals are willing to bare additional costs in order to punish defectors. Current models assume that, once set, the fine and cost of punishment do not change over time. Here we show that relaxing this assumption by allowing players to adapt their sanctioning efforts in dependence on the success of cooperation can explain both, the spontaneous emergence of punishment, as well as its ability to deter defectors and those unwilling to punish them with globally negligible investments. By…
Monitoring with implicated punishment is common in human societies to avert freeriding on common goods. But is it effective in promoting public cooperation? We show that the introduction of monitoring and implicated punishment is indeed effective, as it transforms the public goods game to a coordination game, thus rendering cooperation viable in infinite and finite well-mixed populations. We also show that the addition of within-group enforcement further promotes the evolution of public cooperation. However, although the group size in this context has nonlinear effects on collective action, an…
A large body of empirical evidence suggests that humans are willing to engage in costly punishment of defectors in public goods games. Based on such pieces of evidence, it is suggested that punishment serves an important role in promoting cooperation in humans, and possibly other species. Nevertheless, theoretical work has been unable to show how this is possible. The problem originates from the fact that punishment, being costly, is an altruistic act and its evolution is subject to the same problem that it tries to address. To suppress this so-called second-order free-rider problem, known the…
Non-participant externalities reshape the evolution of altruistic punishment
School of Computing, Engineering and Digital Technologies, Teesside University（蒂赛德大学计算、工程与数字技术学院）；Faculty of Engineering Sciences, Kyushu University（九州大学工学研究院）；Department of Psychology, University of Milan Biccoca（米兰比可卡大学心理学系）
Pro-social punishment and exclusion are common means to elevate the level of cooperation among unrelated individuals. Indeed, it is worth pointing out that the combined use of these two strategies is quite common across human societies. However, it is still not known how a combined strategy where punishment and exclusion are switched can promote cooperation from the theoretical perspective. In this paper, we thus propose two different switching strategies, namely peer switching that is based on peer punishment and peer exclusion, and pool switching that is based on pool punishment and pool exc…
I study two mechanisms based on punishment to promote cooperation in the two-population snowdrift game. The first mechanism follows the traditional approach in the literature and is based on the inclusion of a third additional strategy in the payoff matrix of the stage-game. The second mechanism consists of letting cooperators to punish defectors with a given exogenous frequency. While both mechanisms share the same result regarding the minimum required level of punishment in order to eliminate defectors in both populations, stability in the mechanism following the second approach is more robu…
Finding ways to overcome the temptation to exploit one another is still a challenge in behavioural sciences. In the framework of evolutionary game theory, punishing strategies are frequently used to promote cooperation in competitive environments. Here, we introduce altruistic punishers in the spatial public goods game. This strategy acts as a cooperator in the absence of defectors, otherwise it will punish all defectors in their vicinity while bearing a cost to do so. We observe three distinct behaviours in our model: i) in the absence of punishers, cooperators (who don't punish defectors) ar…
The evolution of cooperation has been a perennial problem in evolutionary biology because cooperation can be undermined by selfish cheaters who gain an advantage in the short run, while compromising the long-term viability of the population. Evolutionary game theory has shown that under certain conditions, cooperation nonetheless evolves stably, for example if players have the opportunity to punish cheaters that benefit from a public good yet refuse to pay into the common pool. However, punishment has remained enigmatic because it is costly, and difficult to maintain. On the other hand, cooper…
Without contributing, defectors take more benefit from social resources than cooperators which is the reflection of a specific character of individuals. However, natural physical mechanisms of our society promote cooperation. Thus, in the long run, the evolution about genetic variation is something more than the social evolution about fitness. The loci of evolutionary paths of the cooperation and the defection are correlated, but not a full complement of each other. Yet, the only single specific mechanism which is operated by some rules explains the enhancement of cooperation where the indepen…
School of Mathematics and Statistics, Northwestern Polytechnical University（西北工业大学数学与统计学院）；Shaanxi Provincial Key Laboratory of Intelligent Game Theory and Information Processing at Higher Education Institutions（陕西省高等学校智能博弈与信息处理重点实验室）；Shenzhen Research Institute, Northwestern Polytechnical University（西北工业大学深圳研究院）；School of Mathematics and Statistics, Nanjing University of Science and Technology（南京理工大学数学与统计学院）；Institute of Technical Physics and Materials Science, Centre for Energy Research（匈牙利科学院技术物理与材料研究所能源研究中心）
King Fahd University of Petroleum and Minerals（国王法赫德国立石油与矿产大学）
Classical studies on aspiration-based dynamics suggest that a dissatisfied individual changes strategy without taking into account the success of others. This promotes defection spreading. The imitation-based dynamics allow individuals to imitate successful strategies without taking into account their own-satisfactions. In this article, we propose to study a dynamic based on aspiration which takes into account imitation of successful strategies for dissatisfied individuals. This helps cooperative members to resist. Individuals compare their success to their desired satisfaction level before ma…
We study the combined influence of selection and random fluctuations on the evolutionary dynamics of two-strategy ("cooperation" and "defection") games in populations comprising cooperation facilitators. The latter are individuals that support cooperation by enhancing the reproductive potential of cooperators relative to the fitness of defectors. By computing the fixation probability of a single cooperator in finite and well-mixed populations that include a fixed number of facilitators, and by using mean field analysis, we determine when selection promotes cooperation in the important classes …
Economic experiments reveal that humans value cooperation and fairness. Punishing unfair behavior is therefore common, and according to the theory of strong reciprocity, it is also directly related to rewarding cooperative behavior. However, empirical data fail to confirm that positive and negative reciprocity are correlated. Inspired by this disagreement, we determine whether the combined application of reward and punishment is evolutionary advantageous. We study a spatial public goods game, where in addition to the three elementary strategies of defection, rewarding and punishment, a fourth …
Evolutionary dynamics in public goods games with general frequency-dependent returns
School of Mathematical Sciences, University of Electronic Science and Technology of China（电子科技大学数学科学学院）；Institute of Technical Physics and Materials Science, Centre for Energy Research（能源研究中心技术物理与材料科学研究所）
Repeated interaction promotes cooperation among rational individuals under the shadow of future, but it is hard to maintain cooperation when a large number of error-prone individuals are involved. One way to construct a cooperative Nash equilibrium is to find a `friendly-rivalry' strategy, which aims at full cooperation but never allows the co-players to be better off. Recently it has been shown that for the iterated Prisoner's Dilemma in the presence of error, a friendly rival can be designed with the following five rules: Cooperate if everyone did, accept punishment for your own mistake, pun…
ETH Zürich（苏黎世联邦理工学院）；Complexity Science Hub Vienna（维也纳复杂性科学中心）；University of Maribor（马里博尔大学）；China Medical University Hospital, China Medical University（中国医药大学附设医院，中国医药大学）；Alma Mater Europaea（欧洲母校大学）
In a non-sustainable, "over-populated" world, what might the use of nanotechnology-based targeted, autonomous weapons mean for the future of humanity? In order to gain some insights, we make a simplified game-theoretical thought experiment. We consider a population where agents play the public goods game, and where in parallel an epidemic unfolds. Agents that are infected defectors are killed with a certain probability and replaced by susceptible cooperators. We show that such "nanowars", even if aiming to promote good behavior and planetary health, fail not only to promote cooperation, but th…
In a world of hardening borders, nations may deprive themselves of enjoying the benefits of cooperative immigrants. Here, we analyze the effect of efficient cooperative immigrants on a population playing public goods games. We considered a population structured on a square lattice with individuals playing public goods games with their neighbors. The demographics are determined by stochastic birth, death, and migration. The strategies spread through imitation dynamics. Our model shows that cooperation among natives can emerge due to social contagion of good role-model agents that can provide be…
Migration is a fundamental trait in humans and animals. Recent studies investigated the effect of migration on the evolution of cooperation, showing that contingent migration favors cooperation in spatial structures. In those studies, only local migration to immediate neighbors was considered, while long-range migration has not been considered yet, partly because the long-range migration has been generally regarded as harmful for cooperation as it would bring the population to a well-mixed state that favors defection. Here, we studied the effects of adaptive long-range migration on the evoluti…
"Personal responsibility", one of the basic principles of modern law, requires one to be responsible for what he did. However, personal responsibility is far from the only norm ruling human interactions, especially in social and economic activities. In many collective communities such as among enterprise colleagues and family members, one's personal interests are often bound to others' -- once one member breaks the rule, a group of people have to bear the punishment or sanction. Such a mechanism is termed "joint liability". Although many real-world cases have demonstrated that joint liability …
Rewards and penalties are common practical tools that can be used to promote cooperation in social institutions. The evolution of cooperation under reward and punishment incentives in joint enterprises has been formalized and investigated, mostly by using compulsory public good games. Recently, Sasaki et al. (2012, Proc Natl Acad Sci USA 109:1165-1169) considered optional participation as well as institutional incentives and described how the interplay between these mechanisms affects the evolution of cooperation in public good games. Here, we present a full classification of these evolutionar…
Recent research has identified the heterogeneity as crucial for the evolution of cooperation in spatial population. However, the influence of heterogeneous noise is still lack. Inspired by this interesting question, in this work, we try to incorporate heterogeneous noise into the evaluation of utility, where only a proportion of population possesses noise, whose range can also be tuned. We find that increasing heterogeneous noise monotonously promotes cooperation and even translates the full defection phase (of the homogeneous version) into the complete cooperation phase. Moreover, the promoti…
Cooperation among individuals has been key to sustaining societies. However, natural selection favors defection over cooperation. Cooperation can be favored when the mobility of individuals allows cooperators to form a cluster (or group). Mobility patterns of animals sometimes follow a Lévy flight. A Lévy flight is a kind of random walk but it is composed of many small movements with a few big movements. The role of Lévy flights for cooperation has been studied by Antonioni and Tomassini. They showed that Lévy flights promoted cooperation combined with conditional movements triggered by neighb…
The environment has a strong influence on a population's evolutionary dynamics. Driven by both intrinsic and external factors, the environment is subject to continual change in nature. To capture an ever-changing environment, we consider a model of evolutionary dynamics with game transitions, where individuals' behaviors together with the games they play in one time step influence the games to be played next time step. Within this model, we study the evolution of cooperation in structured populations and find a simple rule: weak selection favors cooperation over defection if the ratio of the b…
Cooperation is ubiquitous in nature, but explaining its existence remains a central interdisciplinary challenge. Cooperation is most difficult to explain in the Prisoner's Dilemma game, where cooperators always lose in direct competition with defectors despite increasing mean fitness. Here we demonstrate how spatial population expansion, a widespread natural phenomenon, promotes the evolution of cooperation. We engineer an experimental Prisoner's Dilemma game in the budding yeast Saccharomyces cerevisiae to show that, despite losing to defectors in nonexpanding conditions, cooperators increase…
Both conventional wisdom and empirical evidence suggests that arranging a prior commitment or agreement before an interaction enhances the chance of reaching mutual cooperation. Yet it is not clear what mechanisms can promote the participation in and compliance with such a commitment, especially when the former is costly and deviating from the latter is profitable. Prior work either considers regimented commitments where compensation is assumed enforceable from dishonest committers, or assume implicit commitments from every individual (so they are all in and thus being treated as such). Here w…
Emergence of cooperation: A reputation-modulated reinforcement learning
School of Physics, East China Normal University（华东师范大学物理系）；School of Physics, Ningxia University（宁夏大学物理学院）；School of Physics and Information Technology, Shaanxi Normal University（陕西师范大学物理与信息工程学院）
We study the evolution of cooperation in structured populations within popular models of social dilemmas, whereby simple coevolutionary rules are introduced that may enhance players abilities to enforce their strategy on the opponent. Coevolution thus here refers to an evolutionary process affecting the teaching activity of players that accompanies the evolution of their strategies. Particularly, we increase the teaching activity of a player after it has successfully reproduced, yet we do so depending on the disseminated strategy. We separately consider coevolution affecting either only the co…
Population structure and spatial heterogeneity are integral components of evolutionary dynamics, in general, and of evolution of cooperation, in particular. Structure can promote the emergence of cooperation in some populations and suppress it in others. Here, we provide results for weak selection to favor cooperation on regular graphs for any configuration, meaning any arrangement of cooperators and defectors. Our results extend previous work on fixation probabilities of single, randomly placed mutants. We find that for any configuration cooperation is never favored for birth-death (BD) updat…
In spatial evolutionary games the fitness of each individual is traditionally determined by the payoffs it obtains upon playing the game with its neighbors. Since defection yields the highest individual benefits, the outlook for cooperators is gloomy. While network reciprocity promotes collaborative efforts, chances of averting the impending social decline are slim if the temptation to defect is strong. It is therefore of interest to identify viable mechanisms that provide additional support for the evolution of cooperation. Inspired by the fact that the environment may be just as important as…
We study the emergence of cooperation in structured populations with any arrangement of cooperators and defectors on the evolutionary graph. Using structure coefficients defined for configurations describing such arrangements of any number of mutants, we provide results for weak selection to favor cooperation over defection on any regular graph with $N \leq 14$ vertices. Furthermore, the properties of graphs that particularly promote cooperation are analyzed. It is shown that the number of graph cycles of certain length is a good predictor for the values of the structure coefficient, and thus …
Strategy changes are an essential part of evolutionary games. Here we introduce a simple rule that, depending on the value of a single parameter $w$, influences the selection of players that are considered as potential sources of the new strategy. For positive $w$ players with high payoffs will be considered more likely, while for negative $w$ the opposite holds. Setting $w$ equal to zero returns the frequently adopted random selection of the opponent. We find that increasing the probability of adopting the strategy from the fittest player within reach, i.e. setting $w$ positive, promotes the …
Elucidating the mechanisms that lead to cooperation is still one of the main scientific challenges of current times, as many common cooperative scenarios remain elusive and at odds with Darwin's natural selection theory. Here, we study evolutionary games on populations that are structured beyond pairwise interactions. Specifically, we introduce a general evolutionary approach that allows studying situations in which indirect interactions via a neighbor other than the direct pairwise connection (or via a group of neighbors), impact the strategy of the focal player. To this end, we consider simp…
