Varying environmental conditions affect relations between interacting individuals in social dilemmas, thus affecting also the evolution of cooperation. Oftentimes these environmental variations are seasonal and can therefore be mathematically described as periodic changes. Accordingly, we here study how periodic shifts between different manifestations of social dilemmas affect cooperation. We observe a non-trivial interplay between the inherent spatiotemporal dynamics that characterizes the spreading of cooperation in a particular social dilemma type and the frequency of payoff changes. In particular, we show that periodic changes between two available games with global ordering best be fast, while periodic changes between global and local ordering games best be slow for cooperation to thrive. We also show that the frequency of periodic changes between two local ordering social dilemmas is irrelevant, because then the process is fast and simply the average cooperation level of the two is returned. The structure of the interaction network plays an important role too in that lattices promote local ordering, whilst random graphs hinder the formation of compact cooperative clusters. Conversely, for local ordering the regular structure of the interaction network is only marginally relevant as role-separating checkerboard patterns do not rely on long-range order.
An active participation of players in evolutionary games depends on several factors, ranging from personal stakes to the properties of the interaction network. Diverse activity patterns thus have to be taken into account when studying the evolution of cooperation in social dilemmas. Here we study the weak prisoner's dilemma game, where the activity of each player is determined in a probabilistic manner either by its degree or by its payoff. While degree-correlated activity introduces cascading failures of cooperation that are particularly severe on scale-free networks with frequently inactive …
The maintenance of cooperation in the presence of spatial restrictions has been studied extensively. It is well-established that the underlying graph topology can significantly influence the outcome of games on graphs. Maintenance of cooperation could be difficult, especially in the absence of spatial restrictions. The evolution of cooperation would naturally depend on payoffs. However, payoffs are generally considered to be invariant in a given game. A natural yet unexplored question is whether the topology of the underlying structures on which the games are played, possesses no role whatsoev…
The pursuit of highest payoffs in evolutionary social dilemmas is risky and sometimes inferior to conformity. Choosing the most common strategy within the interaction range is safer because it ensures that the payoff of an individual will not be much lower than average. Herding instincts and crowd behavior in humans and social animals also compel to conformity on their own right. Motivated by these facts, we here study the impact of conformity on the evolution of cooperation in social dilemmas. We show that an appropriate fraction of conformists within the population introduces an effective su…
The theory of repeated games analyzes the long-term relationship of interacting players and mathematically reveals the condition of how cooperation is achieved, which is not achieved in a one-shot game. In the repeated prisoner's dilemma (RPD) game with no errors, zero-determinant (ZD) strategies allow a player to unilaterally set a linear relationship between the player's own payoff and the opponent's payoff regardless of the strategy that the opponent implements. In contrast, unconditional strategies such as ALLD and ALLC also unilaterally set a linear payoff relationship. Errors often happe…
Motivated by the fact that the same social dilemma can be perceived differently by different players, we here study evolutionary multigames in structured populations. While the core game is the weak prisoner's dilemma, a fraction of the population adopts either a positive or a negative value of the sucker's payoff, thus playing either the traditional prisoner's dilemma or the snowdrift game. We show that the higher the fraction of the population adopting a different payoff matrix, the more the evolution of cooperation is promoted. The microscopic mechanism responsible for this outcome is uniqu…
In spatial evolutionary games the fitness of each individual is traditionally determined by the payoffs it obtains upon playing the game with its neighbors. Since defection yields the highest individual benefits, the outlook for cooperators is gloomy. While network reciprocity promotes collaborative efforts, chances of averting the impending social decline are slim if the temptation to defect is strong. It is therefore of interest to identify viable mechanisms that provide additional support for the evolution of cooperation. Inspired by the fact that the environment may be just as important as…
We analyse the strategy equilibrium of dilemma games considering a payoff matrix affected by small and random perturbations on the off-diagonal. Notably, a recent work [1] reported that, while cooperation is sustained by perturbations acting on the main diagonal, a less clear scenario emerges when perturbations act on the off-diagonal. Thus, the second case represents the core of this investigation, aimed at completing the description of the effects that payoff perturbations have on the dynamics of evolutionary games. Our results, achieved by analysing the proposed model under a variety of con…
In this paper, the total payoff of each agent is regulated to reduce the heterogeneity of the distribution of the total payoffs. It is found there is an optimal regulation strength where the fraction of cooperation is prominently promoted, too weak or too strong of the strength will have little effects or result in the disappearance of the cooperators. It is also found that most of the cooperators are not distributed in isolation but form the cooperator clusters, and to promote the cooperation the only way is to enlarge the size of the cooperator clusters. Finally, we try to explain the emerge…
Learning from a partner who collects higher payoff is a frequently used working hypothesis in evolutionary game theory. One of the alternative dynamical rules is when the focal player prefers to follow the strategy choice of the majority in the local neighborhood, which is often called as conformity-driven strategy update. In this work we assume that both strategy learning methods are present and compete for space within the framework of a coevolutionary model. Our results reveal that the presence of payoff-driven strategy learning method becomes exclusive for high succer's payoff and/or high …
In this paper the results of a simulation of a prisoner's dilemma robin-round tournament are presented. In the tournament each participating strategy plays an iterated prisoner's dilemma against each other strategy (round-robin) and as a variant also against itself. The participants of a tournament are all strategies that are deterministic and have the same size of memory with regard to their own and their opponent's past actions: up to three most recent actions of their opponent and up to two most recent actions of their own. A focus is set on the investigation of the influence of the number …
In daily life, subjects often face a social dilemma in two stages. In Stage 1, they recognize the social dilemma structure of the decision problem at hand (a tension between personal interest and collective interest); in Stage 2, they have to choose between gathering additional information to learn the exact payoffs corresponding to each of the two options or making a choice without looking at the payoffs. While previous theoretical research suggests that the mere act of considering one's strategic options in a social dilemma will be met with distrust, no experimental study has tested this hyp…
A fundamental question of human society is the evolution of cooperation. Many previous studies explored this question via setting spatial background, where players obtain their payoffs by playing game with their nearest neighbors. Another undoubted fact is that environment plays an important role in the individual development. Inspired by these phenomena, we reconsider the definition of individual fitness which integrates the environment, denoted by the average payoff of all individual neighbors, with the traditional individual payoffs by introducing a selection parameter $u$. Tuning $u$ equal…
In the last few decades, numerous experiments have shown that humans do not always behave so as to maximize their material payoff. Cooperative behavior when non-cooperation is a dominant strategy (with respect to the material payoffs) is particularly puzzling. Here we propose a novel approach to explain cooperation, assuming what Halpern and Pass (2013) call "translucent players". Typically, players are assumed to be "opaque", in the sense that a deviation by one player does not affect the strategies used by other players. But a player may believe that if he switches from one strategy to anoth…
The Prisoner's Dilemma game has a long history stretching across the social, biological, and physical sciences. In 2012, Press and Dyson developed a method for analyzing the mapping of the 8-dimensional strategy profile onto the 2-dimensional payoff space in an infinitely iterated Prisoner's Dilemma game, based on Markov chain analysis and memory-one strategies. We generalize this approach and introduce the concept of strategy parameter to show that linear relations among player payoffs are a ubiquitous feature of the infinitely iterated Prisoner's Dilemma game. Our extended analysis is applie…
We have studied an evolutionary game with spatially arranged players who can choose one of the two strategies (named cooperation and defection for social dilemmas) when playing with their neighbors. In addition to the application of the usual strategies in the present model the players are also characterized by one of the two extreme personal features representing the egoist or fraternal behavior. During the evolution each player can modify both her own strategy and/or personal feature via a myopic update process in order to improve her utility. The results of numerical simulations and stabili…
Dense cooperative networks are an essential element of social capital for a prosperous society. These networks enable individuals to overcome collective action dilemmas by enhancing trust. In many biological and social settings, network structures evolve endogenously as agents exit relationships and build new ones. However, the process by which evolutionary dynamics lead to self-organization of dense cooperative networks has not been explored. Our large group prisoner's dilemma experiments with exit and partner choice options show that core-periphery segregation of cooperators and defectors dr…
Game theory formalizes certain interactions between physical particles or between living beings in biology, sociology, and economics, and quantifies the outcomes by payoffs. The prisoner's dilemma (PD) describes situations in which it is profitable if everybody cooperates rather than defects (free-rides or cheats), but as cooperation is risky and defection is tempting, the expected outcome is defection. Nevertheless, some biological and social mechanisms can support cooperation by effectively transforming the payoffs. Here, we study the related phase transitions, which can be of first order (d…
Maintenance of cooperation was studied for a two-strategy evolutionary Prisoner's Dilemma game where the players are located on a one-dimensional chain and their payoff comes from games with the nearest and next-nearest neighbor interactions. The applied host geometry makes possible to study the impacts of two conflicting topological features. The evolutionary rule involves some noise affecting the strategy adoptions between the interacting players. Using Monte Carlo simulations and the extended versions of dynamical mean-field theory we determined the phase diagram as a function of noise leve…
We present insights and empirical results from an extensive numerical study of the evolutionary dynamics of the iterated prisoner's dilemma. Fixation probabilities for Moran processes are obtained for all pairs of 164 different strategies including classics such as TitForTat, zero determinant strategies, and many more sophisticated strategies. Players with long memories and sophisticated behaviours outperform many strategies that perform well in a two player setting. Moreover we introduce several strategies trained with evolutionary algorithms to excel at the Moran process. These strategies ar…
The commonly used accumulated payoff scheme is not invariant with respect to shifts of payoff values when applied locally in degree-inhomogeneous population structures. We propose a suitably modified payoff scheme and we show both formally and by numerical simulation, that it leaves the replicator dynamics invariant with respect to affine transformations of the game payoff matrix. We then show empirically that, using the modified payoff scheme, an interesting amount of cooperation can be reached in three paradigmatic non-cooperative two-person games in populations that are structured according…
In the study of the evolution of cooperation, many mechanisms have been proposed to help overcome the self-interested cheating that is individually optimal in the Prisoners' Dilemma game. These mechanisms include assortative or networked social interactions, other-regarding preferences considering the payoffs of others, reciprocity rules to establish cooperation as a social norm, and multilevel selection involving simultaneous competition between individuals favoring cheaters and competition between groups favoring cooperators. In this paper, we build on recent work studying PDE replicator equ…
We show that the resolution of social dilemmas on random graphs and scale-free networks is facilitated by imitating not the strategy of better performing players but rather their emotions. We assume sympathy and envy as the two emotions that determine the strategy of each player by any given interaction, and we define them as probabilities to cooperate with players having a lower and higher payoff, respectively. Starting with a population where all possible combinations of the two emotions are available, the evolutionary process leads to a spontaneous fixation to a single emotional profile tha…
We studied spatial Prisoner's Dilemma and Stag Hunt games where both the strategy distribution and the players' individual noise level could evolve to reach higher individual payoff. Players are located on the sites of different two-dimensional lattices and gain their payoff from games with their neighbors by choosing unconditional cooperation or defection. The way of strategy adoption can be characterized by a single $K$ (temperature-like) parameter describing how strongly adoptions depend on the payoff-difference. If we start the system from a random strategy distribution with many different…
Punishment and partner switching are two well-studied mechanisms that support the evolution of cooperation. Observation of human behaviour suggests that the extent to which punishment is adopted depends on the usage of alternative mechanisms, including partner switching. In this study, we investigate the combined effect of punishment and partner switching in evolutionary prisoner's dilemma games conducted on a network. In the model, agents are located on the network and participate in the prisoner's dilemma games with punishment. In addition, they can opportunistically switch interaction partn…
Cooperation lies at the foundations of human societies, yet why people cooperate remains a conundrum. The issue, known as network reciprocity, of whether population structure can foster cooperative behavior in social dilemmas has been addressed by many, but theoretical studies have yielded contradictory results so far---as the problem is very sensitive to how players adapt their strategy. However, recent experiments with the prisoner's dilemma game played on different networks have shown that humans do not consider neighbors' payoffs when making their decisions, and that the network structure …
Recently, Antonioni and Cardillo proposed a coevolutionary model based on the intertwining of oscillator synchronization and evolutionary game theory [Phys. Rev. Lett. \textbf{118}, 238301 (2017)], in which each Kuramoto oscillator can decide whether to interact-or not-with its neighbors, and all oscillators can receive some benefits from the local synchronization but those who choose to interact must pay a cost. Oscillators are allowed to update their strategies according to payoff difference, wherein the strategy of an oscillator who has obtained higher payoff is more likely to be followed. …
Wealthy individuals may be less tempted to defect than those with comparatively low payoffs. To take this into consideration, we introduce coevolutionary success-driven multigames in structured populations. While the core game is always the weak prisoner's dilemma, players whose payoffs from the previous round exceed a threshold adopt only a minimally low temptation to defect in the next round. Along with the strategies, the perceived strength of the social dilemma thus coevolves with the success of each individual player. We show that the lower the threshold for using the small temptation to …
We consider a tournament among four equally strong semifinalists. The players have to decide how much stamina to use in the semifinals, provided that the rest is available in the final and the third-place playoff. We investigate optimal strategies for allocating stamina to the successive matches when players' prizes (payoffs) are given according to the tournament results. From the basic assumption that the probability to win a match follows a nondecreasing function of stamina difference, we present symmetric Nash equilibria for general payoff structures. We find three different phases of the N…
On the existence of fair zero-determinant strategies in the periodic prisoner's dilemma game
Graduate School of Sciences and Technology for Innovation, Yamaguchi University（山口大学创新科学技术研究生院）；Department of Physics, Tokyo Metropolitan University（东京都立大学物理系）
Traveler's dilemma (TD) is one of social dilemmas which has been well studied in the economics community, but it is attracted little attention in the physics community. The TD game is a two-person game. Each player can select an integer value between $R$ and $M$ ($R < M$) as a pure strategy. If both of them select the same value, the payoff to them will be that value. If the players select different values, say $i$ and $j$ ($R \le i < j \le M$), then the payoff to the player who chooses the small value will be $i+R$ and the payoff to the other player will be $i-R$. We term the player who selec…
The effects of networking on the extent of cooperation emerging in a competitive setting are studied. The evolutionary snowdrift game, which represents a realistic alternative to the well-known Prisoner's Dilemma, is studied in the Watts-Strogatz network that spans the regular, small-world, and random networks through random re-wiring. Over a wide range of payoffs, a re-wired network is found to suppress cooperation when compared with a well-mixed or fully connected system. Two extinction payoffs, that characterize the emergence of a homogeneous steady state, are identified. It is found that, …
In society, mutual cooperation, defection, and asymmetric exploitative relationships are common. Whereas cooperation and defection are studied extensively in the literature on game theory, asymmetric exploitative relationships between players are little explored. In a recent study, Press and Dyson demonstrate that if only one player can learn about the other, asymmetric exploitation is achieved in the prisoner's dilemma game. In contrast, however, it is unknown whether such one-way exploitation is stably established when both players learn about each other symmetrically and try to optimize the…
In this paper we extend the investigation of cooperation in some classical evolutionary games on populations were the network of interactions among individuals is of the scale-free type. We show that the update rule, the payoff computation and, to some extent the timing of the operations, have a marked influence on the transient dynamics and on the amount of cooperation that can be established at equilibrium. We also study the dynamical behavior of the populations and their evolutionary stability.
We propose an extension of the evolutionary Prisoner's Dilemma cellular automata, introduced by Nowak and May \cite{nm92}, in which the pressure of the environment is taken into account. This is implemented by requiring that individuals need to collect a minimum score $U_{min}$, representing indispensable resources (nutrients, energy, money, etc.) to prosper in this environment. So the agents, instead of evolving just by adopting the behaviour of the most successful neighbour (who got $U^{msn}$), also take into account if $U^{msn}$ is above or below the threshold $U_{min}$. If $U^{msn}<U_{min}…
Dynamics of evolutionary games strongly depend on underlying networks. We study the coevolutionary prisoner's dilemma in which players change their local networks as well as strategies (i.e., cooperate or defect). This topic has been increasingly explored by many researchers. On the basis of active linking dynamics [J. M. Pacheco et al., J. Theor. Biol. 243, 437 (2006), J. M. Pacheco et al., Phys. Rev. Lett. 97, 258103 (2006)], we show that cooperation is enhanced fairly robustly. In particular, cooperation evolves when the payoff of the player is normalized by the number of neighbors; this is…
Evolution is based on the assumption that competing players update their strategies to increase their individual payoffs. However, while the applied updating method can be different, most of previous works proposed uniform models where players use identical way to revise their strategies. In this work we explore how imitation-based or learning attitude and innovation-based or myopic best response attitude compete for space in a complex model where both attitudes are available. In the absence of additional cost the best response trait practically dominates the whole snow-drift game parameter sp…
We study an evolutionary spatial prisoner's dilemma game where the fitness of the players is determined by both the payoffs from the current interaction and their history. We consider the situation where the selection timescale is slower than the interaction timescale. This is done by implementing probabilistic reproduction on an individual level. We observe that both too fast and too slow reproduction rates hamper the emergence of cooperation. In other words, there exists an intermediate selection timescale that maximizes cooperation. Another factor we find to promote cooperation is a diversi…
We study a spatial Prisoner's dilemma game with two types (A and B) of players located on a square lattice. Players following either cooperator or defector strategies play Prisoner's Dilemma games with their 24 nearest neighbors. The players are allowed to adopt one of their neighbor's strategy with a probability dependent on the payoff difference and type of the given neighbor. Players A and B have different efficiency in the transfer of their own strategy therefore the strategy adoption probability is reduced by a multiplicative factor (w < 1) from the players of type B. We report that the m…
The emergence of cooperation in the thermodynamic limit of social dilemmas is an emerging field of research. While numerical approaches (using replicator dynamics) are dime a dozen, analytical approaches are rare. A particularly useful analytical approach is to utilize a mapping between the spin-1/2 Ising model in 1-D and the social dilemma game and calculate the magnetization, which is the net difference between the fraction of cooperators and defectors in a social dilemma. In this paper, we look at the susceptibility, which probes the net change in the fraction of players adopting a certain …
We study the evolution of cooperation in populations where individuals play prisoner's dilemma on a network. Every node of the network corresponds on an individual choosing whether to cooperate or defect in a repeated game. The players revise their actions by imitating those neighbors who have higher payoffs. We show that when the interactions take place on graphs with large girth, cooperation is more likely to emerge. On the flip side, in graphs with many cycles of length 3 and 4, defection spreads more rapidly. One of the key ideas of our analysis is that our dynamics can be seen as a pertur…
In this work we have used computer models of social-like networks to show by extensive numerical simulations that cooperation in evolutionary games can emerge and be stable on this class of networks. The amounts of cooperation reached are at least as much as in scale-free networks but here the population model is more realistic. Cooperation is robust with respect to different strategy update rules, population dynamics, and payoff computation. Only when straight average payoff is used or there is high strategy or network noise does cooperation decrease in all games and disappear in the Prisoner…
In many social dilemmas, individuals tend to generate a situation with low payoffs instead of a system optimum ("tragedy of the commons"). Is the routing of traffic a similar problem? In order to address this question, we present experimental results on humans playing a route choice game in a computer laboratory, which allow one to study decision behavior in repeated games beyond the Prisoner's Dilemma. We will focus on whether individuals manage to find a cooperative and fair solution compatible with the system-optimal road usage. We find that individuals tend towards a user equilibrium with …
We study the evolution of cooperation among selfish individuals in the stochastic strategy spatial prisoner's dilemma game. We equip players with the particle swarm optimization technique, and find that it may lead to highly cooperative states even if the temptations to defect are strong. The concept of particle swarm optimization was originally introduced within a simple model of social dynamics that can describe the formation of a swarm, i.e., analogous to a swarm of bees searching for a food source. Essentially, particle swarm optimization foresees changes in the velocity profile of each pl…
Exploiting others is beneficial individually but it could also be detrimental globally. The reverse is also true: a higher cooperation level may change the environment in a way that is beneficial for all competitors. To explore the possible consequence of this feedback we consider a coevolutionary model where the local cooperation level determines the payoff values of the applied prisoner's dilemma game. We observe that the coevolutionary rule provides a significantly higher cooperation level comparing to the traditional setup independently of the topology of the applied interaction graph. Int…
We introduce nonlinear attractive effects into a spatial Prisoner's Dilemma game where the players located on a square lattice can either cooperate with their nearest neighbors or defect. In every generation, each player updates its strategy by firstly choosing one of the neighbors with a probability proportional to $\mathcal{A}^α$ denoting the attractiveness of the neighbor, where $\mathcal{A}$ is the payoff collected by it and $α$ ($\geq$0) is a free parameter characterizing the extent of the nonlinear effect; and then adopting its strategy with a probability dependent on their payoff differ…
We study co-evolutionary Prisoner's Dilemma games where each player can imitate both the strategy and imitation rule from a randomly chosen neighbor with a probability dependent on the payoff difference when the player's income is collected from games with the neighbors. The players, located on the sites of a two-dimensional lattice, follow unconditional cooperation or defection and use individual strategy adoption rule described by a parameter. If the system is started from a random initial state then the present co-evolutionary rule drives the system towards a state where only one evolutiona…
Punishment, especially selfish punishment, has recently been identified as a potent promoter in sustaining or even enhancing the cooperation among unrelated individuals. However, without other key mechanisms, the first-order social dilemma and second-order social dilemma are still two enduring conundrums in biology and the social sciences even with the presence of punishment. In the present study, we investigate a spatial evolutionary four-strategy prisoner's dilemma game model with avoiding mechanism, where the four strategies are cooperation, defection, altruistic and selfish punishment. By …
Cooperation in one-shot anonymous interactions is a widely documented aspect of human behaviour. Here we shed light on the motivations behind this behaviour by experimentally exploring cooperation in a one-shot continuous-strategy Prisoner's Dilemma (i.e. one-shot two-player Public Goods Game). We examine the distribution of cooperation amounts, and how that distribution varies based on the benefit-to-cost ratio of cooperation (b/c). Interestingly, we find a trimodal distribution at all b/c values investigated. Increasing b/c decreases the fraction of participants engaging in zero cooperation …
When the interactions between cooperators (C) and defectors (D) can be partially avoided within a population, there may be an overall enhancement of cooperation. One example of such screening mechanism occurs in the presence of risk-averse agents (loners, L) that are neutral towards others, i.e., both L and its opponent, whatever its strategy, receive the same payoff. Their presence in the Prisoner's Dilemma (PD) game sustains the coexistence of cooperators and defectors far beyond the level attained in their absence. Another screening mechanism is a heterogeneous landscape obtained, for examp…
In the framework of the paradigmatic prisoner's dilemma, we investigate the evolutionary dynamics of social dilemmas in the presence of "cooperation facilitators". In our model, cooperators and defectors interact as in the classical prisoner's dilemma game, where selection favors defection. However, here the presence of a small number of cooperation facilitators enhances the fitness (reproductive potential) of cooperators, while it does not alter that of defectors. In a finite population of size N, the dynamics of the prisoner's dilemma with facilitators is characterized by the probability tha…
We study the evolution of cooperation in the evolutionary spatial prisoner's dilemma game (PDG) and snowdrift game (SG), within which a fraction $α$ of the payoffs of each player gained from direct game interactions is shared equally by the immediate neighbors. The magnitude of the parameter $α$ therefore characterizes the degree of the relatedness among the neighboring players. By means of extensive Monte Carlo simulations as well as an extended mean-field approximation method, we trace the frequency of cooperation in the stationary state. We find that plugging into relatedness can significan…
We study a spatial two-strategy (cooperation and defection) Prisoner's Dilemma game with two types ($A$ and $B$) of players located on the sites of a square lattice. The evolution of strategy distribution is governed by iterated strategy adoption from a randomly selected neighbor with a probability depending on the payoff difference and also on the type of the neighbor. The strategy adoption probability is reduced by a pre-factor ($w < 1$) from the players of type $B$. We consider the competition between two opposite effects when increasing the number of neighbors ($k=4$, 8, and 24). Within a …
We present a game-theoretic model for the spread of deviant behavior in online social networks. We utilize a two-strategy framework wherein each player's behavior is classified as normal or deviant and evolves according to the cooperate-defect payoff scheme of the classic prisoner's dilemma game. We demonstrate convergence of individual behavior over time to a final strategy vector and indicate counterexamples to this convergence outside the context of prisoner's dilemma. Theoretical results are validated on a real-world dataset collected from a popular online forum.
