Evolution of cooperation in the prisoner's dilemma game is studied where initially all players are linked via a regular graph, having four neighbors each. Simultaneously with the strategy evolution, players are allowed to make new connections and thus permanently extend their neighborhoods, provided they have been successful in passing their strategy to the opponents. We show that this simple coevolutionary rule shifts the survival barrier of cooperators towards high temptations to defect and results in highly heterogeneous interaction networks with an exponential fit best characterizing their degree distributions. In particular, there exist an optimal maximal degree for the promotion of cooperation, warranting the best exchange of information between influential players.
Differences between men and women have intrigued generations of social scientists, who have found that the two sexes behave differently in settings requiring competition, risk taking, altruism, honesty, as well as many others. Yet, little is known about whether there are gender differences in cooperative behavior. Previous evidence is mixed and inconclusive. Here I shed light on this topic by analyzing the totality of studies that my research group has conducted since 2013. This is a dataset of 10,951 observations coming from 7,322 men and women living in the US, recruited through Amazon Mecha…
Recent studies on the evolutionary dynamics of the Prisoner's Dilemma game in scale-free networks have demonstrated that the heterogeneity of the network interconnections enhances the evolutionary success of cooperation. In this paper we address the issue of how the characterization of the asymptotic states of the evolutionary dynamics depends on the initial concentration of cooperators. We find that the measure and the connectedness properties of the set of nodes where cooperation reaches fixation is largely independent of initial conditions, in contrast with the behavior of both the set of n…
We introduce the stochastic Network-Iterated Prisoner's Dilemma (NIPD) model, a network of players playing the Prisoner's Dilemma with their neighbours, each with a memory-one strategy which they constantly and locally update to improve their success. This process is non-deterministic, and mirrors societal interactions in many relevant aspects. We use it to assess the flexibility, noise tolerance and real-world adaptability of some well-known strategies. Furthermore, in the model a new strategy naturally emerges which proves way more successful than those. We also derive some theoretical param…
Punishment and partner switching are two well-studied mechanisms that support the evolution of cooperation. Observation of human behaviour suggests that the extent to which punishment is adopted depends on the usage of alternative mechanisms, including partner switching. In this study, we investigate the combined effect of punishment and partner switching in evolutionary prisoner's dilemma games conducted on a network. In the model, agents are located on the network and participate in the prisoner's dilemma games with punishment. In addition, they can opportunistically switch interaction partn…
The world in which we are living is a huge network of networks and should be described by interdependent networks. The interdependence between networks significantly affects the evolutionary dynamics of cooperation on them. Meanwhile, due to the diversity and complexity of social and biological systems, players on different networks may not interact with each other by the same way, which should be described by multiple models in evolutionary game theory, such as the Prisoner's Dilemma and Snowdrift Game. We therefore study the evolutionary dynamics of cooperation on two interdependent networks…
Prisoner's Dilemma is a game theory model used to describe altruistic behavior seen in various populations. This theoretical game is important in understanding why a seemingly selfish strategy does persist and spread throughout a population that is mixing homogeneously at random. For a population with structure determined by social interactions, Prisoner's Dilemma brings to light certain requirements for the altruistic strategy to become established. Monte Carlo simulations of Prisoner's Dilemma are carried out using both simulated social networks and a dataset of a real social network. In bot…
Dynamics of evolutionary games strongly depend on underlying networks. We study the coevolutionary prisoner's dilemma in which players change their local networks as well as strategies (i.e., cooperate or defect). This topic has been increasingly explored by many researchers. On the basis of active linking dynamics [J. M. Pacheco et al., J. Theor. Biol. 243, 437 (2006), J. M. Pacheco et al., Phys. Rev. Lett. 97, 258103 (2006)], we show that cooperation is enhanced fairly robustly. In particular, cooperation evolves when the payoff of the player is normalized by the number of neighbors; this is…
Dense cooperative networks are an essential element of social capital for a prosperous society. These networks enable individuals to overcome collective action dilemmas by enhancing trust. In many biological and social settings, network structures evolve endogenously as agents exit relationships and build new ones. However, the process by which evolutionary dynamics lead to self-organization of dense cooperative networks has not been explored. Our large group prisoner's dilemma experiments with exit and partner choice options show that core-periphery segregation of cooperators and defectors dr…
Recently, the eco-evolutionary game theory which describes the coupled dynamics of strategies and environment have attracted great attention. At the same time, most of the current work is focused on the classic two-player two-strategy game. In this work, we study multi-strategy eco-evolutionary game theory which is an extension of the framework. For simplicity, we'll focus on the voluntary participation Prisoner's dilemma game. For the general class of payoff-dependent feedback dynamics, we show the conditions for the existence and stability of internal equilibrium by using the replicator dyna…
This manuscript explores the research topics and collaborative behaviour of authors in the field of the Prisoner's Dilemma using topic modeling and a graph theoretic analysis of the co-authorship network. The analysis identified five research topics in the Prisoner's Dilemma which have been relevant over the course of time. These are human subject research, biological studies, strategies, evolutionary dynamics on networks and modeling problems as a Prisoner's Dilemma game. Moreover, the results demonstrated the Prisoner's Dilemma is a field of continued interest, and that it is a collaborative…
The theory of repeated games analyzes the long-term relationship of interacting players and mathematically reveals the condition of how cooperation is achieved, which is not achieved in a one-shot game. In the repeated prisoner's dilemma (RPD) game with no errors, zero-determinant (ZD) strategies allow a player to unilaterally set a linear relationship between the player's own payoff and the opponent's payoff regardless of the strategy that the opponent implements. In contrast, unconditional strategies such as ALLD and ALLC also unilaterally set a linear payoff relationship. Errors often happe…
We study a spatial Prisoner's dilemma game with two types (A and B) of players located on a square lattice. Players following either cooperator or defector strategies play Prisoner's Dilemma games with their 24 nearest neighbors. The players are allowed to adopt one of their neighbor's strategy with a probability dependent on the payoff difference and type of the given neighbor. Players A and B have different efficiency in the transfer of their own strategy therefore the strategy adoption probability is reduced by a multiplicative factor (w < 1) from the players of type B. We report that the m…
We studied synchronization between prisoner's dilemma games with voluntary participation in two Newman-Watts small-world networks. It was found that there are three kinds of synchronization: partial phase synchronization, total phase synchronization and complete synchronization, for varied coupling factors. Besides, two games can reach complete synchronization for the large enough coupling factor. We also discussed the effect of coupling factor on the amplitude of oscillation of $cooperator$ density.
Game theory is fundamental to understanding cooperation between agents. Mainly, the Prisoner's Dilemma is a well-known model that has been extensively studied in complex networks. However, although the emergence of cooperation has been investigated before, the influence of memory in its evolution is not well understood. This paper presents a detailed study of cooperation dynamics in which agents have memory. We simulate the evolutionary Prisoner's dilemma game on random, scale-free and networks presenting degree-degree correlation. Through extensive simulations, we show that assortativity can …
Aging is always present, tailoring our interactions with others and postulating a finite lifespan during which we are able to exercise them. We consider the prisoner's dilemma game on a square lattice, and examine how quenched age distributions and different aging protocols influence the evolution of cooperation when taking the life experience and knowledge accumulation into account as time passes. In agreement with previous studies, we find that a quenched assignment of age to players, introducing heterogeneity to the game, substantially promotes cooperative behavior. Introduction of aging an…
We study an evolutionary spatial prisoner's dilemma game where the fitness of the players is determined by both the payoffs from the current interaction and their history. We consider the situation where the selection timescale is slower than the interaction timescale. This is done by implementing probabilistic reproduction on an individual level. We observe that both too fast and too slow reproduction rates hamper the emergence of cooperation. In other words, there exists an intermediate selection timescale that maximizes cooperation. Another factor we find to promote cooperation is a diversi…
We study the evolution of cooperation in the spatial prisoner's dilemma game where players are allowed to establish new interactions with others. By employing a simple coevolutionary rule entailing only two crucial parameters, we find that different selection criteria for the new interaction partners as well as their number vitally affect the outcome of the game. The resolution of the social dilemma is most probable if the selection favors more successful players and if their maximally attainable number is restricted. While the preferential selection of the best players promotes cooperation ir…
We investigate the repeated prisoner's dilemma game where both players alternately use reinforcement learning to obtain their optimal memory-one strategies. We theoretically solve the simultaneous Bellman optimality equations of reinforcement learning. We find that the Win-stay Lose-shift strategy, the Grim strategy, and the strategy which always defects can form symmetric equilibrium of the mutual reinforcement learning process amongst all deterministic memory-one strategies.
In this work we study a weak Prisonerâs Dilemma game in which both strategies and update rules are subjected to evolutionary pressure. Interactions among agents are specified by complex topologies, and we consider both homogeneous and heterogeneous situations. We consider deterministic and stochastic update rules for the strategies, which in turn may consider single links or full context when selecting agents to copy from. Our results indicate that the co-evolutionary process preserves heterogeneous networks as a suitable framework for the emergence of cooperation. Furthermore, on those networ…
In this article we discuss network growth based on Prisoner's Dilemma(PD) where palyers on nodes in a network palay with its linked players. The players estimate total profits in the PD. When a new node is attached, the node make linkes to nodes in the network with the probabilities in proportion to the profits made by the game. Iterating this process, a network grows. We investigate properties of this type of growing networks, especially the degree distribution and time-depending strategy distribution by running computer simulation. We also find a sort of phase transition in the strategy dist…
Previous studies suggest that punishment is a useful way to promote cooperation in the well-mixed public goods game, whereas it still lacks specific evidence that punishment maintains cooperation in spatial prisoner's dilemma game as well. To address this issue, we introduce a mechanism of recorded punishment, involved with memory and punishment, into spatial prisoner's dilemma game. We find that increasing punishment rate or memory length promotes the evolution of cooperation monotonously. Interestingly, compared with traditional version, recorded punishment will facilitate cooperation better…
Two-player games have had a long and fruitful history of applications stretching across the social, biological, and physical sciences. Most applications of two-player games assume synchronous decisions or moves even when the games are iterated. But different strategies may emerge as preferred when the decisions or moves are sequential, or the games are iterated. Zero-determinant strategies developed by Press and Dyson are a new class of strategies that have been developed for synchronous two-player games, most notably the iterated prisoner's dilemma. Here we apply the Press-Dyson analysis to s…
On the existence of fair zero-determinant strategies in the periodic prisoner's dilemma game
Graduate School of Sciences and Technology for Innovation, Yamaguchi University（山口大学创新科学技术研究生院）；Department of Physics, Tokyo Metropolitan University（东京都立大学物理系）
We introduce a community network model which exhibits scale-free property and study the evolutionary Prisoner's Dilemma game (PDG) on this network model. It is found that the frequency of cooperators decreases with the increment of the average degree $\bar{k}$ from the simulation results. And reducing inter-community links can promote cooperation when we keep the total links (including inner-community and inter-community links) unchanged. It is also shown that the heterogeneity of networks does not always enhance cooperation and the pattern of links among all the vertices under a given degree-…
Cooperation in one-shot anonymous interactions is a widely documented aspect of human behaviour. Here we shed light on the motivations behind this behaviour by experimentally exploring cooperation in a one-shot continuous-strategy Prisoner's Dilemma (i.e. one-shot two-player Public Goods Game). We examine the distribution of cooperation amounts, and how that distribution varies based on the benefit-to-cost ratio of cooperation (b/c). Interestingly, we find a trimodal distribution at all b/c values investigated. Increasing b/c decreases the fraction of participants engaging in zero cooperation …
In the framework of the paradigmatic prisoner's dilemma, we investigate the evolutionary dynamics of social dilemmas in the presence of "cooperation facilitators". In our model, cooperators and defectors interact as in the classical prisoner's dilemma game, where selection favors defection. However, here the presence of a small number of cooperation facilitators enhances the fitness (reproductive potential) of cooperators, while it does not alter that of defectors. In a finite population of size N, the dynamics of the prisoner's dilemma with facilitators is characterized by the probability tha…
We show that the success of cooperation in an evolutionary prisoner's dilemma on a complex network can be predicted by a simple, quantitative network analysis using mean field parameters. The criterion is shown to be accurate on a wide variety of networks with degree distributions ranging from regular to Poisson to scale-free. The network analysis uses a parameter that allows for comparisons of networks with both similar, and distinct, topologies. Furthermore, we establish the criterion here as a natural network analogue of Hamilton's classical rule for kin selection, despite arising in an ent…
Maintenance of cooperation was studied for a two-strategy evolutionary Prisoner's Dilemma game where the players are located on a one-dimensional chain and their payoff comes from games with the nearest and next-nearest neighbor interactions. The applied host geometry makes possible to study the impacts of two conflicting topological features. The evolutionary rule involves some noise affecting the strategy adoptions between the interacting players. Using Monte Carlo simulations and the extended versions of dynamical mean-field theory we determined the phase diagram as a function of noise leve…
We present results of the prisoner's dilemma game on complex networks that have population change. We introduce a death process with minimum requirements and show that it induces a highly cooperative society. We also study the effects of immigration on the society. We show that the acceptable number of immigrants of the society is determined by the population of the society, the ratio of cooperator among immigrants, and the immigration interval. In addition, if immigrants have a preferential attachment link, the acceptable number of immigrants increases.
We investigate an evolutionary prisoner's dilemma game among self-driven agents, where collective motion of biological flocks is imitated through averaging directions of neighbors. Depending on the temptation to defect and the velocity at which agents move, we find that cooperation can not only be maintained in such a system but there exists an optimal size of interaction neighborhood, which can induce the maximum cooperation level. When compared with the case that all agents do not move, cooperation can even be enhanced by the mobility of individuals, provided that the velocity and the size o…
Evolutionary prisoner's dilemma games are studied with players located on square lattice and random regular graphs defining four neighbors for each one. The players follow one of the three strategies: tit-for-tat, unconditional cooperation, and defection. The simplified payoff matrix is characterized by two parameters: the temptation $b$ to choose defection, and the cost $c$ of inspection reducing the income of tit-for-tat. The strategy imitation from one of the neighbors is controlled by pairwise comparison at a fixed level of noise. Using Monte Carlo simulations and the extended versions of …
We investigate symmetric equilibria of mutual reinforcement learning when both players alternately learn the optimal memory-two strategies against the opponent in the repeated prisoners' dilemma game. We provide a necessary condition for memory-two deterministic strategies to form symmetric equilibria. We then provide three examples of memory-two deterministic strategies which form symmetric mutual reinforcement learning equilibria. We also prove that mutual reinforcement learning equilibria formed by memory-two strategies are also mutual reinforcement learning equilibria when both players use…
Here we study the effects of adopting different strategies against different opponent instead of adopting the same strategy against all of them in the prisoner dilemma structured in well-mixed populations. We consider an evolutionary process in which strategies that provide reproductive success are imitated and players replace one of their worst interactions by the new one. We set individuals in a well-mixed population so that network reciprocity effect is excluded and we analyze both synchronous and asynchronous updates. As a consequence of the replacement rule, we show that mutual cooperatio…
We study an evolutionary prisoner's dilemma game with two layered graphs, where the lower layer is the physical infrastructure on which the interactions are taking place and the upper layer represents the connections for the strategy adoption (learning) mechanism. This system is investigated by means of Monte Carlo simulations and an extended pair-approximation method. We consider the average density of cooperators in the stationary state for a fixed interaction graph, while varying the number of edges in the learning graph. According to the Monte Carlo simulations, the cooperation is modified…
We study the prisoner's dilemma model with a noisy imitation evolutionary dynamics on directed out-homogeneous and uncorrelated directed random networks. An heterogeneous pair mean-field approximation is presented showing good agreement with Monte Carlo simulations in the limit of weak selection (high noise) where we obtain analytical predictions for the critical temptations. We discuss the phase diagram as a function of temptation, intensity of noise and coordination number of the networks and we consider both the model with and without self-interaction. We compare our results with available …
The prisoner's dilemma game is the most known contribution of game theory into social sciences. Here we describe new implications of this game for transactional and transformative leadership. While the autocratic (Stackelberg's) leadership is inefficient for this game, we discuss a Pareto-optimal scenario, where the leader L commits to react probabilistically to pure strategies of the follower F, which is free to make the first move. Offering F to resolve the dilemma, L is able to get a larger average pay-off. The exploitation can be stabilized via repeated interaction of L and F, and turns to…
We address the problem of how the survival of cooperation in a social system depends on the motion of the individuals. Specifically, we study a model in which Prisoner's Dilemma players are allowed to move in a two-dimensional plane. Our results show that cooperation can survive in such a system provided that both the temptation to defect and the velocity at which agents move are not too high. Moreover, we show that when these conditions are fulfilled, the only asymptotic state of the system is that in which all players are cooperators. Our results might have implications for the design of coo…
We use replicator dynamics to study an iterated prisoners' dilemma game with memory. In this study, we investigate the characteristics of all 32 possible strategies with a single-step memory by observing the results when each strategy encounters another one. Based on these results, we define similarity measures between the 32 strategies and perform a network analysis of the relationship between the strategies by constructing a strategies network. Interestingly, we find that a win-lose circulation, like rock-paper-scissors, exists between strategies and that the circulation results from one unu…
The lowest temptation level (T = 1) is considered a trivial case for the Prisoner's Dilemma. Here, we show that this statement is true only for a very particular case, where the players interact with only one player. Otherwise, if the players interact with more than one player, the system presents the same possible behaviors observed for $T > 1$. In the steady state, the system can reach the cooperative, chaotic or defective phases, when adopting the Darwinian Evolutionary Strategy and the cooperative or quasi-regular phases, adopting the Pavlovian Evolutionary Strategy.
We study co-evolutionary Prisoner's Dilemma games where each player can imitate both the strategy and imitation rule from a randomly chosen neighbor with a probability dependent on the payoff difference when the player's income is collected from games with the neighbors. The players, located on the sites of a two-dimensional lattice, follow unconditional cooperation or defection and use individual strategy adoption rule described by a parameter. If the system is started from a random initial state then the present co-evolutionary rule drives the system towards a state where only one evolutiona…
We have studied the effect of memory on evolution of the prisoner's dilemma game using square lattice networks. Based on extensive simulations, we found that the density of cooperators was enhanced by an increasing memory effect for most parameters. However, we also observed that the density of cooperators decreased with an increased memory effect in the case of a large memory and moderate temptation. It is interesting to note that memory makes cooperators immune from temptation. The strength of protection reaches its maximal value only for the moderate memory effect.
Holding on to one's strategy is natural and common if the later warrants success and satisfaction. This goes against widespread simulation practices of evolutionary games, where players frequently consider changing their strategy even though their payoffs may be marginally different than those of the other players. Inspired by this observation, we introduce an aspiration-based win-stay-lose-learn strategy updating rule into the spatial prisoner's dilemma game. The rule is simple and intuitive, foreseeing strategy changes only by dissatisfied players, who then attempt to adopt the strategy of o…
We study a modified prisoner's dilemma game taking place on two-dimensional disordered square lattices. The players are pure strategists and can either cooperate or defect with their immediate neighbors. In the generations each player update its strategy by following one of the neighboring strategies with a probability dependent on the payoff difference. The neighbor selection obeys a dynamic preferential rule, i.e., the more frequently a neighbor's strategy was adopted by the focal player in the previous rounds, the larger probability it will be chosen to refer to in the subsequent rounds. It…
We introduce an analytical model to study the evolution towards equilibrium in spatial games, with `memory-aware' agents, i.e., agents that accumulate their payoff over time. In particular, we focus our attention on the spatial Prisoner's Dilemma, as it constitutes an emblematic example of a game whose Nash equilibrium is defection. Previous investigations showed that, under opportune conditions, it is possible to reach, in the evolutionary Prisoner's Dilemma, an equilibrium of cooperation. Notably, it seems that mechanisms like motion may lead a population to become cooperative. In the propos…
We study the evolution of cooperation in the prisoner's dilemma game, whereby a coevolutionary rule is introduced that molds the random topology of the interaction network in two ways. First, existing links are deleted whenever a player adopts a new strategy or its degree exceeds a threshold value, and second, new links are added randomly after a given number of game iterations. These coevolutionary processes correspond to the generic formation of new and deletion of existing links that, especially in human societies, appear frequently as a consequence of ongoing socialization, change of lifes…
We analyze an extended model of the Iterated Prisoner's Dilemma where agents decide to play based on the data from their limited memory or recommendations. The cooperators can decide whether to play with the matched opponent or not. The agents' decisions are directly linked to their level of optimism since they decide to play if they believe the opponent has a high probability of cooperating. Optimism is precisely tuned by parameters optimism threshold and tolerance. Our experiment showed that being optimistic is better for cooperators as it leads to more accurate exploration in the multi-agen…
The Prisoner's Dilemma game has a long history stretching across the social, biological, and physical sciences. In 2012, Press and Dyson developed a method for analyzing the mapping of the 8-dimensional strategy profile onto the 2-dimensional payoff space in an infinitely iterated Prisoner's Dilemma game, based on Markov chain analysis and memory-one strategies. We generalize this approach and introduce the concept of strategy parameter to show that linear relations among player payoffs are a ubiquitous feature of the infinitely iterated Prisoner's Dilemma game. Our extended analysis is applie…
When the interactions between cooperators (C) and defectors (D) can be partially avoided within a population, there may be an overall enhancement of cooperation. One example of such screening mechanism occurs in the presence of risk-averse agents (loners, L) that are neutral towards others, i.e., both L and its opponent, whatever its strategy, receive the same payoff. Their presence in the Prisoner's Dilemma (PD) game sustains the coexistence of cooperators and defectors far beyond the level attained in their absence. Another screening mechanism is a heterogeneous landscape obtained, for examp…
We investigate the win-lose relations between strategies of iterated prisoner's dilemma games by using a directed network concept to display the replicator dynamics results. In the giant strongly-connected component of the win/lose network, we find win-lose circulations similar to rock-paper-scissors and analyze the fixed point and its stability. Applying the network motif concept, we introduce dynamic motifs, which describe the population dynamics relations among the three strategies. Through exact enumeration, we find 22 dynamic motifs and display their phase portraits. Visualization using d…
We study the evolutionary Prisoner's Dilemma game on scale-free networks for different initial distributions. We consider three types of initial distributions for cooperators and defectors: initially random distribution with different frequencies of defectors; intentional organization with defectors initially occupying the most connected nodes with different fractions of defectors; intentional assignment for cooperators occupying the most connected nodes with different proportions of defectors at the beginning. It is shown that initial configurations for cooperators and defectors can influence…
This paper studies scenarios of cyclic dominance in a coevolutionary spatial model in which game strategies and links between agents adaptively evolve over time. The Optional Prisoner's Dilemma (OPD) game is employed. The OPD is an extended version of the traditional Prisoner's Dilemma where players have a third option to abstain from playing the game. We adopt an agent-based simulation approach and use Monte Carlo methods to perform the OPD with coevolutionary rules. The necessary conditions to break the scenarios of cyclic dominance are also investigated. This work highlights that cyclic dom…
The Iterated Prisoner's Dilemma (IPD) is a well studied framework for understanding direct reciprocity and cooperation in pairwise encounters. However, measuring the morality of various IPD strategies is still largely lacking. Here, we partially address this issue by proposing a suit of plausible morality metrics to quantify four aspects of justice. We focus our closed-form calculation on the class of reactive strategies because of their mathematical tractability and expressive power. We define reactive means as a tool for studying how actors in the IPD and Iterated Snowdrift Game (ISG) behave…
The conventional wisdom is that scale-free networks are prone to cooperation spreading. In this paper we investigate the cooperative behaviors on the structured scale-free network. On the contrary of the conventional wisdom that scale-free networks are prone to cooperation spreading, the evolution of cooperation is inhibited on the structured scale-free network while performing the prisoner's dilemma (PD) game. Firstly, we demonstrate that neither the scale-free property nor the high clustering coefficient is responsible for the inhibition of cooperation spreading on the structured scale-free …
The spatial Prisoner's Dilemma is a prototype model to show the emergence of cooperation in very competitive environments. It considers players, at site of lattices, that can either cooperate or defect when playing the Prisoner's Dilemma with other z players. This model presents a rich phase diagram. Here we consider players in cells of one-dimensional cellular automata. Each player interacts with other z players. This geometry allows us to vary, in a simple manner, the number of neighbors ranging from one up to the lattice size, including self-interaction. This approach has multiple advantage…
