In Evolutionary Dynamics the understanding of cooperative phenomena in natural and social systems has been the subject of intense research during decades. We focus attention here on the so-called "Lattice Reciprocity" mechanisms that enhance evolutionary survival of the cooperative phenotype in the Prisoner's Dilemma game when the population of darwinian replicators interact through a fixed network of social contacts. Exact results on a "Dipole Model" are presented, along with a mean-field analysis as well as results from extensive numerical Monte Carlo simulations. The theoretical framework used is that of standard Statistical Mechanics of macroscopic systems, but with no energy considerations. We illustrate the power of this perspective on social modeling, by consistently interpreting the onset of lattice reciprocity as a thermodynamical phase transition that, moreover, cannot be captured by a purely mean-field approach.
Indirect reciprocity based on reputation is a leading mechanism driving human cooperation, where monitoring of behaviour and sharing reputation-related information are crucial. Because collecting information is costly, a tragedy of the commons can arise, with some individuals free-riding on information supplied by others. This can be overcome by organising monitors that aggregate information, supported by fees from their information users. We analyse a co-evolutionary model of individuals playing a social dilemma game and monitors watching them; monitors provide information and players vote fo…
Recent studies suggest that the emergence of cooperative behavior can be explained by generalized reciprocity, a behavioral mechanism based on the principle of "help anyone if helped by someone". In complex systems, the cooperative dynamics is largely determined by the network structure which dictates the interactions among neighboring individuals. Despite an abundance of studies, the role of the network structure in in promoting cooperation through generalized reciprocity remains an under-explored phenomenon. In this doctoral thesis, we utilize basic tools from the dynamical systems theory, a…
Indirect reciprocity in which players cooperate with unacquainted other players having good reputations is a mechanism for cooperation in relatively large populations subjected to social dilemma situations. When the population has group structure, as is often found in social networks, players in experiments are considered to show behavior that deviates from existing theoretical models of indirect reciprocity. First, players often show ingroup favoritism (i.e., cooperation only within the group) rather than full cooperation (i.e., cooperation within and across groups), even though the latter is…
The success of modern civilization is built upon widespread cooperation in human society, deciphering the mechanisms behind has being a major goal for centuries. A crucial fact is, however, largely missing in most prior studies that games in the real world are typically played simultaneously and interactively rather than separately as assumed. Here we introduce the idea of interacting games that different games coevolve and influence each other's decision-making. We show that as the game-game interaction becomes important, the cooperation phase transition dramatically improves, a fairly high l…
Learning to cooperate in a changing world: How caring about the future promotes cooperation across scales
Beihang University（北京航空航天大学）；Zhongguancun Laboratory（中关村实验室）；Hangzhou International Innovation Institute, Beihang University（北京航空航天大学杭州创新研究院）；Key Laboratory of Mathematics, Informatics and Behavioral Semantics, Beihang University（北京航空航天大学数学、信息学与行为语义重点实验室）；Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University（北京航空航天大学未来区块链与隐私计算高级创新中心）；Beijing Academy of Blockchain and Edge Computing（北京区块链与边缘计算研究院）
Upstream reciprocity (also called generalized reciprocity) is a putative mechanism for cooperation in social dilemma situations with which players help others when they are helped by somebody else. It is a type of indirect reciprocity. Although upstream reciprocity is often observed in experiments, most theories suggest that it is operative only when players form short cycles such as triangles, implying a small population size, or when it is combined with other mechanisms that promote cooperation on their own. An expectation is that real social networks, which are known to be full of triangles…
Although various norms for reciprocity-based cooperation have been suggested that are evolutionarily stable against invasion from free riders, the process of alternation of norms and the role of diversified norms remain unclear in the evolution of cooperation. We clarify the co-evolutionary dynamics of norms and cooperation in indirect reciprocity and also identify the indispensable norms for the evolution of cooperation. Inspired by the gene knockout method, a genetic engineering technique, we developed the norm knockout method and clarified the norms necessary for the establishment of cooper…
Many biological and social systems show significant levels of collective action. Several cooperation mechanisms have been proposed, yet they have been mostly studied independently. Among these, direct reciprocity supports cooperation on the basis of repeated interactions among individuals. Signals and quorum dynamics may also drive cooperation. Here, we resort to an evolutionary game theoretical model to jointly analyse these two mechanisms and study the conditions in which evolution selects for direct reciprocity, signalling, or their combination. We show that signalling alone leads to higher…
In the study of the evolution of cooperation, many mechanisms have been proposed to help overcome the self-interested cheating that is individually optimal in the Prisoners' Dilemma game. These mechanisms include assortative or networked social interactions, other-regarding preferences considering the payoffs of others, reciprocity rules to establish cooperation as a social norm, and multilevel selection involving simultaneous competition between individuals favoring cheaters and competition between groups favoring cooperators. In this paper, we build on recent work studying PDE replicator equ…
Evolutionary game theory predicts that cooperation in social dilemma games is promoted when agents are connected as a network. However, when networks are fixed over time, humans do not necessarily show enhanced mutual cooperation. Here we show that reinforcement learning (specifically, the so-called Bush-Mosteller model) approximately explains the experimentally observed network reciprocity and the lack thereof in a parameter region spanned by the benefit-to-cost ratio and the node's degree. Thus, we significantly extend previously obtained numerical results.
The nodes of a regular two-dimensional lattice play a game based on the joint action of two distinct levels. At the first step of the game, using a random prescription half players are assigned the cooperation and half the defection state. At the bottom level the strategy choice is done on the mere basis of imitation according to the homo imitans principle, generating a form of collective intelligence that makes the system sensitive to the criteria determining the strategy choice adopted at the top level. The units of the top level, in fact, play the prisoner's dilemma game and are allowed to …
Incomplete Reputation Information and Punishment in Indirect Reciprocity
Pukyong National University（釜庆国立大学）；RIKEN Center for Interdisciplinary Theoretical and Mathematical Science (iTHEMS)（理化学研究所交叉理论数学科学中心（iTHEMS））；RIKEN Center for Computational Science（理化学研究所计算科学中心）
The network reciprocity is an important dynamic rule fostering the emergence of cooperation among selfish individuals. This was reported firstly in the seminal work of Nowak and May, where individuals were arranged on the regular lattice network, and played the prisoner's dilemma game (PDG). In the standard PDG, one often assumes that the players have perfect rationality. However, in reality, we human are far from rational agents, as we often make mistakes, and behave irrationally. Accordingly, in this work, we introduce the element of noise into the measurement of fitness, which is determined…
Cooperation can be supported by indirect reciprocity via reputation.Thanks to gossip, reputations are built and circulated and humans can identify defectors and ostracise them. However, the evolutionary stability of gossip is allegedly undermined by the fact that it is more error-prone that direct observation, whereas ostracism could be ineffective if the partner selection mechanism is not robust. The aim of this work is to investigate the conditions under which the combination of gossip and ostracism might support cooperation in groups of different sizes. We are also interested in exploring t…
Recent research has identified the heterogeneity as crucial for the evolution of cooperation in spatial population. However, the influence of heterogeneous noise is still lack. Inspired by this interesting question, in this work, we try to incorporate heterogeneous noise into the evaluation of utility, where only a proportion of population possesses noise, whose range can also be tuned. We find that increasing heterogeneous noise monotonously promotes cooperation and even translates the full defection phase (of the homogeneous version) into the complete cooperation phase. Moreover, the promoti…
We study the evolutionary Prisoner's Dilemma game on scale-free networks for different initial distributions. We consider three types of initial distributions for cooperators and defectors: initially random distribution with different frequencies of defectors; intentional organization with defectors initially occupying the most connected nodes with different fractions of defectors; intentional assignment for cooperators occupying the most connected nodes with different proportions of defectors at the beginning. It is shown that initial configurations for cooperators and defectors can influence…
In this paper three computational models for the study of the evolution of cooperation under cultural propagation are studied: Kin Selection, Direct Reciprocity and Indirect Reciprocity. Two analyzes are reported, one comparing their behavior between them and a second one identifying the impact that different parameters have in the model dynamics. The results of these analyzes illustrate how game transitions may occur depending of some parameters within the models and also explain how agents adapt to these transitions by individually choosing their attachment to a cooperative attitude. These p…
Eco-evolutionary game dynamics which characterizes the mutual interactions and the coupled evolutions of strategies and environments has been of growing interests in very recent years. Since such feedback loops widely exist in a range of coevolutionary systems, such as microbial systems, social-ecological system and psychological-economic system, recent modeling frameworks that unveil the oscillating dynamics of social dilemmas have great potential for practical applications. In this perspective article, we overview the latest progress of evolutionary game theory in this direction. We describe…
The evolution of cooperation among unrelated individuals in human and animal societies remains a challenging issue across disciplines. It is an important subject also in the evolutionary game theory to research how cooperation arises. The subject has been extensively studied especially in Prisonars' dilemma game(PD) and the emergence of cooperation is important subject also in public goods game(PGG). In this article, we consider evolutionary PGG on complex networks where the topology of the networks varies under the infulence of game dynamics. Then we study what effects on the evolution of pla…
We study the evolution of two mutually interacting games with both pairwise games as well as the public goods game on different topologies. On 2d square lattices, we reveal that the game-game interaction can promote the cooperation prevalence in all cases, and the cooperation-defection phase transitions even become absent and fairly high cooperation is expected when the interaction goes to be very strong. A mean-field theory is developed that points out new dynamical routes arising therein. Detailed analysis shows indeed that there are rich categories of interactions in either individual or bu…
The effects of networking on the extent of cooperation emerging in a competitive setting are studied. The evolutionary snowdrift game, which represents a realistic alternative to the well-known Prisoner's Dilemma, is studied in the Watts-Strogatz network that spans the regular, small-world, and random networks through random re-wiring. Over a wide range of payoffs, a re-wired network is found to suppress cooperation when compared with a well-mixed or fully connected system. Two extinction payoffs, that characterize the emergence of a homogeneous steady state, are identified. It is found that, …
How cooperation emerges in human societies is both an evolutionary enigma, and a practical problem with tangible implications for societal health. Population structure has long been recognized as a catalyst for cooperation because local interactions enable reciprocity. Analysis of this phenomenon typically assumes bi-directional social interactions, even though real-world interactions are often uni-directional. Uni-directional interactions -- where one individual has the opportunity to contribute altruistically to another, but not conversely -- arise in real-world populations as the result of …
Reputation is one of key mechanisms to maintain human cooperation, but its analysis gets complicated if we consider the possibility that reputation does not reach consensus because of erroneous assessment. The difficulty is alleviated if we assume that reputation and cooperation do not take binary values but have continuous spectra so that disagreement over reputation can be analysed in a perturbative way. In this work, we carry out the analysis by expanding the dynamics of reputation to the second order of perturbation under the assumption that everyone initially cooperates with good reputati…
University of Pennsylvania（宾夕法尼亚大学）；RIKEN Center for Interdisciplinary Theoretical and Mathematical Science (iTHEMS)（理化学研究所交叉理论与数学科学中心(iTHEMS)）；RIKEN Center for Computational Science（理化学研究所计算科学中心）；Saitama University（埼玉大学）
We show that the success of cooperation in an evolutionary prisoner's dilemma on a complex network can be predicted by a simple, quantitative network analysis using mean field parameters. The criterion is shown to be accurate on a wide variety of networks with degree distributions ranging from regular to Poisson to scale-free. The network analysis uses a parameter that allows for comparisons of networks with both similar, and distinct, topologies. Furthermore, we establish the criterion here as a natural network analogue of Hamilton's classical rule for kin selection, despite arising in an ent…
Using a new dynamical network model of society in which pairwise interactions are weighted according to mutual satisfaction, we show that cooperation is the norm in the Hawks-Doves game when individuals are allowed to break ties with undesirable neighbors and to make new acquaintances in their extended neighborhood. Moreover, cooperation is robust with respect to rather strong strategy perturbations. We also discuss the empirical structure of the emerging networks, and the reasons that allow cooperators to thrive in the population. Given the metaphorical importance of this game for social inte…
Indirect reciprocity is a major mechanism in the maintenance of cooperation among unrelated individuals. Indirect reciprocity leads to conditional cooperation according to social norms that discriminate the good (those who deserve to be rewarded with help) and the bad (those who should be punished by refusal of help). Despite intensive research, however, there is no definitive consensus on what social norms best promote cooperation through indirect reciprocity, and it remains unclear even how those who refuse to help the bad should be assessed. Here, we propose a new simple norm called "Stayin…
Indirect reciprocity is one of the major mechanisms of the evolution of cooperation. Because constant monitoring and accurate evaluation in moral assessments tend to be costly, indirect reciprocity can be exploited by cost evaders. A recent study crucially showed that a cooperative state achieved by indirect reciprocators is easily destabilized by cost evaders in the case with no supportive mechanism. Here, we present a simple and widely applicable solution that considers pre-assessment of cost evaders. In the pre-assessment, those who fail to pay for costly assessment systems are assigned a n…
We study an evolutionary prisoner's dilemma game with two layered graphs, where the lower layer is the physical infrastructure on which the interactions are taking place and the upper layer represents the connections for the strategy adoption (learning) mechanism. This system is investigated by means of Monte Carlo simulations and an extended pair-approximation method. We consider the average density of cooperators in the stationary state for a fixed interaction graph, while varying the number of edges in the learning graph. According to the Monte Carlo simulations, the cooperation is modified…
Besides the structure of interactions within networks, also the interactions between networks are of the outmost importance. We therefore study the outcome of the public goods game on two interdependent networks that are connected by means of a utility function, which determines how payoffs on both networks jointly influence the success of players in each individual network. We show that an unbiased coupling allows the spontaneous emergence of interdependent network reciprocity, which is capable to maintain healthy levels of public cooperation even in extremely adverse conditions. The mechanis…
We study the interplay between evolutionary game and network structure and show how the dynamics of the game affect the growth pattern of the network and how the evolution of the network influence the cooperative behavior in the game. Simulation results show that the payoff-based preferential attachment mechanism leads to the emergence of a scale-free structural property, $P(k)\sim k^{-γ}$. Moreover, we investigate the average path length and the assortative mixing features. The obtained results indicate that the network has small-world and positive assortative behaviors, which are consistent …
In this paper we extend the investigation of cooperation in some classical evolutionary games on populations were the network of interactions among individuals is of the scale-free type. We show that the update rule, the payoff computation and, to some extent the timing of the operations, have a marked influence on the transient dynamics and on the amount of cooperation that can be established at equilibrium. We also study the dynamical behavior of the populations and their evolutionary stability.
Many mechanisms for the emergence and maintenance of altruistic behavior in social dilemma situations have been proposed. Indirect reciprocity is one such mechanism, where other-regarding actions of a player are eventually rewarded by other players with whom the original player has not interacted. The upstream reciprocity (also called generalized indirect reciprocity) is a type of indirect reciprocity and represents the concept that those helped by somebody will help other unspecified players. In spite of the evidence for the enhancement of helping behavior by upstream reciprocity in rats and …
Evolution of cooperation is a widely studied problem in biology, social science, economics, and artificial intelligence. Most of the existing approaches that explain cooperation rely on some notion of direct or indirect reciprocity. These reciprocity based models assume agents recognize their partner and know their previous interactions, which requires advanced cognitive abilities. In this paper we are interested in developing a model that produces cooperation without requiring any explicit memory of previous game plays. Our model is based on the notion of, a concept introduced within behavior…
According to the evolutionary game theory principle, a strategy representing a higher payoff can spread among competitors. But there are cases when a player consistently overestimates or underestimates her own payoff, which undermines proper comparison. Interestingly, both underconfident and overconfident individuals are capable of elevating the cooperation level significantly. While former players stimulate a local coordination of strategies, the presence of overconfident individuals enhances the spatial reciprocity mechanism. In both cases the propagations of competing strategies are influen…
Understanding the origins of volunteerism and free-riding is crucial in collective action situations where a sufficient number of cooperators is necessary to achieve shared benefits, such as in vaccination campaigns and social change movements. Despite the importance of attaining behavior consistency for successful collective action, the theoretical mechanisms behind this process remain largely elusive. Here, we address this issue by studying the evolutionary dynamics of individual cooperativity levels in multi-round threshold public goods games. By using adaptive dynamics, we explore how indi…
In recent years, there has been growing interest in studying evolutionary games with environmental feedback. Previous studies exclusively focus on two-player games. However, extension to multi-player game is needed to study problems such as microbial cooperation and crowdsourcing collaborations. Here, we study coevolutionary public goods games where strategies coevolve with the multiplication factors of group cooperation. Asymmetry can arise in such environmental feedback, where games organized by focal cooperators may have a different efficiency than the ones by defectors. Our analysis shows …
Evolutionary Dynamics of Reputation-Based Voluntary Prisoner's Dilemma Games
Kyushu University（九州大学）；Teesside University（蒂斯赛德大学）；CSSC Systems Engineering Research Institute（中国船舶系统工程研究院）；CSSC Intelligent Innovation Research Institute（中国船舶智能创新研究院）；Yunnan University of Finance and Economics（云南财经大学）；University of Maribor（马里博尔大学）；Community Healthcare Center Dr. Adolf Drolc Maribor（马里博尔阿道夫·德罗尔克博士社区健康中心）；Kyung Hee University（庆熙大学）；Korea University（高丽大学）；Northwestern Polytechnical University（西北工业大学）
