arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1401.3465cs.GTcs.SIphysics.soc-ph
收藏

连续最后通牒博弈中的学习达成协议

Learning to Reach Agreement in a Continuous Ultimatum Game

Steven de Jong, Simon Uyttendaele, Karl Tuyls

摘要:

众所周知,根据经典博弈论的原则,以个人理性的方式行事可能会导致一类称为社会困境的问题的次优解决方案。相比之下,人类通常不会有太大的困难与社会困境,因为他们能够平衡个人利益和群体利益。由于多代理系统中的代理经常面临社会困境,例如在资源分配等任务中,这些代理可能会受益于被认为有利于人类公平的机制。虽然许多这样的机制已经实现了多智能体系统的情况下,他们的应用通常是有限的,而抽象的社会困境与一组离散的可用策略(通常是两个)。鉴于许多现实世界中的社会困境的例子实际上是连续的性质,我们将以前的工作扩展到更一般的困境,其中代理人在连续的策略空间中操作。在这里研究的社会困境是著名的最后通牒游戏,在其中,如果代理商同意一个共同的战略,实现了最佳的解决方案。我们调查无标度交互网络是否有助于代理商达成协议,特别是在存在代表期望结果(例如人类)的固定策略代理商的情况下。此外,我们还研究了交互网络中重布线的影响。智能体配备了连续动作学习自动机,并进行大量的随机配对游戏,以建立一个共同的战略。从我们的实验中,我们可以得出结论,在离散策略游戏中得到的结果可以推广到连续策略游戏在一定程度上:无标度的交互网络结构允许代理人达成协议的共同策略,并在交互网络中重新布线大大提高了代理人达成协议的能力。然而,也很明显,一些替代机制,如声誉和志愿服务,有许多微妙之处,在连续的情况下并没有令人信服的有益效果。

英文摘要:

It is well-known that acting in an individually rational manner, according to the principles of classical game theory, may lead to sub-optimal solutions in a class of problems named social dilemmas. In contrast, humans generally do not have much difficulty with social dilemmas, as they are able to balance personal benefit and group benefit. As agents in multi-agent systems are regularly confronted with social dilemmas, for instance in tasks such as resource allocation, these agents may benefit from the inclusion of mechanisms thought to facilitate human fairness. Although many of such mechanisms have already been implemented in a multi-agent systems context, their application is usually limited to rather abstract social dilemmas with a discrete set of available strategies (usually two). Given that many real-world examples of social dilemmas are actually continuous in nature, we extend this previous work to more general dilemmas, in which agents operate in a continuous strategy space. The social dilemma under study here is the well-known Ultimatum Game, in which an optimal solution is achieved if agents agree on a common strategy. We investigate whether a scale-free interaction network facilitates agents to reach agreement, especially in the presence of fixed-strategy agents that represent a desired (e.g. human) outcome. Moreover, we study the influence of rewiring in the interaction network. The agents are equipped with continuous-action learning automata and play a large number of random pairwise games in order to establish a common strategy. From our experiments, we may conclude that results obtained in discrete-strategy games can be generalized to continuous-strategy games to a certain extent: a scale-free interaction network structure allows agents to achieve agreement on a common strategy, and rewiring in the interaction network greatly enhances the agents ability to reach agreement. However, it also becomes clear that some alternative mechanisms, such as reputation and volunteering, have many subtleties involved and do not have convincing beneficial effects in the continuous case.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑