从非实时的交互建模社会惯例的形成
Modeling the Formation of Social Conventions from Embodied Real-Time Interactions
摘要:
实时的【形】控制和学习在社会习俗形成中的作用是什么?为了回答这个问题,我们提出了一个计算模型,在一个社会决策的游戏,分析了在离散时间和连续时间设置匹配人类的行为数据。此外,与以前的方法不同,我们的模型考虑了感觉运动控制回路在具体决策场景中的作用。为此,我们引入了基于控制的强化学习(CRL)模型。CRL基于心智和大脑的分布式自适应控制(DAC)理论,其中低级感觉运动控制通过分层结构中的感知和行为学习进行调制。CRL遵循这些原则,实现了一个处理代理反应行为(预连线反射)的反馈控制回路,以及一个使用强化学习来最大化长期奖励的自适应层。我们测试我们的模型在多代理博弈论的任务,其中必须实现协调,以找到最佳的解决方案。我们表明,CRL是能够达到人类水平的性能标准的博弈论指标,如效率在获取奖励和公平的奖励分配。
英文摘要:
What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore, unlike previous approaches, our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios. For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learning in a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent's reactive behaviors (pre-wired reflexes), along with an adaptive layer that uses reinforcement learning to maximize long-term reward. We test our model in a multi-agent game-theoretic task in which coordination must be achieved to find an optimal solution. We show that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。