在多智能体系统中,降噪技术对于提高整个系统的可靠性非常重要,因为智能体需要依赖有限的环境信息来与周围的智能体开发合作和协调的行为。然而,以前的研究往往采用集中式降噪方法,在嘈杂的多智能体环境中建立强大的和通用的协调,而分布式和分散的自主智能体更合理的现实世界的应用。在本文中,我们介绍了一个\emph{distributed attentional actor architecture model for a multi-agent system}(DA 3-X),使用它,我们证明了与DA 3-X的代理可以有选择地学习噪声环境和合作行为。我们通过比较使用和不使用DA 3-X的学习方法来实验评估DA 3-X的有效性,并表明使用DA 3-X的代理可以比基线代理实现更好的性能。此外,我们可视化DA 3-X的\emph{attentional weights}热图,以分析决策过程和协调行为如何受到噪声的影响。
英文摘要:
In multi-agent systems, noise reduction techniques are important for improving the overall system reliability as agents are required to rely on limited environmental information to develop cooperative and coordinated behaviors with the surrounding agents. However, previous studies have often applied centralized noise reduction methods to build robust and versatile coordination in noisy multi-agent environments, while distributed and decentralized autonomous agents are more plausible for real-world application. In this paper, we introduce a \emph{distributed attentional actor architecture model for a multi-agent system} (DA3-X), using which we demonstrate that agents with DA3-X can selectively learn the noisy environment and behave cooperatively. We experimentally evaluate the effectiveness of DA3-X by comparing learning methods with and without DA3-X and show that agents with DA3-X can achieve better performance than baseline agents. Furthermore, we visualize heatmaps of \emph{attentional weights} from the DA3-X to analyze how the decision-making process and coordinated behavior are influenced by noise.
KnowPC: Knowledge-Driven Programmatic Reinforcement Learning for Zero-shot Coordination
State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China(中国科学技术大学认知智能国家重点实验室);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
HAVEN: Hierarchical Cooperative Multi-Agent Reinforcement Learning with Dual Coordination Mechanism
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task
Montreal Neurological Institute and Hospital(蒙特利尔神经学研究所与医院);Sorbonne Universités, UPMC Univ Paris 06(索邦大学,巴黎第六大学(UPMC));CNRS(法国国家科学研究中心);University of Lyon(里昂大学);Université Claude Bernard Lyon 1(里昂第一大学(克洛德·贝尔纳大学));INSERM(法国国家健康与医学研究院);Stem Cell and Brain Research Institute U1208(干细胞与脑研究所 U1208)
Intelligent Coordination among Multiple Traffic Intersections Using Multi-Agent Reinforcement Learning
Siemens Technology and Services Pvt. Ltd.(西门子技术服务私人有限公司);International Institute of Information Technology Hyderabad(海得拉巴国际信息技术学院);Indian Institute of Science Bengaluru(班加罗尔印度科学研究所)
HAMMER: Multi-Level Coordination of Reinforcement Learning Agents via Learned Messaging
IIIT-Bangalore(班加罗尔国际信息技术研究所);Ericsson Research(爱立信研究院);IIT-BHU(贝拿勒斯印度教大学印度理工学院);University of Alberta(阿尔伯塔大学);Alberta Machine Intelligence Institute (Amii)(阿尔伯塔机器智能研究所)
An Automated Reinforcement Learning Reward Design Framework with Large Language Model for Cooperative Platoon Coordination
Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University(上海智能自主系统研究院,同济大学);Department of Control Science and Engineering, Tongji University(控制科学与工程系,同济大学)
Strategic Maneuver and Disruption with Reinforcement Learning Approaches for Multi-Agent Coordination
DEVCOM Army Research Laboratory(DEVCOM陆军研究实验室);Army Research Laboratory-Research Associateship Program(陆军研究实验室研究副研究员项目);University of Colorado Boulder(科罗拉多大学博尔德分校)
Silo-Bench: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systems
Beijing University of Technology(北京理工大学);Zhejiang University(浙江大学);ETH Zürich(苏黎世联邦理工学院);Meituan LongCat Interaction Team(美团LongCat交互团队);Vector Institute for Artificial Intelligence(人工智能向量研究所)
A Model-Based Solution to the Offline Multi-Agent Reinforcement Learning Coordination Problem
Mila - Quebec AI Institute(魁北克人工智能研究所);McGill University(麦吉尔大学);University of Oxford(牛津大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);Meta AI - FAIR(Meta AI 基础人工智能研究团队)