This paper investigates the problem of cooperative tuning of multi-agent optimal control systems, where a network of agents (i.e. multiple coupled optimal control systems) adjusts parameters in their dynamics, objective functions, or controllers in a coordinated way to minimize the sum of their loss functions. Different from classical techniques for tuning parameters in a controller, we allow tunable parameters appearing in both the system dynamics and the objective functions of each agent. A framework is developed to allow all agents to reach a consensus on the tunable parameter, which minimizes team loss. The key idea of the proposed algorithm rests on the integration of consensus-based distributed optimization for a multi-agent system and a gradient generator capturing the optimal performance as a function of the parameter in the feedback loop tuning the parameter for each agent. Both theoretical results and simulations for a synchronous multi-agent rendezvous problem are provided to validate the proposed method for cooperative tuning of multi-agent optimal control.
Cooperative Task Planning of Multi-Agent Systems Under Timed Temporal Specifications
ACCESS Linnaeus Center, School of Electrical Engineering, KTH Royal Institute of Technology(林奈中心电气工程学院,皇家理工学院);KTH Centre for Autonomous Systems(皇家理工学院自主系统中心)
McGill University(麦吉尔大学);Mila;Université de Montréal(蒙特利尔大学);DeepMind
在本文中,我们研究学习时间抽象的合作多智能体系统,使用的选项框架(萨顿等,1999年)。首先,我们解决的分散POMDP的多智能体系统所代表的规划问题,通过引入一个\emph{common information approach}。我们使用\emph{common beliefs}和广播的概念来解决一个等价的集中式POMDP问题。然后,我们提出了分布式期权评价(DOC)算法,它使用集中式期权评价和分散式期权内改进。我们从理论上分析了DOC的渐近收敛性,并建立了一个新的多智能体环境,以证明其有效性。我们的实验经验表明,DOC执行竞争力对基线和规模的代理商的数量。
A Cooperative Multi-Agent Probabilistic Framework for Search and Track Missions
KIOS Research and Innovation Center of Excellence(KIOS卓越研究与创新中心);Department of Electrical and Computer Engineering, University of Cyprus(塞浦路斯大学电气与计算机工程系)
MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotion
Faculty of Robot Science and Engineering, Northeastern University(机器人科学与工程学院,东北大学);Guangdong Key Laboratory of Intelligent Morphing Mechanisms and Adaptive Robotics and School of Intelligence Science and Engineering, the Harbin Institute of Technology Shenzhen(智能变形机制与适应机器人重点实验室和智能科学与工程学院,哈尔滨工业大学深圳)