arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.01557cs.MAcs.AIcs.LGcs.RO
收藏

面向动态网络桥接的分布式自主集群编队

Distributed Autonomous Swarm Formation for Dynamic Network Bridging

Institute for Human & Machine Cognition (IHMC)(人机认知研究所);The University of West Florida (UWF)(西佛罗里达大学);Fraunhofer Institute for Communication, Information Processing and Ergonomics (FKIE)(弗劳恩霍夫通信、信息处理与人体工程学研究所);US Army Research Laboratory (ARL)(美国陆军研究实验室)

Raffaele Galliera, Thies Möhlenhof, Alessandro Amato, Daniel Duran, Kristen Brent Venable, Niranjan Suri

AI总结:

本文在Dec-POMDP框架下形式化动态网络桥接问题,并提出基于图卷积强化学习DGN的多智能体强化学习方法,通过仿真和近LVC无人机框架验证其在分布式集群组网中的有效性。

摘要:

机器人系统的有效运行与无缝协作是下一代技术和应用的基础组成部分。在灾害响应等场景中,集群操作需要以分布式方式处理协调行为和移动控制,而智能体行动的质量在很大程度上依赖于它们之间的通信以及底层网络。在本文中,我们在一种新颖的分散式部分可观测马尔可夫决策过程(Dec-POMDP)中形式化了动态网络桥接问题,其中一组智能体协同工作,在两个远距离移动目标之间建立链路。此外,我们针对该问题提出了一种基于图卷积强化学习(DGN)的多智能体强化学习(MARL)方法,该方法天然适用于该任务的网络化、分布式特性。所提出的方法在仿真环境中进行了评估,并与集中式启发式基线进行了比较,显示出有前景的结果。此外,通过在近实况虚拟构造(LVC)无人机框架中额外评估所提出的方法,展示了向仿真到现实迁移方向迈出的进一步一步。

英文摘要:

Effective operation and seamless cooperation of robotic systems are a fundamental component of next-generation technologies and applications. In contexts such as disaster response, swarm operations require coordinated behavior and mobility control to be handled in a distributed manner, with the quality of the agents' actions heavily relying on the communication between them and the underlying network. In this paper, we formulate the problem of dynamic network bridging in a novel Decentralized Partially Observable Markov Decision Process (Dec-POMDP), where a swarm of agents cooperates to form a link between two distant moving targets. Furthermore, we propose a Multi-Agent Reinforcement Learning (MARL) approach for the problem based on Graph Convolutional Reinforcement Learning (DGN) which naturally applies to the networked, distributed nature of the task. The proposed method is evaluated in a simulated environment and compared to a centralized heuristic baseline showing promising results. Moreover, a further step in the direction of sim-to-real transfer is presented, by additionally evaluating the proposed approach in a near Live Virtual Constructive (LVC) UAV framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑