arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.08327cs.ROcs.AI
收藏

安全的异构多智能体强化学习与通信正则化用于协同目标获取

Safe Heterogeneous Multi-Agent RL with Communication Regularization for Coordinated Target Acquisition

Department of Computer Science, Electrical and Space Engineering, Luleå University of Technology, Luleå, Sweden.(计算机科学与空间工程系,卢勒奥技术大学,卢勒奥,瑞典)

Gabriele Calzolari, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos

AI总结:

本文提出了一种安全的异构多智能体强化学习框架,通过通信正则化和安全过滤器实现协同目标获取任务中的安全与稳定执行。

摘要:

本文介绍了一种去中心化的多智能体强化学习框架,使结构上异质的智能体团队能够共同发现和获取随机位置的目标,在部分可观测、通信限制和动态交互的环境中。每个智能体的策略均采用多智能体近端策略优化算法,并采用图注意力网络编码器,将模拟的测距数据与邻近智能体之间交换的通信嵌入整合在一起,从而实现从本地感知和关系信息中进行上下文感知的决策。特别地,本文提出了一种统一的框架,整合了基于图的通信和轨迹感知的安全性,通过安全过滤器实现。该架构由一种结构化的奖励公式支持,旨在鼓励有效的目标发现和获取、碰撞避免以及智能体通信向量之间的去相关性,通过促进信息正交性。所提出奖励函数的有效性通过全面的消融研究得到验证。此外,仿真结果证明了安全且稳定的任务执行,证实了该框架的有效性。

英文摘要:

This paper introduces a decentralized multi-agent reinforcement learning framework enabling structurally heterogeneous teams of agents to jointly discover and acquire randomly located targets in environments characterized by partial observability, communication constraints, and dynamic interactions. Each agent's policy is trained with the Multi-Agent Proximal Policy Optimization algorithm and employs a Graph Attention Network encoder that integrates simulated range-sensing data with communication embeddings exchanged among neighboring agents, enabling context-aware decision-making from both local sensing and relational information. In particular, this work introduces a unified framework that integrates graph-based communication and trajectory-aware safety through safety filters. The architecture is supported by a structured reward formulation designed to encourage effective target discovery and acquisition, collision avoidance, and de-correlation between the agents' communication vectors by promoting informational orthogonality. The effectiveness of the proposed reward function is demonstrated through a comprehensive ablation study. Moreover, simulation results demonstrate safe and stable task execution, confirming the framework's effectiveness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑