arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.20436stat.MLcs.LG

基于图注意力多智能体强化学习的月球延迟容忍网络分散式路由策略学习

Learning Decentralized Routing Policies via Graph Attention-based Multi-Agent Reinforcement Learning in Lunar Delay-Tolerant Networks

Telecommunications Research Institute, University of Málaga(马德里大学电信研究所);Jet Propulsion Laboratory, California Institute of Technology(加州理工学院喷气推进实验室);Department of Mechanical Engineering, Johns Hopkins University(约翰霍普金斯大学机械工程系)

Federico Lozano-Cuadra, Beatriz Soret, Marc Sanchez Net, Abhishek Cauligi, Federico Rossi

AI总结:

针对月球延迟容忍网络中的多机器人探索,提出基于图注意力多智能体强化学习的分散式路由策略,采用集中训练分散执行,仅依赖局部观测,在蒙特卡洛模拟中实现更高投递率、无重复和更少丢包,并可扩展至更大团队。

摘要:

我们提出了一种完全分散式的路由框架,用于在月球延迟容忍网络(LDTN)约束下执行多机器人探索任务。在此场景中,自主漫游车必须在间歇性连接和未知移动模式下,将收集到的数据中继传输至着陆器。我们将该问题建模为部分可观测马尔可夫决策问题(POMDP),并提出一种基于图注意力的多智能体强化学习(GAT-MARL)策略,该策略采用集中式训练、分散式执行(CTDE)范式。与最短路径和受控泛洪等经典算法不同,我们的方法仅依赖局部观测,无需全局拓扑更新或数据包复制。通过在随机探索环境中的蒙特卡洛模拟,GAT-MARL实现了更高的投递率、无重复数据包和更少的丢包,并能利用短期移动性预测;该方法为未来行星探索的空间机器人系统提供了可扩展的解决方案,并成功泛化至更大规模的漫游车团队。

英文摘要:

We present a fully decentralized routing framework for multi-robot exploration missions operating under the constraints of a Lunar Delay-Tolerant Network (LDTN). In this setting, autonomous rovers must relay collected data to a lander under intermittent connectivity and unknown mobility patterns. We formulate the problem as a Partially Observable Markov Decision Problem (POMDP) and propose a Graph Attention-based Multi-Agent Reinforcement Learning (GAT-MARL) policy that performs Centralized Training, Decentralized Execution (CTDE). Our method relies only on local observations and does not require global topology updates or packet replication, unlike classical approaches such as shortest path and controlled flooding-based algorithms. Through Monte Carlo simulations in randomized exploration environments, GAT-MARL provides higher delivery rates, no duplications, and fewer packet losses, and is able to leverage short-term mobility forecasts; offering a scalable solution for future space robotic systems for planetary exploration, as demonstrated by successful generalization to larger rover teams.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑