arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.04730cs.RO

IR2:稀疏间歇连通性下机器人探索团队的隐式会合

IR2: Implicit Rendezvous for Robotic Exploration Teams under Sparse Intermittent Connectivity

Department of Mechanical Engineering, College of Design and Engineering, National University of Singapore(机械工程系,设计与工程学院,新加坡国立大学);Singapore Technologies Engineering Ltd(新加坡科技工程有限公司)

Derek Ming Siang Tan, Yixiao Ma, Jingsong Liang, Yi Cheng Chng, Yuhong Cao, Guillaume Sartoretti

AI总结:

针对多机器人探索中稀疏间歇连通下的信息共享低效问题,提出基于深度强化学习的IR2方法,结合注意力网络、课程学习与分层图结构,在仿真中较基线缩短6.6%-34.1%探索路径并完成硬件部署。

摘要:

在时间敏感的现实多机器人探索任务中,信息共享至关重要,尤其是在大规模环境中作业的小型机器人团队,其通信连接可能稀疏且间歇。现有方法通常假设不切实际的全局连通性,从而忽略了这类通信约束。其他研究虽考虑了通信约束(通过在信息交换时保持近距离或视线接触实现),但效率往往较低。例如,预规划会合方法通常会因会合时机不当而产生不必要的绕行,而基于追踪的方法则因贪婪特性常导致短视决策。我们提出IR2,一种用于多机器人探索信息共享的深度强化学习方法。借助通过强化学习与课程学习训练的基于注意力的神经网络,IR2让机器人能够有效权衡长期收益:断开连接独自探索,或是重新连接共享信息。此外,我们提出一种分层图构建方法,用于维持稀疏但信息丰富的图结构,使该方法可扩展至大规模环境。我们在三个大规模Gazebo环境中开展了仿真实验,结果表明,与当前最优基线方法相比,我们的方法将探索路径缩短了6.6%-34.1%,最后我们还将训练得到的策略部署到了硬件上。我们的仿真训练与测试代码可在https://ir2-explore.github.io获取。

英文摘要:

Information sharing is critical in time-sensitive and realistic multi-robot exploration, especially for smaller robotic teams in large-scale environments where connectivity may be sparse and intermittent. Existing methods often overlook such communication constraints by assuming unrealistic global connectivity. Other works account for communication constraints (by maintaining close proximity or line of sight during information exchange), but are often inefficient. For instance, preplanned rendezvous approaches typically involve unnecessary detours resulting from poorly timed rendezvous, while pursuit-based approaches often result in short-sighted decisions due to their greedy nature. We present IR2, a deep reinforcement learning approach to information sharing for multi-robot exploration. Leveraging attention-based neural networks trained via reinforcement and curriculum learning, IR2 allows robots to effectively reason about the longer-term trade-offs between disconnecting for solo exploration and reconnecting for information sharing. In addition, we propose a hierarchical graph formulation to maintain a sparse yet informative graph, enabling our approach to scale to large-scale environments. We present simulation results in three large-scale Gazebo environments, which show that our approach yields 6.6-34.1% shorter exploration paths when compared to state-of-the-art baselines, and lastly deploy our learned policy on hardware. Our simulation training and testing code is available at https://ir2-explore.github.io.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑