arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.11710cs.MA
收藏

基于上下文感知的深度Q网络的机器人群分布式协作侦察

Context-Aware Deep Q-Network for Decentralized Cooperative Reconnaissance by a Robotic Swarm

Nishant Mohanty, Mohitvishnu S. Gadde, Suresh Sundaram, Narasimhan Sundararajan, P. B. Sujit

摘要:

机器人群体作战的关键问题之一是在未知和不确定的环境中搜索和压制异构目标,群体内没有任何通信。在这里,一些目标可以被单个机器人压制,而另一些则需要多个机器人以特定的顺序来压制它们。由于可扩展性和信息的不确定性,限制了机器人对群体和目标分布的感知,问题变得复杂。在本文中,这个问题是通过提出一种新的上下文感知的深度Q网络(CA-DQN)框架来解决的,以获得在群中的机器人之间的通信自由合作。每个机器人保持一个自适应的网格表示附近的上下文信息嵌入其中,以保持群体完整,同时搜索和中和的目标。问题公式化使用强化学习框架,其中两个深度Q网络(DQN)分别处理“冲突”和“无冲突”场景。基于自参与的方法被用来确定DQN的最优策略。Monte-Carlo仿真和比较研究与国家的最先进的联盟形成算法进行验证的性能CA-DQN与不同的环境参数。结果表明,该方法对检测到的目标数和群中机器人的数目具有不变性。本文还提出了在实验室环境中使用地面机器人的不同场景的CA-DQN的实时实现,以演示CA-DQN与低功耗计算设备的工作。

英文摘要:

One of the crucial problems in robotic swarm-based operation is to search and neutralize heterogeneous targets in an unknown and uncertain environment, without any communication within the swarm. Here, some targets can be neutralized by a single robot, while others need multiple robots in a particular sequence to neutralize them. The complexity in the problem arises due to the scalability and information uncertainty, which restricts the robot's awareness of the swarm and the target distribution. In this paper, this problem is addressed by proposing a novel Context-Aware Deep Q-Network (CA-DQN) framework to obtain communication free cooperation between the robots in the swarm. Each robot maintains an adaptive grid representation of the vicinity with the context information embedded into it to keep the swarm intact while searching and neutralizing the targets. The problem formulation uses a reinforcement learning framework where two Deep Q-Networks (DQNs) handle 'conflict' and 'conflict-free' scenarios separately. The self-play-in-based approach is used to determine the optimal policy for the DQNs. Monte-Carlo simulations and comparison studies with a state-of-the-art coalition formation algorithm are performed to verify the performance of CA-DQN with varying environmental parameters. The results show that the approach is invariant to the number of detected targets and the number of robots in the swarm. The paper also presents the real-time implementation of CA-DQN for different scenarios using ground robots in a laboratory environment to demonstrate the working of CA-DQN with low-power computing devices.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑