使用分布式软Actor Critic学习对象条件探索
Learning Object-conditioned Exploration using Distributed Soft Actor Critic
摘要:
对象导航被定义为在复杂的、未探索的环境中导航到给定标签的对象。在其一般形式中,这个问题给机器人技术带来了几个挑战:在搜索对象和低级控制时对未知环境进行语义探索。在这项工作中,我们研究了对象引导的探索和低级别的控制,并提出了一个端到端的训练导航策略,实现了0.68的成功率和0.58的SPL对看不见的,视觉上复杂的扫描真实的家园。我们提出了一种高度可扩展的非策略强化学习算法的实现,分布式Soft Actor Critic,它允许系统在8个GPU上在24小时内利用98M经验步骤。我们的系统学习控制差分驱动移动基地在模拟中,从机器人平台上常用的高维观测堆栈。学习的策略能够从现实环境中的纯经验中学习到对象引导的探索性行为和低级控制。
英文摘要:
Object navigation is defined as navigating to an object of a given label in a complex, unexplored environment. In its general form, this problem poses several challenges for Robotics: semantic exploration of unknown environments in search of an object and low-level control. In this work we study object-guided exploration and low-level control, and present an end-to-end trained navigation policy achieving a success rate of 0.68 and SPL of 0.58 on unseen, visually complex scans of real homes. We propose a highly scalable implementation of an off-policy Reinforcement Learning algorithm, distributed Soft Actor Critic, which allows the system to utilize 98M experience steps in 24 hours on 8 GPUs. Our system learns to control a differential drive mobile base in simulation from a stack of high dimensional observations commonly used on robotic platforms. The learned policy is capable of object-guided exploratory behaviors and low-level control learned from pure experiences in realistic environments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。