ViPlanner:用于局部导航的视觉语义命令学习
ViPlanner: Visual Semantic Imperative Learning for Local Navigation
AI总结:
ViPlanner提出一种基于视觉语义命令学习的局部导航规划方法,利用可微分语义代价地图实现端到端训练,在仿真中训练并零样本迁移到真实环境,相比几何方法可通行性代价降低38.02%。
摘要:
在户外环境中进行实时路径规划仍然对现代机器人系统构成挑战,这归因于地形可通行性的差异、多样化的障碍物以及快速决策的必要性。已有的方法主要集中于几何导航解决方案,这些方法对于结构化几何障碍物效果良好,但在不同地形类型及其可通行属性的语义解释方面存在局限性。此外,这些方法无法识别可通行的几何结构,例如楼梯。为克服这些问题,我们引入了ViPlanner,一种基于几何和语义信息生成局部规划的学习型局部路径规划方法。该系统采用命令学习范式进行训练,其中网络权重基于规划任务目标进行端到端优化。该优化利用可微分的语义代价地图公式,使规划器能够区分不同地形的可通行性并准确识别障碍物。语义信息以30个类别使用RGB色彩空间表示,该色彩空间能有效编码多个可通行性级别。我们展示了该规划器能够适应多样化的真实世界环境,而无需任何真实世界训练。事实上,该规划器完全在仿真中训练,从而实现了高度可扩展的训练数据生成。实验结果表明,该方法具有抗噪声能力、零样本仿真到现实迁移能力,并且与纯几何方法相比,可通行性代价降低了38.02%。代码和模型已公开提供:https://github.com/leggedrobotics/viplanner。
英文摘要:
Real-time path planning in outdoor environments still challenges modern robotic systems due to differences in terrain traversability, diverse obstacles, and the necessity for fast decision-making. Established approaches have primarily focused on geometric navigation solutions, which work well for structured geometric obstacles but have limitations regarding the semantic interpretation of different terrain types and their affordances. Moreover, these methods fail to identify traversable geometric occurrences, such as stairs. To overcome these issues, we introduce ViPlanner, a learned local path planning approach that generates local plans based on geometric and semantic information. The system is trained using the Imperative Learning paradigm, for which the network weights are optimized end-to-end based on the planning task objective. This optimization uses a differentiable formulation of a semantic costmap, which enables the planner to distinguish between the traversability of different terrains and accurately identify obstacles. The semantic information is represented in 30 classes using an RGB colorspace that can effectively encode the multiple levels of traversability. We show that the planner can adapt to diverse real-world environments without requiring any real-world training. In fact, the planner is trained purely in simulation, enabling a highly scalable training data generation. Experimental results demonstrate resistance to noise, zero-shot sim-to-real transfer, and a decrease of 38.02% in terms of traversability cost compared to purely geometric-based approaches. Code and models are made publicly available: https://github.com/leggedrobotics/viplanner.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。