arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.06239cs.RO
收藏

面向真实世界的自主机器人导航开架系统

Open-Architecture End-to-End System for Real-World Autonomous Robot Navigation

Control/Robotics Research Laboratory (CRRL), Department of Electrical and Computer Engineering, NYU Tandon School of Engineering(控制/机器人研究实验室(CRRL),电气与计算机工程系,NYU塔恩顿工程学院)

Venkata Naren Devarakonda, Ali Umut Kaypak, Raktim Gautam Goswami, Naman Patel, Rooholla Khorrambakht, Prashanth Krishnamurthy, Farshad Khorrami

AI总结:

本文提出一种轻量级开架端到端系统,通过整合多组件实现四足机器人实时导航,利用自然语言任务和语义信息构建场景图,基于LLM生成动态计划,实现在多个室内环境中的零样本自主导航。

摘要:

使机器人能够自主导航未知、复杂和动态的真实世界环境面临诸多挑战,包括感知不完美、部分可观测性、定位不确定性以及安全约束。当前方法通常局限于仿真环境,其中这些挑战并不存在。本文提出了一种轻量级、开架的端到端系统,用于真实世界的机器人自主导航。具体而言,我们通过整合多个 onboard 组件,在四足机器人上部署了实时导航系统,这些组件通过 ROS2 通信。给定由自然语言指定的导航任务,系统将 onboard 感知数据与开放词汇语义融合,从持续更新的语义对象地图中构建层次化场景图。基于 LLM 的规划器利用这些图生成并适应多步骤计划,以适应场景的变化。通过在多个室内环境使用 Unitree Go2 四足机器人进行实验,我们展示了零样本真实世界自主导航,实现了超过 88% 的任务成功率,并提供了部署期间系统行为的分析。

英文摘要:

Enabling robots to autonomously navigate unknown, complex, and dynamic real-world environments presents several challenges, including imperfect perception, partial observability, localization uncertainty, and safety constraints. Current approaches are typically limited to simulations, where such challenges are not present. In this work, we present a lightweight, open-architecture, end-to-end system for real-world robot autonomous navigation. Specifically, we deploy a real-time navigation system on a quadruped robot by integrating multiple onboard components that communicate via ROS2. Given navigation tasks specified in natural language, the system fuses onboard sensory data for localization and mapping with open-vocabulary semantics to build hierarchical scene graphs from a continuously updated semantic object map. An LLM-based planner leverages these graphs to generate and adapt multi-step plans in real time as the scene evolves. Through experiments across multiple indoor environments using a Unitree Go2 quadruped, we demonstrate zero-shot real-world autonomous navigation, achieving over 88% task success, and provide analysis of system behavior during deployment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑