Navigation is one of the most heavily studied problems in robotics, and is conventionally approached as a geometric mapping and planning problem. However, real-world navigation presents a complex set of physical challenges that defies simple geometric abstractions. Machine learning offers a promising way to go beyond geometry and conventional planning, allowing for navigational systems that make decisions based on actual prior experience. Such systems can reason about traversability in ways that go beyond geometry, accounting for the physical outcomes of their actions and exploiting patterns in real-world environments. They can also improve as more data is collected, potentially providing a powerful network effect. In this article, we present a general toolkit for experiential learning of robotic navigation skills that unifies several recent approaches, describe the underlying design principles, summarize experimental results from several of our recent papers, and discuss open problems and directions for future work.
A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AI
Department of Computer Science, City University of Hong Kong(城市大学计算机科学系);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院);Department of Informatics, Universität Hamburg(汉堡大学信息学院)
Toward Autonomous Soft Robotic Endovascular Navigation via Imitation Learning
Johns Hopkins University(约翰霍普金斯大学);Stanford University(斯坦福大学);McGill University(麦吉尔大学);University of Maryland(马里兰大学);Swiss Federal Institute of Technology in Lausanne (EPFL)(日内瓦联邦理工学院(EPFL));ETH Zurich(苏黎世联邦理工学院)
VCN-Bench: A Video-Contextualized Navigation Benchmark for Spatial Reasoning over Prior Visual Experience
Tongji University(同济大学);Shanghai AI Laboratory(上海人工智能实验室);The University of Hong Kong(香港大学);Zhejiang University(浙江大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
SimWorld-Robotics: Synthesizing Photorealistic and Dynamic Urban Environments for Multimodal Robot Navigation and Collaboration
University of Virginia(弗吉尼亚大学);UC San Diego(加州大学圣地亚哥分校);Johns Hopkins University(约翰霍普金斯大学);Carnegie Mellon University(卡内基梅隆大学);University of Michigan(密歇根大学)
Human-Aware Robot Navigation via Reinforcement Learning with Hindsight Experience Replay and Curriculum Learning
The Chinese University of Hong Kong(香港中文大学);Southern University of Science and Technology(南方科技大学);Shenzhen Research Institute of the Chinese University of Hong Kong(香港中文大学深圳研究院)
Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Hong Kong University of Science and Technology(香港科技大学)
Vision-Language Procedural Reasoning for Context-Aware Reward Modeling of Robotic Endovascular Guidewire Navigation
Department of Control Science and Engineering, College of Electronic and Information Engineering, and Shanghai Institute of Intelligent Science and Technology, Tongji University(同济大学电子与信息工程学院控制科学与工程系,以及上海智能科学与技术研究院);Department of Electronic Engineering, Faculty of Engineering, The Chinese University of Hong Kong(香港中文大学工程学院电子工程系);Shanghai Operation Robot Co., Ltd.(上海微创医疗机器人(集团)股份有限公司)
Contact-Aided Navigation of Flexible Robotic Endoscope Using Deep Reinforcement Learning in Dynamic Stomach
Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong, China(电子工程系,香港中文大学(深圳)沙田分校,香港,中国);Department of Mechanical Engineering, Stanford University(机械工程系,斯坦福大学)
RoboRAN: A Unified Robotics Framework for Reinforcement Learning-Based Autonomous Navigation
Space Robotics Research Group, SnT University of Luxembourg(锡尔特大学卢森堡大学空间机器人研究组);Georgia Tech-Europe IRL2958(佐治亚理工学院欧洲分校IRL2958);GT-CNRS, Metz, France(GT-CNRS,法国梅茨);Earth Species Project(地球物种项目)
Where to Fetch: Extracting Visual Scene Representation from Large Pre-Trained Models for Robotic Goal Navigation
School of Control Science and Engineering, Shandong University(山东大学控制科学与工程学院);Campus Security Smart Brain Shandong Engineering Research Center(山东校园安全智能脑工程研究中心)
MAER-Nav: Bidirectional Motion Learning Through Mirror-Augmented Experience Replay for Robot Navigation
Hong Kong Polytechnic University(香港理工大学);Eastern Institute of Technology(宁波东方理工大学);National University of Singapore(新加坡国立大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))
HyperDCM: Dynamic Cluster Memory Replay in Hyperbolic Space for Continual Robotic Navigation Across Scenes
Software Engineering Institute, East China Normal University(华东师范大学软件工程学院);School of Geospatial Information, Information Engineering University(信息工程大学地理空间信息学院);University of Shanghai for Science and Technology(上海理工大学);Shanghai Jiao Tong University(上海交通大学)
Enhanced Robotic Navigation in Deformable Environments using Learning from Demonstration and Dynamic Modulation
Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich (TUM), Germany(慕尼黑机器人与机器智能研究所(MIRMI),慕尼黑技术大学(TUM));Mohamed Bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE(穆罕默德·本·扎耶德人工智能大学)