HM3D-M3: A Benchmark for Multi-Agent, Multi-Modal, Multi-Object Goal Navigation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);School of Computer Science, Nanjing University(南京大学计算机科学学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院);School of Electrical and Automation Engineering, Nanjing Normal University(南京师范大学电气与自动化工程学院)
Rapid progress in AI agents and robotics makes it a matter of the near future that humans are served by a team of robots. Such a team will receive several goals at once, each specified in whatever form is convenient for the human, such as a category name, a photo, or a spoken description. Existing benchmarks study multi-agent, multi-modal, and multi-object goal navigation in isolation, and a benchmark that places all three in one episode is missing. To fill this gap, we introduce HM3D-M3. A team of K agents starts at distributed locations in a photorealistic indoor scene and searches for an unordered set of M object goals, each given as an open-vocabulary category, an instance image, or an instance description. HM3D-M3 provides 1,000 validation episodes over 3,926 goals from 379 open-vocabulary categories, 100K observation-assignment training samples, and two team-level metrics, goal-level SR and makespan-normalized SPL. We further contribute two baselines. HiGA is a trained hierarchical goal assigner on top of a frozen open-vocabulary navigation policy, and LaViRA-M3 is a training-free team of VLM agents with shared mapping and progress analysis. Adapted multi-robot and zero-shot methods reach 16--27% SR, while our baselines reach 38--41% with complementary strengths and distinct failure modes. Furthermore, we deploy LaViRA-M3 on a heterogeneous three-robot team. Project page: https://robo-lavira.github.io/hm3d-m3/
GUIDE: Goal-Initialized Directional Understanding for End-to-End Legged Navigation
Institute of Cyber-Systems and Control, Zhejiang University(浙江大学控制科学与工程学院);Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI));Oxford Robotics Institute, University of Oxford(牛津大学牛津机器人研究所);Center for Robotics, University of Bonn(波恩大学机器人中心);Department of Mechanical Engineering, Massachusetts Institute of Technology(麻省理工学院机械工程系)
Where to Fetch: Extracting Visual Scene Representation from Large Pre-Trained Models for Robotic Goal Navigation
School of Control Science and Engineering, Shandong University(山东大学控制科学与工程学院);Campus Security Smart Brain Shandong Engineering Research Center(山东校园安全智能脑工程研究中心)
STONE Dataset: A Scalable Multi-Modal Surround-View 3D Traversability Dataset for Off-Road Robot Navigation
Interdisciplinary Program in Artificial Intelligence, Seoul National University(人工智能交叉学科项目,首尔国立大学);Department of Electrical and Computer Engineering, Seoul National University(电气与计算机工程系,首尔国立大学)
FSUNav: A Cerebrum-Cerebellum Architecture for Fast, Safe, and Universal Zero-Shot Goal-Oriented Navigation
School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院);College of Information Science and Technology, Eastern Institute of Technology(东方理工学院信息科学与技术学院)
Efficient Image-Goal Navigation with Representative Latent World Model
College of Intelligence Science and Technology, the National Key Laboratory of Equipment State Sensing and Smart Support, National University of Defense Technology(智能科学与技术学院、装备状态感知与智能支持国家重点实验室、国防科技大学)
Advancing Object Goal Navigation Through LLM-enhanced Object Affinities Transfer
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Georgia Institute of Technology(佐治亚理工学院);ETH Zurich(苏黎世联邦理工学院);Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学);McCormick School of Engineering, Northwestern University(西北大学工程学院)
Stairway to Success: An Online Floor-Aware Zero-Shot Object-Goal Navigation Framework via LLM-Driven Coarse-to-Fine Exploration
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong University of Science and Technology(香港科学与技术大学);National University of Singapore(新加坡国立大学);Tsinghua University(清华大学)
Hierarchical Experience-informed Navigation for Multi-modal Quadrupedal Rebar Grid Traversal
Georgia Institute of Technology(佐治亚理工学院);School of Mechanical Engineering, Georgia Institute of Technology(佐治亚理工学院机械工程学院);SkyMul Inc(SkyMul公司);School of Electrical and Computer Engineering, Georgia Institute of Technology(佐治亚理工学院电气与计算机工程学院)
Think before Go: Hierarchical Reasoning for Image-goal Navigation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(人机混合增强智能国家实验室、视觉信息与应用国家工程研究中心、人工智能与机器人研究所、西安交通大学);University of Macau(澳门大学);Xiaomi EV(小米电动车);School of Automation, Beijing Institute of Technology(自动化学院,北京理工大学)