In this paper, we present a novel method for reliable frontier selection in Zero-Shot Object Goal Navigation (ZS-OGN), enhancing robotic navigation systems with foundation models to improve commonsense reasoning in indoor environments. Our approach introduces a multi-expert decision framework to address the nonsensical or irrelevant reasoning often seen in foundation model-based systems. The method comprises two key components: Diversified Expert Frontier Analysis (DEFA) and Consensus Decision Making (CDM). DEFA utilizes three expert models: furniture arrangement, room type analysis, and visual scene reasoning, while CDM aggregates their outputs, prioritizing unanimous or majority consensus for more reliable decisions. Demonstrating state-of-the-art performance on the RoboTHOR and HM3D datasets, our method excels at navigating towards untrained objects or goals and outperforms various baselines, showcasing its adaptability to dynamic real-world conditions and superior generalization capabilities.
R2F: Repurposing Ray Frontiers for LLM-free Object Navigation
Department of Computer, Automation and Management Engineering, Sapienza University of Rome(罗马萨皮恩扎大学计算机、自动化与管理工程系);Department of Electronics and Automation, Mohamed Khider University of Biskra(比斯克拉Mohamed Khider大学电子与自动化系);International University of Rome UNINT, Rome(罗马国际大学UNINT)
FOM-Nav: Frontier-Object Maps for Object Goal Navigation
Inria(法国国家信息与自动化技术研究院);Department of Computer Science, École normale supérieure (ENS-PSL, CNRS, Inria)(高等师范学院计算机科学系);Courant Institute of Mathematical Sciences and Center for Data Science, New York University(纽约大学Courant数学科学研究所和数据科学中心)
IntentNav: Learning Spatial-Visual Object Navigation from Human Demonstrations
Nanyang Technological University(南洋理工大学);Carnegie Mellon University(卡内基梅隆大学);The Chinese University of Hong Kong(香港中文大学);A*STAR Institute for Infocomm Research (I2R)(新加坡科技研究局资讯通信研究院)
STEGNav: Spatio-Temporal Event Graph Reasoning for Multimodal Lifelong Object Navigation
State Key Laboratory of Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院);School of Artificial Intelligence, Nanjing University(南京大学人工智能学院)
Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
Renmin University of China(中国人民大学);Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing(北京未来区块链与隐私计算先进创新中心);Horizon Robotics(地平线机器人)
Have You Seen It Clearly? Uncertainty-Guided Belief Refinement for Zero-Shot Object Navigation
Hong Kong Polytechnic University(香港理工大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);DeepRobotics(深度机器人公司);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));City University of Hong Kong(香港城市大学)
Open-Nav: Exploring Zero-Shot Vision-and-Language Navigation in Continuous Environment with Open-Source LLMs
Australian Institute for Machine Learning at the University of Adelaide(阿德莱德大学澳大利亚机器学习研究所);School of Software Engineering, South China University of Technology(华南理工大学软件工程学院)
How Much is too Much: Exploring the Effect of Verbal Route Description Length on Indoor Navigation
TCS Research(塔塔咨询服务研究中心);Interdepartmental Center for Advances in Robotic Surgery - ICAROS(跨部门机器人外科进展中心(ICAROS));University of Naples Federico II(那不勒斯费德里科二世大学)
Stop Wandering: Efficient Vision-Language Navigation via Metacognitive Reasoning
Central South University(中南大学);Nanjing University(南京大学);State Grid Hubei Electric Power Research Institute(国网湖北省电力有限公司电力科学研究院);Dongguan University of Technology(东莞理工学院)
DRIVE-Nav: Directional Reasoning, Inspection, and Verification for Efficient Open-Vocabulary Navigation
Beijing Institute of Technology(北京理工大学);DeepBlue College(深蓝学院);The National Key Laboratory of Autonomous Intelligent Unmanned Systems (KAIUS), School of Automation(自主智能无人系统全国重点实验室(KAIUS),自动化学院)
Origami crawlers: exploring a single origami vertex for complex path navigation
J.A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院);Delft University of Technology(代尔夫特理工大学);Politecnico di Milano(米兰理工大学)
Exploring multimodal implicit behavior learning for vehicle navigation in simulated cities
Systems Engineering Department, Federal University of Santa Catarina, Florianopolis, Brazil Faculty of Science;Engineering, Information Technology Åbo Akademi University, Finland
Zero-shot Object Navigation with Vision-Language Models Reasoning
New York University Abu Dhabi(纽约大学阿布扎比分校);Center for Artificial Intelligence and Robotics(人工智能与机器人中心);Tandon School of Engineering(坦登工程学院);China Academic of Electronics and Information Technology(中国电子信息产业发展研究院);School of Software, Tsinghua University(清华大学软件学院)
IndustryNav: Evaluating Spatial Reasoning and Safety of Embodied Agents in Dynamic Industrial Navigation
Michigan State University(密歇根州立大学);Independent Researcher(独立研究者);University of California, Irvine(加州大学尔湾分校);Ohio State University(俄亥俄州立大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);University of California, Santa Barbara(加州大学圣巴巴拉分校);University of Pittsburgh(匹兹堡大学);University of Virginia(弗吉尼亚大学);Arizona State University(亚利桑那州立大学);Purdue University Northwest(普渡大学西北分校)
Uncertainty-Informed Active Perception for Open Vocabulary Object Goal Navigation
Center for Robotics, University of Bonn(波恩大学机器人中心);MAVLab, TU Delft(代尔夫特理工大学MAVLab);Lamarr Institute for Machine Learning and Artificial Intelligence(机器学习与人工智能拉马尔研究所)
Exploring Unstructured Environments using Minimal Sensing on Cooperative Nano-Drones
Computer Vision and Aerial Robotics Group at Universidad Politécnica de Madrid(马德里理工大学计算机视觉与空中机器人小组);Centre for Automation and Robotics C.A.R. (UPM-CSIC)(自动化与机器人中心(UPM-CSIC));Department of Mechanical Engineering, Texas A&M University(机械工程系,德克萨斯A&M大学)
PIGEON: VLM-Driven Object Navigation via Points of Interest Selection
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing Academy of Artificial Intelligence (BAAI)(北京人工智能研究院);Peking University(北京大学);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)