Map representations learned by expert demonstrations have shown promising research value. However, the field of visual navigation still faces challenges due to the lack of real-world human-navigation datasets that can support efficient, supervised, representation learning of environments. We present a Landmark-Aware Visual Navigation (LAVN) dataset to allow for supervised learning of human-centric exploration policies and map building. We collect RGBD observation and human point-click pairs as a human annotator explores virtual and real-world environments with the goal of full coverage exploration of the space. The human annotators also provide distinct landmark examples along each trajectory, which we intuit will simplify the task of map or graph building and localization. These human point-clicks serve as direct supervision for waypoint prediction when learning to explore in environments. Our dataset covers a wide spectrum of scenes, including rooms in indoor environments, as well as walkways outdoors. We release our dataset with detailed documentation at https://huggingface.co/datasets/visnavdataset/lavn (DOI: 10.57967/hf/2386) and a plan for long-term preservation.
Grounded Entity-Landmark Adaptive Pre-training for Vision-and-Language Navigation
Defense Innovation Institute, Chinese Academy of Military Science(中国军事科学院国防科技创新研究院);Tianjin Artificial Intelligence Innovation Center(天津人工智能创新中心);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
Correctable Landmark Discovery via Large Models for Vision-Language Navigation
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);PengCheng Laboratory(鹏城实验室);Dataa Robotics(达闼机器人公司);Shenzhen Institute of Advanced Technology(深圳先进技术研究院)
Defense Innovation Institute, Chinese Academy of Military Science(国防科技研究院,中国军事科学院);Tianjin Artificial Intelligence Innovation Center(天津人工智能创新中心);School of Mechanical Engineering, Tianjin University(天津大学机械工程学院)
Controllable Navigation Instruction Generation with Chain of Thought Prompting
School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
Visual Semantic SLAM with Landmarks for Large-Scale Outdoor Environment
Faculty of Electronic and Information Engineering, Xi’an Jiaotong University(西安交通大学电子与信息工程学院);College of Artificial Intelligence, Xi’an Jiaotong University(西安交通大学人工智能学院)
From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigation
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(北京航空航天大学虚拟现实技术与系统国家重点实验室);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院)
Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments
New Laboratory of Pattern Recognition (NLPR)(模式识别新实验室);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学);Robotics X, Tencent(腾讯Robotics X实验室)
Sun Yat-sen University(中山大学);Peng Cheng Laboratory(鹏城实验室);The Chinese University of Hong Kong(香港中文大学);Centre for Perceptual and Interactive Intelligence(感知与交互智能中心);Cardiff University(卡迪夫大学);Beihang University(北航);Guangdong Key Laboratory of Big Data Analysis and Processing(广东大数据分析与处理重点实验室)
Uncertainty-aware U-Net for Medical Landmark Detection
Fudan University(复旦大学);Shanghai Key Laboratory of Intelligent Information Processing(上海市智能信息处理重点实验室);School of Computer Science, Fudan University(复旦大学计算机科学学院)
NavAgent: Multi-scale Urban Street View Fusion For UAV Embodied Vision-and-Language Navigation
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
Coordinated Transformer with Position \& Sample-aware Central Loss for Anatomical Landmark Detection
Case Western Reserve University(凯斯西储大学);The Second Affiliated Hospital of Anhui Medical University(安徽医科大学第二附属医院);Institute of Orthopaedics, Research Center for Translational Medicine, The Second Affiliated Hospital of Anhui Medical University(安徽医科大学第二附属医院骨科研究所、转化医学研究中心);China University of Petroleum(中国石油大学);Guangzhou Twelfth people’s Hospital(广州市第十二人民医院);Guangzhou Occupational Disease Prevention and Treatment Hospital(广州市职业病防治院);Guangzhou Otolaryngology-head and Neck Surgery Hospital(广州市耳鼻咽喉头颈外科医院);West China Hospital(华西医院);Renmin Hospital of Wuhan University(武汉大学人民医院)
Adversarial Learning of Structure-Aware Fully Convolutional Networks for Landmark Localization
Nanjing University of Science and Technology(南京理工大学);The University of Adelaide(阿德莱德大学);Australian Centre for Robotic Vision(澳大利亚机器人视觉中心);Nanjing University(南京大学)
From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videos
School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机与信息工程学院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学)
Dual-Anchoring: Addressing State Drift in Vision-Language Navigation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence(人机混合增强智能国家重点实验室);National Engineering Research Center for Visual Information and Applications(视觉信息与应用国家工程研究中心);Institute of Artificial Intelligence and Robotics(人工智能与机器人研究院);Xi’an Jiaotong University(西安交通大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Johns Hopkins University(约翰霍普金斯大学);Joy Future Academy, JD(京东探索研究院)
Proto-Former: Unified Facial Landmark Detection by Prototype Transformer
School of Information Engineering, Zhongnan University of Economics and Law(中南财经政法大学信息工程学院);School of Computer Science and Engineering (SCSE), Nanyang Technological University(南洋理工大学计算机科学与工程学院);School of Computer Science, Wuhan University(武汉大学计算机学院);Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering, College of Computer and Information Technology, China Three Gorges University(湖北工业大学水电工程智能视觉监测重点实验室,计算机与信息学院)