arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.07705cs.RO
收藏

面向大语言模型时代的空中机器人视觉-语言导航

Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models

Defense Innovation Institute, Chinese Academy of Military Sciences(军事科学院国防创新研究院);Intelligent Game and Decision Laboratory(智能博弈与决策实验室);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院)

Xingyu Xia, Lekai Zhou, Yujie Tang, Xiaozhou Zhu, Hai Zhu, Wen Yao

AI总结:

本文综述了空中机器人视觉-语言导航领域,分析了大语言模型与视觉-语言模型的整合,归纳了五类架构方法,指出了评估体系的不足,并提出了七个开放性问题。

摘要:

空中视觉-语言导航(Aerial VLN)旨在使无人机能够通过将语言 grounding 在视觉感知中,解释自然语言指令并自主导航复杂的三维环境。本文对 Aerial VLN 领域进行了批判性分析,特别关注近期大语言模型(LLMs)和视觉-语言模型(VLMs)的整合。我们首先正式介绍了 Aerial VLN 问题,并定义了两种交互范式:单指令和基于对话的范式,作为基础轴。然后将 Aerial VLN 方法组织成五种架构类别:序列到序列和基于注意力的方法、端到端 LLM/VLM 方法、分层方法、多智能体方法和基于对话的导航方法。对于每种类别,我们系统分析了设计原理、技术权衡和报告性能。我们批判性评估了 Aerial VLN 的评估基础设施,包括数据集、模拟平台和指标,并识别了其在规模、环境多样性、现实世界 grounding 和指标覆盖方面的不足。我们汇总了在共享基准上的跨方法比较,并分析了关键架构权衡,包括离散与连续动作、端到端与分层设计以及模拟到现实的差距。最后,我们综合了七个具体开放问题:长周期指令 grounding、视角鲁棒性、可扩展的空间表示、连续 6-DoF 动作执行、 onboard 部署、基准标准化和多无人机群导航,并指出了具体的研究方向。

英文摘要:

Aerial vision-and-language navigation (Aerial VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and autonomously navigate complex three-dimensional environments by grounding language in visual perception. This survey provides a critical and analytical review of the Aerial VLN field, with particular attention to the recent integration of large language models (LLMs) and vision-language models (VLMs). We first formally introduce the Aerial VLN problem and define two interaction paradigms: single-instruction and dialog-based, as foundational axes. We then organize the body of Aerial VLN methods into a taxonomy of five architectural categories: sequence-to-sequence and attention-based methods, end-to-end LLM/VLM methods, hierarchical methods, multi-agent methods, and dialog-based navigation methods. For each category, we systematically analyze design rationales, technical trade-offs, and reported performance. We critically assess the evaluation infrastructure for Aerial VLN, including datasets, simulation platforms, and metrics, and identify their gaps in scale, environmental diversity, real-world grounding, and metric coverage. We consolidate cross-method comparisons on shared benchmarks and analyze key architectural trade-offs, including discrete versus continuous actions, end-to-end versus hierarchical designs, and the simulation-to-reality gap. Finally, we synthesize seven concrete open problems: long-horizon instruction grounding, viewpoint robustness, scalable spatial representation, continuous 6-DoF action execution, onboard deployment, benchmark standardization, and multi-UAV swarm navigation, with specific research directions grounded in the evidence presented throughout the survey.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑