arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.15875cs.ROcs.AI
收藏

Fly0: 解耦语义定位与几何规划以实现零样本空中导航

Fly0: Persistent Metric Anchoring for Zero-Shot Aerial Vision-Language Navigation

National Key Laboratory of Big Data and Decision(大数据与决策国家重点实验室);National University of Defense Technology(国防科技大学);State Key Laboratory of Digital Intelligent Modeling and Simulation(数字智能建模与仿真国家重点实验室);Information Support Force Engineering University(信息支援力量工程大学)

Zhenxing Xu, Yihong Lu, Weidong Bao, Zhengqiu Zhu, Jingxuan Zhou, Zhichuang Wang, Ji Wang, Lihua Liu, Wei He

AI总结:

Fly0通过解耦语义推理与几何规划,实现零样本空中导航,提升导航成功率和减少导航误差。

摘要:

当前视觉-语言导航(VLN)方法面临语义理解和控制精度之间的权衡。尽管多模态大语言模型(MLLMs)具有优越的推理能力,但将其作为低层控制器会导致高延迟、轨迹震荡和泛化能力差,这是因为几何定位能力薄弱。为了解决这些限制,我们提出了Fly0框架,该框架将语义推理与几何规划解耦。所提出的方法通过一个三阶段流程运作:(1)一个由MLLM驱动的模块,将自然语言指令转换为2D像素坐标;(2)一个几何投影模块,利用深度数据将目标定位在3D空间中;(3)一个几何规划器,生成无碰撞轨迹。这种机制使得即使在视觉接触丢失时也能实现稳健的导航。通过消除持续推理的需要,Fly0减少了计算开销并提高了系统稳定性。在模拟和现实环境中的大量实验表明,Fly0在无结构环境中优于最先进的基线方法,成功率为20%以上,导航误差(NE)减少了约50%。我们的代码可在https://github.com/xuzhenxing1/Fly0上获得。

英文摘要:

Current Visual-Language Navigation (VLN) methodologies face a trade-off between semantic understanding and control precision. While Multimodal Large Language Models (MLLMs) offer superior reasoning, deploying them as low-level controllers leads to high latency, trajectory oscillations, and poor generalization due to weak geometric grounding. To address these limitations, we propose Fly0, a framework that decouples semantic reasoning from geometric planning. The proposed method operates through a three-stage pipeline: (1) an MLLM-driven module for grounding natural language instructions into 2D pixel coordinates; (2) a geometric projection module that utilizes depth data to localize targets in 3D space; and (3) a geometric planner that generates collision-free trajectories. This mechanism enables robust navigation even when visual contact is lost. By eliminating the need for continuous inference, Fly0 reduces computational overhead and improves system stability. Extensive experiments in simulation and real-world environments demonstrate that Fly0 outperforms state-of-the-art baselines, improving the Success Rate by over 20\% and reducing Navigation Error (NE) by approximately 50\% in unstructured environments. Our code is available at https://github.com/xuzhenxing1/Fly0.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑