VANGUARD:用于GPS受限环境下的无人机车辆锚定地面采样距离估计
VehAnchor: Metadata-Free Metric Scale Recovery from Vehicle Cues in Aerial Imagery
AI总结:
VANGUARD通过利用车辆锚点和核密度估计,为无人机在GPS受限环境中提供可靠地面采样距离估计,降低空间推理中的误差和失败率。
摘要:
在GPS受限或通信退化的环境中自主飞行的空中机器人经常失去相机元数据和 telemetry 的访问权限,导致机载感知系统无法恢复场景的绝对度量尺度。随着基于LLM/VLM的规划器越来越多地被用作具身系统的高层代理,它们对物理尺寸的推理能力变得安全关键——然而我们的实验表明,五种最先进的VLMs都受到空间尺度幻觉的影响,中位数面积估计误差超过50%。我们提出了VANGUARD,这是一种轻量且确定性的几何感知技能,设计为可调用的工具,任何基于LLM的代理都可以调用来从普遍存在的环境锚点中恢复地面采样距离(GSD):通过定向边界框检测到的小型车辆,其模态像素长度通过核密度估计稳健地估计,并通过预校准的参考长度转换为GSD。该工具返回GSD估计和复合置信度分数,使调用代理能够自主决定是否信任测量结果或回退到替代策略。在DOTA~v1.5基准上,VANGUARD在306张图像上实现了6.87%的中位数GSD误差。与基于SAM的分割结合后,该流程在100项基准上产生19.7%的中位数误差——比最好的VLM基线少了2.6倍的类别依赖性和4倍的灾难性失败。这表明为代理配备确定性的几何工具对于安全的自主空间推理至关重要。
英文摘要:
Autonomous aerial robots operating in GPS-denied or communication-degraded environments frequently lose access to camera metadata and telemetry, leaving onboard perception systems unable to recover the absolute metric scale of the scene. As LLM/VLM-based planners are increasingly adopted as high-level agents for embodied systems, their ability to reason about physical dimensions becomes safety-critical -- yet our experiments show that five state-of-the-art VLMs suffer from \emph{spatial scale hallucinations}, with median area estimation errors exceeding 50\%. We propose VehAnchor, a lightweight, deterministic \emph{Geometric Perception Skill} designed as a callable tool that any LLM-based agent can invoke to recover Ground Sample Distance (GSD) from ubiquitous environmental anchors: small vehicles detected via oriented bounding boxes, whose modal pixel length is robustly estimated through kernel density estimation and converted to GSD using a pre-calibrated reference length. The tool returns both a GSD estimate and a composite confidence score, enabling the calling agent to autonomously decide whether to trust the measurement or fall back to alternative strategies. On the DOTA~v1.5 benchmark, VehAnchor achieves 6.87\% median GSD error on 306~images. Integrated with SAM-based segmentation for downstream area measurement, the pipeline yields 19.7\% median error on a 100-entry benchmark -- with 2.6$\times$ lower category dependence and 4$\times$ fewer catastrophic failures than the best VLM baseline -- demonstrating that equipping agents with deterministic geometric tools is essential for safe autonomous spatial reasoning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。