arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.19929cs.NIcs.ITmath.IT
收藏

BeamVLM 用于低空经济:通过视觉-语言模型进行生成式波束预测

BeamVLM for Low-altitude Economy: Generative Beam Prediction via Vision-language Models

Southern University of Science and Technology(南方科技大学);ShanghaiTech University(上海科技大学);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Beijing Institute of Technology(北京理工大学)

Chenran Kou, Changsheng You, Mingjiang Wu, Dingzhu Wen, Zezhong Zhang, Chengwen Xing

AI总结:

BeamVLM 通过视觉-语言模型实现生成式波束预测,提升无人机与地面基站间通信的准确性和泛化能力。

摘要:

对于低空经济(LAE),高速和准确的无人机与地面基站之间波束预测至关重要,这确保了无缝覆盖和可靠通信。然而,现有的基于深度学习的波束预测方法缺乏对动态环境的高层语义理解,导致泛化能力差。另一方面,新兴的基于大语言模型(LLM)的方法在增强泛化能力方面显示出潜力,但它们通常缺乏丰富的环境感知,从而无法捕捉到精确波束对齐所需的细粒度空间语义。为了解决这些限制,本文提出了一种新颖的端到端生成框架用于波束预测,称为BeamVLM,它将波束预测视为一个视觉问答任务,利用强大的现有视觉-语言模型(VLMs)。通过将原始视觉块直接投影到语言领域,并精心设计指导提示,所提出的BeamVLM使VLM能够联合推理解无人机轨迹和环境背景。最后,在真实世界数据集上的实验结果表明,所提出的BeamVLM在预测精度上优于最先进的方法,并且在其他场景如车辆到基础设施(V2I)波束预测中也表现出更优的泛化能力。

英文摘要:

For low-altitude economy (LAE), fast and accurate beam prediction between high-mobility unmanned aerial vehicles (UAVs) and ground base stations is of paramount importance, which ensures seamless coverage and reliable communications. However, existing deep learning-based beam prediction methods lack high-level semantic understanding of dynamic environments, resulting in poor generalization. On the other hand, the emerging large language model (LLM) based approaches show promise in enhancing generalization, but they typically lack rich environmental perception, thereby failing to capture fine-grained spatial semantics essential for precise beam alignment. To tackle these limitations, we propose in this correspondence a novel end-to-end generative framework for beam prediction, called BeamVLM, which treats beam prediction as a vision question answering task capitalizing on powerful existing vision-language models (VLMs). By projecting raw visual patches directly into the language domain and judiciously designing an instructional prompt, the proposed BeamVLM enables the VLM to jointly reason over UAV trajectories and environmental context. Last, experimental results on real-world datasets demonstrate that the proposed BeamVLM outperforms state-of-the-art methods in prediction accuracy and also exhibits superior generalization for other scenarios such as vehicle-to-infrastructure (V2I) beam prediction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑