arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.01550cs.CV

基于原型的低空无人机语义分割

Prototype-Based Low Altitude UAV Semantic Segmentation

School of Artificial Intelligence, Optics and Electronics, Northwestern Polytechnical University(西北工业大学人工智能、光学与电子学院);Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究院(TeleAI))

Da Zhang, Gao Junyu, Zhao Zhiyuan

AI总结:

本文提出PBSeg框架,通过原型交叉注意力机制和多尺度特征提取模块,解决低空无人机图像语义分割中的尺度变化和计算资源限制问题,实现高效准确的分割性能。

摘要:

低空无人机图像的语义分割面临极端尺度变化、复杂边界和边缘设备计算资源有限的挑战。现有基于Transformer的方法性能优异但计算开销大,轻量方法难以捕捉高分辨率场景的细粒度细节。为此,我们提出PBSeg,一种针对无人机应用的高效原型基于分割框架。PBSeg引入新颖的原型交叉注意力(PBCA),利用特征冗余降低计算复杂性同时保持分割质量。框架包含高效的多尺度特征提取模块,结合可变形卷积(DConv)与上下文感知调制(CAM)以捕捉局部细节和全局语义。在两个具有挑战性的无人机数据集上的实验表明了所提方法的有效性。PBSeg在UAVid上达到71.86%的mIoU,在UDD6上达到80.92%的mIoU,实现了竞争性的性能同时保持计算效率。代码可在https://github.com/zhangda1018/PBSeg获取。

英文摘要:

Semantic segmentation of low-altitude UAV imagery presents unique challenges due to extreme scale variations, complex object boundaries, and limited computational resources on edge devices. Existing transformer-based segmentation methods achieve remarkable performance but incur high computational overhead, while lightweight approaches struggle to capture fine-grained details in high-resolution aerial scenes. To address these limitations, we propose PBSeg, an efficient prototype-based segmentation framework tailored for UAV applications. PBSeg introduces a novel prototype-based cross-attention (PBCA) that exploits feature redundancy to reduce computational complexity while maintaining segmentation quality. The framework incorporates an efficient multi-scale feature extraction module that combines deformable convolutions (DConv) with context-aware modulation (CAM) to capture both local details and global semantics. Experiments on two challenging UAV datasets demonstrate the effectiveness of the proposed approach. PBSeg achieves 71.86\% mIoU on UAVid and 80.92\% mIoU on UDD6, establishing competitive performance while maintaining computational efficiency. Code is available at https://github.com/zhangda1018/PBSeg.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑