arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2508.07300cs.CV

BEVANet:用于实时语义分割的双边高效视觉注意力网络

BEVANet: Bilateral Efficient Visual Attention Network for Real-Time Semantic Segmentation

Graduate Institute of Networking and Multimedia, National Taiwan University(网络与多媒体研究所,国立台湾大学);Department of Computer Science and Information Engineering, National Taiwan University(计算机科学与信息工程系,国立台湾大学)

Ping-Mao Huang, I-Tien Chao, Ping-Chia Huang, Jia-Wei Liao, Yung-Yu Chuang

AI总结:

针对实时语义分割需兼顾大感受野与细节轮廓的挑战,提出BEVANet,引入LKA机制,结合SDLSKA、CKS和DLKPPM等模块,实现33 FPS实时分割,在Cityscapes上无预训练达79.3% mIoU、预训练后81.0% mIoU。

摘要:

实时语义分割面临双重挑战:设计高效架构以捕捉大感受野实现语义理解,同时细化详细轮廓。视觉Transformer能有效建模长程依赖,但计算成本高。为应对这些挑战,我们引入大核注意力(LKA)机制。所提出的双边高效视觉注意力网络(BEVANet)通过稀疏分解大分离核注意力(SDLSKA)扩展感受野以捕捉上下文信息,并提取视觉和结构特征。综合核选择(CKS)机制动态调整感受野以进一步提升性能。此外,深度大核金字塔池化模块(DLKPPM)通过协同结合扩张卷积和大核注意力来丰富上下文特征。双边架构促进频繁的分支通信,边界引导自适应融合(BGAF)模块在边界引导下整合空间和语义特征以增强边界描绘。BEVANet实现33 FPS的实时分割,无预训练时在Cityscapes上获得79.3%的mIoU,经ImageNet预训练后达到81.0%的mIoU,展现出最先进的性能。代码和模型可在https://github.com/maomao0819/BEVANet获取。

英文摘要:

Real-time semantic segmentation presents the dual challenge of designing efficient architectures that capture large receptive fields for semantic understanding while also refining detailed contours. Vision transformers model long-range dependencies effectively but incur high computational cost. To address these challenges, we introduce the Large Kernel Attention (LKA) mechanism. Our proposed Bilateral Efficient Visual Attention Network (BEVANet) expands the receptive field to capture contextual information and extracts visual and structural features using Sparse Decomposed Large Separable Kernel Attentions (SDLSKA). The Comprehensive Kernel Selection (CKS) mechanism dynamically adapts the receptive field to further enhance performance. Furthermore, the Deep Large Kernel Pyramid Pooling Module (DLKPPM) enriches contextual features by synergistically combining dilated convolutions and large kernel attention. The bilateral architecture facilitates frequent branch communication, and the Boundary Guided Adaptive Fusion (BGAF) module enhances boundary delineation by integrating spatial and semantic features under boundary guidance. BEVANet achieves real-time segmentation at 33 FPS, yielding 79.3% mIoU without pretraining and 81.0% mIoU on Cityscapes after ImageNet pretraining, demonstrating state-of-the-art performance. The code and model is available at https://github.com/maomao0819/BEVANet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑