arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.21079cs.CV
收藏

WaveSeg:通过高频先验与Mamba驱动的频谱分解提升分割精度

WaveSeg: Enhancing Segmentation Precision via High-Frequency Prior and Mamba-Driven Spectrum Decomposition

Faculty of Engineering and Information Technology, University of Technology Sydney(工程与信息技术学院,悉尼技术大学)

Guoan Xu, Yang Xiao, Wenjing Jia, Guangwei Gao, Guo-Jun Qi, Chia-Wen Lin

AI总结:

针对语义分割解码器在语义与细节间的权衡问题,提出WaveSeg,结合高频先验、双域操作及Mamba驱动的频谱分解注意力,在标准基准上超越现有方法,实现高效精确分割。

摘要:

尽管最近的语义分割网络严重依赖强大的预训练编码器,但大多数采用简单的解码器,导致语义上下文与细粒度细节保留之间的权衡欠佳。为解决这一问题,我们提出了一种新颖的解码器架构WaveSeg,它在空间域和小波域中联合优化特征细化。具体而言,首先从输入图像中学习高频分量作为显式先验,以在早期阶段强化边界细节。然后应用多尺度融合机制——双域操作(DDO),并提出了新颖的频谱分解注意力(SDA)模块,该模块利用Mamba的线性复杂度长程建模来增强高频结构细节。同时,应用重参数化卷积以在小波域中保留低频语义完整性。最后,残差引导融合在原生分辨率下将多尺度特征与边界感知表示相结合,生成语义和结构丰富的特征图。在标准基准上的大量实验表明,WaveSeg利用小波域频率先验与基于Mamba的注意力,在定量和定性上均持续优于最先进的方法,实现了高效且精确的分割。

英文摘要:

While recent semantic segmentation networks heavily rely on powerful pretrained encoders, most employ simplistic decoders, leading to suboptimal trade-offs between semantic context and fine-grained detail preservation. To address this, we propose a novel decoder architecture, WaveSeg, which jointly optimizes feature refinement in spatial and wavelet domains. Specifically, high-frequency components are first learned from input images as explicit priors to reinforce boundary details at early stages. A multi-scale fusion mechanism, Dual Domain Operation (DDO), is then applied, and the novel Spectrum Decomposition Attention (SDA) block is proposed, which is developed to leverage Mamba's linear-complexity long-range modeling to enhance high-frequency structural details. Meanwhile, reparameterized convolutions are applied to preserve low-frequency semantic integrity in the wavelet domain. Finally, a residual-guided fusion integrates multi-scale features with boundary-aware representations at native resolution, producing semantically and structurally rich feature maps. Extensive experiments on standard benchmarks demonstrate that WaveSeg, leveraging wavelet-domain frequency prior with Mamba-based attention, consistently outperforms state-of-the-art approaches both quantitatively and qualitatively, achieving efficient and precise segmentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑