arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.03260cs.CV
收藏

ShadowMamba:用于阴影去除的基于边界区域选择性扫描的状态空间模型

ShadowMamba: State-Space Model with Boundary-Region Selective Scan for Shadow Removal

Department of Electrical Engineering, Faculty of Engineering, Universiti Malaya(马来大学电气工程系);Faculty of Engineering and Information Technology, Southern University College(南方学院工程与信息技术学院)

Xiujin Zhu, Chee-Onn Chow, Joon Huang Chuah

AI总结:

本文提出首个基于Mamba的阴影去除模型ShadowMamba,通过边界区域选择性扫描机制和阴影掩码去噪方法,在保持线性复杂度的同时有效提升了阴影去除性能。

摘要:

图像阴影去除是一项典型的低级视觉任务。阴影会导致局部亮度偏移,从而降低下游视觉任务的性能。目前,基于Transformer的阴影去除方法由于自注意力机制而存在二次计算复杂度。为了提高效率,许多方法使用局部注意力,但这限制了全局信息的建模能力,并削弱了对区域之间亮度变化的感知。最近,Mamba通过以线性复杂度实现全局建模,在视觉任务中展现出了强大的性能。然而,现有的扫描策略并不适合阴影去除,因为它们忽略了阴影边界和内部区域的语义连续性。为了解决这个问题,本文提出了一种边界区域选择性扫描机制,该机制在捕捉局部细节的同时增强了它们之间的语义连续性,有效提高了阴影去除性能。此外,还引入了一种阴影掩码去噪方法来支持扫描机制并提高数据质量。基于这些技术,本文提出了一个名为ShadowMamba的模型,这是首个为阴影去除设计的基于Mamba的模型。实验结果表明,所提出的方法在AISTD、ISTD和SRD数据集上优于现有的主流方法,并且在参数效率和计算复杂度方面也具有明显优势。代码可在以下地址获取:https://github.com/ZHUXIUJINChris/ShadowMamba

英文摘要:

Image shadow removal is a typical low-level vision task. Shadows cause local brightness shifts, which reduce the performance of downstream vision tasks. Currently, Transformer-based shadow removal methods suffer from quadratic computational complexity due to the self-attention mechanism. To improve efficiency, many approaches use local attention, but this limits the ability to model global information and weakens the perception of brightness changes between regions. Recently, Mamba has shown strong performance in vision tasks by enabling global modeling with linear complexity. However, existing scanning strategies are not suitable for shadow removal, as they ignore the semantic continuity of shadow boundaries and internal regions. To address this, this paper proposes a boundary-region selective scanning mechanism that captures local details while enhancing semantic continuity between them, effectively improving shadow removal performance. In addition, a shadow mask denoising method is introduced to support the scanning mechanism and improve data quality. Based on these techniques, this paper presents a model called ShadowMamba, the first Mamba-based model designed for shadow removal. Experimental results show that the proposed method outperforms existing mainstream approaches on the AISTD, ISTD, and SRD datasets, and also offers clear advantages in parameter efficiency and computational complexity. Code is available at: https://github.com/ZHUXIUJINChris/ShadowMamba

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑