arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.01686cs.CV

用于伪装目标检测的频率-空间纠缠学习

Frequency-Spatial Entanglement Learning for Camouflaged Object Detection

Nanjing University of Science and Technology(南京理工大学);Anhui University(安徽大学)

Yanguang Sun, Chunyan Xu, Jian Yang, Hanyu Xuan, Lei Luo

AI总结:

本文提出频率-空间纠缠学习(FSEL)方法,通过联合探索频率域和空间域表示,结合纠缠Transformer模块、联合域感知模块和双域反向解析器,在三个数据集上超越21种最先进方法,有效解决伪装目标检测中目标与背景高度相似的问题。

摘要:

伪装目标检测在计算机视觉中引起了广泛关注。其主要挑战在于伪装目标与其周围环境在空间域中的高度相似性,使得识别变得困难。现有方法试图通过复杂设计最大化空间特征的区分能力来减少像素相似性的影响,但往往忽略了空间域中特征的敏感性和局部性,导致结果次优。本文提出了一种新方法,通过联合探索频率域和空间域的表示来解决这一问题,引入了频率-空间纠缠学习(FSEL)方法。该方法由一系列精心设计的纠缠Transformer模块(ETB)用于表示学习、一个联合域感知模块用于语义增强,以及一个双域反向解析器用于频率域和空间域的特征集成。具体而言,ETB利用频率自注意力有效刻画不同频带之间的关系,而纠缠前馈网络通过纠缠学习促进不同域特征之间的信息交互。我们的大量实验通过在三个广泛使用的数据集上进行全面的定量和定性比较,证明了FSEL相对于21种最先进方法的优越性。源代码可在以下地址获取:https://github.com/CSYSI/FSEL。

英文摘要:

Camouflaged object detection has attracted a lot of attention in computer vision. The main challenge lies in the high degree of similarity between camouflaged objects and their surroundings in the spatial domain, making identification difficult. Existing methods attempt to reduce the impact of pixel similarity by maximizing the distinguishing ability of spatial features with complicated design, but often ignore the sensitivity and locality of features in the spatial domain, leading to sub-optimal results. In this paper, we propose a new approach to address this issue by jointly exploring the representation in the frequency and spatial domains, introducing the Frequency-Spatial Entanglement Learning (FSEL) method. This method consists of a series of well-designed Entanglement Transformer Blocks (ETB) for representation learning, a Joint Domain Perception Module for semantic enhancement, and a Dual-domain Reverse Parser for feature integration in the frequency and spatial domains. Specifically, the ETB utilizes frequency self-attention to effectively characterize the relationship between different frequency bands, while the entanglement feed-forward network facilitates information interaction between features of different domains through entanglement learning. Our extensive experiments demonstrate the superiority of our FSEL over 21 state-of-the-art methods, through comprehensive quantitative and qualitative comparisons in three widely-used datasets. The source code is available at: https://github.com/CSYSI/FSEL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑