arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.12664cs.CV
收藏

基于循环融合细化块的多光谱融合目标检测

Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks

Univ Rennes(雷恩大学);IRISA(法国国家信息与自动化研究所雷恩分院(雷恩信息系统与随机系统研究所));Univ Bretagne Sud(南布列塔尼大学);ATERMES company(ATERMES公司);Inria(法国国家信息与自动化研究所)

Heng Zhang, Elisa Fromont, Sébastien Lefevre, Bruno Avignon

摘要:

多光谱图像(例如可见光和红外)在不同环境(例如白天/夜晚户外场景)中检测具有相同模型的对象时可能特别有用。为了有效地利用不同的光谱,主要的技术问题在于信息融合过程。在本文中,我们提出了一种新的中途功能融合方法,神经网络,利用互补性/一致性平衡存在于多光谱功能添加到网络架构,一个特定的模块,循环融合和细化每个光谱功能。我们评估我们的融合方法的有效性,两个具有挑战性的多光谱数据集的目标检测。我们的研究结果表明,与其他最先进的多光谱目标检测方法相比,在任何网络中实施我们的循环融合和优化模块都可以提高两个数据集的性能。

英文摘要:

Multispectral images (e.g. visible and infrared) may be particularly useful when detecting objects with the same model in different environments (e.g. day/night outdoor scenes). To effectively use the different spectra, the main technical problem resides in the information fusion process. In this paper, we propose a new halfway feature fusion method for neural networks that leverages the complementary/consistency balance existing in multispectral features by adding to the network architecture, a particular module that cyclically fuses and refines each spectral feature. We evaluate the effectiveness of our fusion method on two challenging multispectral datasets for object detection. Our results show that implementing our Cyclic Fuse-and-Refine module in any network improves the performance on both datasets compared to other state-of-the-art multispectral object detection methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑