arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.04381cs.CVcs.AI

用于精确目标检测的带重参数化异构卷积的多分支辅助融合YOLO

Multi-Branch Auxiliary Fusion YOLO with Re-parameterization Heterogeneous Convolutional for accurate object detection

Zhejiang University of Technology(浙江工业大学);Zhejiang College of Sports(浙江体育学院)

Zhiqiang Yang, Qiu Guan, Keer Zhao, Jianmin Yang, Xinli Xu, Haixia Long, Ying Tang

AI总结:

本文提出MAF-YOLO目标检测框架,通过多分支辅助FPN和重参数化异构卷积模块实现高效多尺度特征融合,在COCO上以极低参数量达到42.4% AP,显著优于YOLOv8n。

摘要:

由于多尺度特征融合的有效性能,路径聚合FPN(PAFPN)被广泛应用于YOLO检测器中。然而,它无法同时高效且自适应地整合高层语义信息与低层空间信息。本文提出了一种名为MAF-YOLO的新模型,这是一个新颖的目标检测框架,具有一个名为多分支辅助FPN(MAFPN)的多功能颈部。在MAFPN中,设计了浅层辅助融合(SAF)模块,将骨干网络的输出与颈部相结合,保留最佳水平的浅层信息以促进后续学习。同时,深度嵌入颈部的高级辅助融合(AAF)模块向输出层传递更多样化的梯度信息。此外,我们提出的重参数化异构高效层聚合网络(RepHELAN)模块确保整体模型架构和卷积设计都采用异构大卷积核。因此,这保证了与小目标相关信息的保留,同时实现了多尺度感受野。最后,以MAF-YOLO的nano版本为例,它在COCO上仅用3.76M可学习参数和10.51G FLOPs即可达到42.4%的AP,约比YOLOv8n高出约5.1%。本工作的源代码可在以下地址获取:https://github.com/yang-0201/MAF-YOLO。

英文摘要:

Due to the effective performance of multi-scale feature fusion, Path Aggregation FPN (PAFPN) is widely employed in YOLO detectors. However, it cannot efficiently and adaptively integrate high-level semantic information with low-level spatial information simultaneously. We propose a new model named MAF-YOLO in this paper, which is a novel object detection framework with a versatile neck named Multi-Branch Auxiliary FPN (MAFPN). Within MAFPN, the Superficial Assisted Fusion (SAF) module is designed to combine the output of the backbone with the neck, preserving an optimal level of shallow information to facilitate subsequent learning. Meanwhile, the Advanced Assisted Fusion (AAF) module deeply embedded within the neck conveys a more diverse range of gradient information to the output layer. Furthermore, our proposed Re-parameterized Heterogeneous Efficient Layer Aggregation Network (RepHELAN) module ensures that both the overall model architecture and convolutional design embrace the utilization of heterogeneous large convolution kernels. Therefore, this guarantees the preservation of information related to small targets while simultaneously achieving the multi-scale receptive field. Finally, taking the nano version of MAF-YOLO for example, it can achieve 42.4% AP on COCO with only 3.76M learnable parameters and 10.51G FLOPs, and approximately outperforms YOLOv8n by about 5.1%. The source code of this work is available at: https://github.com/yang-0201/MAF-YOLO.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑