arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.07502cs.CV

基于目标检测器和适配的Segment Anything Model的SAR图像组合式溢油检测

Compositional Oil Spill Detection Based on Object Detector and Adapted Segment Anything Model from SAR Images

The Hong Kong Polytechnic University(香港理工大学);Research Institute for Sustainable Urban Development, The Hong Kong Polytechnic University(香港理工大学可持续城市发展研究院)

Wenhui Wu, Man Sing Wong, Xinyu Yu, Guoqiang Shi, Coco Yin Tung Kwok, Kang Zou

AI总结:

提出组合式溢油检测框架SAM-OIL,结合YOLOv8、适配的SAM和OMF模块,减少对精细标注样本的依赖,实现69.52%的mIoU,超越现有语义分割方法。

摘要:

基于语义分割的方法在SAR图像溢油检测中引起了广泛关注。然而,现有方法在训练阶段需要大量精细标注的分割样本。为缓解这一问题,我们提出了一种组合式溢油检测框架SAM-OIL,包含目标检测器(如YOLOv8)、适配的Segment Anything Model(SAM)和有序掩码融合(OMF)模块。SAM-OIL是强大的SAM在溢油检测中的首次应用。具体而言,SAM-OIL策略使用YOLOv8获取溢油相关对象的类别和边界框,然后将边界框输入适配的SAM以检索类别无关的掩码,最后采用OMF模块融合掩码和类别。适配的SAM将冻结的SAM与可学习的Adapter模块相结合,能增强SAM分割模糊对象的能力。OMF模块是一种无参数方法,能有效解决SAM内部像素类别冲突。实验结果表明,SAM-OIL超越了现有基于语义分割的溢油检测方法,实现了69.52%的mIoU。结果还表明,OMF和Adapter模块均能有效提高SAM-OIL的准确性。

英文摘要:

Semantic segmentation-based methods have attracted extensive attention in oil spill detection from SAR images. However, the existing approaches require a large number of finely annotated segmentation samples in the training stage. To alleviate this issue, we propose a composite oil spill detection framework, SAM-OIL, comprising an object detector (e.g., YOLOv8), an Adapted Segment Anything Model (SAM), and an Ordered Mask Fusion (OMF) module. SAM-OIL is the first application of the powerful SAM in oil spill detection. Specifically, the SAM-OIL strategy uses YOLOv8 to obtain the categories and bounding boxes of oil spill-related objects, then inputs bounding boxes into the Adapted SAM to retrieve category-agnostic masks, and finally adopts the OMF module to fuse the masks and categories. The Adapted SAM, combining a frozen SAM with a learnable Adapter module, can enhance SAM's ability to segment ambiguous objects. The OMF module, a parameter-free method, can effectively resolve pixel category conflicts within SAM. Experimental results demonstrate that SAM-OIL surpasses existing semantic segmentation-based oil spill detection methods, achieving mIoU of 69.52\%. The results also indicated that both OMF and Adapter modules can effectively improve the accuracy in SAM-OIL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑