arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09484eess.IVcs.CVcs.LG
收藏

基于混合YOLO-SAM 2模型的结肠镜检查自提示息肉分割

Self-Prompting Polyp Segmentation in Colonoscopy using Hybrid Yolo-SAM 2 Model

University of Toronto(多伦多大学);Yazd University(亚兹德大学)

Mobina Mansoori, Sajjad Shahabodini, Jamshid Abouei, Konstantinos N. Plataniotis, Arash Mohammadi

AI总结:

针对结肠镜息肉分割中息肉特征多样、图像存在伪影且人工标注成本高的问题,提出融合YOLOv8与SAM 2的自提示分割方法,仅用边界框标注即可在多数据集上实现优于现有最优模型的分割精度,提升临床息肉检测效率与可扩展性。

摘要:

结肠镜检查中息肉的早期诊断与治疗对于降低结直肠癌(CRC)的发病率和死亡率至关重要。然而,息肉特征的多样性以及结肠镜图像和视频中存在的伪影,给准确高效的息肉检测与分割带来了重大挑战。本文提出了一种新颖的息肉分割方法,将Segment Anything Model(SAM 2,分割一切模型2)与YOLOv8模型相融合。该方法利用YOLOv8的边界框预测结果,自主为SAM 2生成输入提示,从而减少对人工标注的需求。我们在5个结肠镜图像基准数据集和2个结肠镜视频数据集上开展了详尽测试,结果表明本方法在图像和视频分割任务上均优于现有最优模型。值得注意的是,该方法仅使用边界框标注即可实现高分割精度,大幅减少了标注时间与工作量。这一进展有望提升临床场景中息肉检测的效率与可扩展性,相关代码见https://github.com/sajjad-sh33/YOLO_SAM2。

英文摘要:

Early diagnosis and treatment of polyps during colonoscopy are essential for reducing the incidence and mortality of Colorectal Cancer (CRC). However, the variability in polyp characteristics and the presence of artifacts in colonoscopy images and videos pose significant challenges for accurate and efficient polyp detection and segmentation. This paper presents a novel approach to polyp segmentation by integrating the Segment Anything Model (SAM 2) with the YOLOv8 model. Our method leverages YOLOv8's bounding box predictions to autonomously generate input prompts for SAM 2, thereby reducing the need for manual annotations. We conducted exhaustive tests on five benchmark colonoscopy image datasets and two colonoscopy video datasets, demonstrating that our method exceeds state-of-the-art models in both image and video segmentation tasks. Notably, our approach achieves high segmentation accuracy using only bounding box annotations, significantly reducing annotation time and effort. This advancement holds promise for enhancing the efficiency and scalability of polyp detection in clinical settings https://github.com/sajjad-sh33/YOLO_SAM2.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑