arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.04826eess.IVcs.CV

重新思考基于SAM2的少样本医学图像分割:一种具有增强提示与动态匹配的无训练框架

Rethinking Few-Shot Medical Image Segmentation by SAM2: A Training-Free Framework with Augmentative Prompting and Dynamic Matching

The First Affiliated Hospital of Soochow University(苏州大学附属第一医院);Soochow University(苏州大学)

Haiyue Zu, Jun Ge, Heting Xiao, Jile Xie, Zhangzhe Zhou, Yifan Meng, Jiayi Ni, Junjie Niu, Linlin Zhang, Li Ni, Huilin Yang

AI总结:

本文提出一种基于SAM2的无训练少样本医学图像分割框架,将3D体数据视为视频序列,通过支持图像增强提示与动态匹配驱动分割,在基准数据集上取得领先性能并显著提升标注效率。

摘要:

对大规模标注数据集的依赖给医学图像分割带来了重大挑战。少样本学习提供了一种潜在的解决方案,但现有方法通常仍需要大量的训练数据。本文提出了一种新颖的方法,利用Segment Anything Model 2(SAM2)这一具有强大视频分割能力的视觉基础模型。我们将3D医学图像体数据概念化为视频序列,摒弃了传统的逐切片范式。我们的核心创新是一种支持-查询匹配策略:我们对单个标注的支持图像进行广泛的数据增强,并针对查询体数据中的每一帧,通过算法选择最相似的增强支持图像。该选定的图像及其对应的掩码被用作掩码提示,驱动SAM2进行视频分割。该方法完全避免了模型重训练或参数更新。我们在基准少样本医学图像分割数据集上展示了最先进的性能,在准确率和标注效率方面均取得了显著提升。这种即插即用的方法为3D医学图像分割提供了一种强大且具有泛化能力的解决方案。

英文摘要:

The reliance on large labeled datasets presents a significant challenge in medical image segmentation. Few-shot learning offers a potential solution, but existing methods often still require substantial training data. This paper proposes a novel approach that leverages the Segment Anything Model 2 (SAM2), a vision foundation model with strong video segmentation capabilities. We conceptualize 3D medical image volumes as video sequences, departing from the traditional slice-by-slice paradigm. Our core innovation is a support-query matching strategy: we perform extensive data augmentation on a single labeled support image and, for each frame in the query volume, algorithmically select the most analogous augmented support image. This selected image, along with its corresponding mask, is used as a mask prompt, driving SAM2's video segmentation. This approach entirely avoids model retraining or parameter updates. We demonstrate state-of-the-art performance on benchmark few-shot medical image segmentation datasets, achieving significant improvements in accuracy and annotation efficiency. This plug-and-play method offers a powerful and generalizable solution for 3D medical image segmentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑