arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.06162eess.IV

面向脑肿瘤分割的Segment Anything Model(SAM)实证评估

Empirical Evaluation of the Segment Anything Model (SAM) for Brain Tumor Segmentation

Mohammad Peivandi, Jason Zhang, Michael Lu, Dongxiao Zhu, Zhifeng Kou

AI总结:

本研究针对SAM适配脑肿瘤分割的难题,通过迁移学习增强其掩码解码器,设计三维数据封装与实时增强方法,实验显示改进SAM优于预训练版,精度虽不及nnUNetv2但困难病例一致性更优。

摘要:

脑肿瘤分割是医学图像分割领域中一项极具挑战性的任务。尽管深度学习模型已发挥作用,但人类专家分割仍是最准确的方法。近期发布的Segment Anything Model(SAM)为将基础模型应用于这一艰巨任务提供了可能。然而,SAM主要是在多样化的自然图像上训练的,这使得将SAM应用于生物医学分割(如边界欠清晰的脑肿瘤分割)颇具挑战。本文中,我们利用Decathlon脑肿瘤数据集通过迁移学习增强了SAM的掩码解码器。我们开发了三种方法,将四维数据封装为三维数据以适配SAM。我们采用了结合旋转与弹性形变的实时数据增强方法,以扩大训练数据集的规模。我们使用两个关键指标——戴斯相似系数(DSC)和95%豪斯多夫距离(HD95)——来评估分割模型的性能,这些指标为分割结果的质量提供了有价值的参考。在评估中,我们将改进后的模型与两个基准进行了对比:预训练SAM和广泛使用的nnUNetv2模型。我们发现,改进后的SAM相比预训练SAM有显著提升,而nnUNetv2的整体分割精度优于改进后的SAM。不过,改进后的SAM展现出的结果一致性略优于nnUNetv2,尤其是在可能导致更大豪斯多夫距离的困难病例上。未来可应用更先进的技术,以进一步提升SAM在脑肿瘤分割上的性能。

英文摘要:

Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment Anything Model (SAM) has opened up the opportunity to apply foundation models to this difficult task. However, SAM was primarily trained on diverse natural images. This makes applying SAM to biomedical segmentation, such as brain tumors with less defined boundaries, challenging. In this paper, we enhanced SAM's mask decoder using transfer learning with the Decathlon brain tumor dataset. We developed three methods to encapsulate the four-dimensional data into three dimensions for SAM. An on-the-fly data augmentation approach has been used with a combination of rotations and elastic deformations to increase the size of the training dataset. Two key metrics: the Dice Similarity Coefficient (DSC) and the Hausdorff Distance 95th Percentile (HD95), have been applied to assess the performance of our segmentation models. These metrics provided valuable insights into the quality of the segmentation results. In our evaluation, we compared this improved model to two benchmarks: the pretrained SAM and the widely used model, nnUNetv2. We find that the improved SAM shows considerable improvement over the pretrained SAM, while nnUNetv2 outperformed the improved SAM in terms of overall segmentation accuracy. Nevertheless, the improved SAM demonstrated slightly more consistent results than nnUNetv2, especially on challenging cases that can lead to larger Hausdorff distances. In the future, more advanced techniques can be applied in order to further improve the performance of SAM on brain tumor segmentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑