arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.05912eess.IVcs.CV

面向肿瘤病灶语义分割的掩码增强型Segment Anything Model

Mask-Enhanced Segment Anything Model for Tumor Lesion Semantic Segmentation

Beihang University(北京航空航天大学);Hangzhou Innovation Institute, Beihang University(北京航空航天大学杭州创新研究院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);The Chinese University of Hong Kong(香港中文大学);Sun Yat-sen University(中山大学);Peking University Cancer Hospital & Institute(北京大学肿瘤医院暨研究所);Nanjing University(南京大学)

Hairong Shi, Songhao Han, Shaofei Huang, Yue Liao, Guanbin Li, Xiangxing Kong, Hua Zhu, Xiaomu Wang, Si Liu

AI总结:

针对3D肿瘤病灶分割中肿瘤复杂、前后景不平衡的问题,提出融合掩码增强适配器与迭代优化机制的M-SAM模型,在7个数据集上实现高精度与强泛化性。

摘要:

CT或MRI图像上的肿瘤病灶分割在癌症诊断与治疗规划中发挥着关键作用。考虑到不同医学成像模态与设备的肿瘤病灶分割数据存在固有差异,将医学知识融入Segment Anything Model(SAM,通用分割模型)凭借其多功能性与泛化潜力展现出可观的应用前景。已有研究尝试通过在大规模医学分割数据集上预训练,为SAM注入医学专业知识以增强其性能。然而,受肿瘤复杂性以及前景与背景区域不平衡的影响,3D肿瘤病灶分割仍存在诸多挑战。为此,我们提出了掩码增强型SAM(M-SAM)——一种专为3D肿瘤病灶分割定制的创新架构。我们在M-SAM中设计了全新的掩码增强适配器(MEA),利用粗分割掩码的位置信息丰富医学图像的语义信息,助力生成更精准的分割掩码。此外,M-SAM还引入了迭代优化机制,可逐步细化分割掩码,进一步提升性能。在7个肿瘤病灶分割数据集上开展的大量实验表明,我们的M-SAM不仅实现了较高的分割精度,还具备出色的泛化能力。代码已开源至https://github.com/nanase1025/M-SAM。

英文摘要:

Tumor lesion segmentation on CT or MRI images plays a critical role in cancer diagnosis and treatment planning. Considering the inherent differences in tumor lesion segmentation data across various medical imaging modalities and equipment, integrating medical knowledge into the Segment Anything Model (SAM) presents promising capability due to its versatility and generalization potential. Recent studies have attempted to enhance SAM with medical expertise by pre-training on large-scale medical segmentation datasets. However, challenges still exist in 3D tumor lesion segmentation owing to tumor complexity and the imbalance in foreground and background regions. Therefore, we introduce Mask-Enhanced SAM (M-SAM), an innovative architecture tailored for 3D tumor lesion segmentation. We propose a novel Mask-Enhanced Adapter (MEA) within M-SAM that enriches the semantic information of medical images with positional data from coarse segmentation masks, facilitating the generation of more precise segmentation masks. Furthermore, an iterative refinement scheme is implemented in M-SAM to refine the segmentation masks progressively, leading to improved performance. Extensive experiments on seven tumor lesion segmentation datasets indicate that our M-SAM not only achieves high segmentation accuracy but also exhibits robust generalization. The code is available at https://github.com/nanase1025/M-SAM.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑