arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.19213cs.CV

SegMoTE: 用于医学图像分割的令牌级混合专家模型

SegMoTE: Token-Level Mixture of Experts for Medical Image Segmentation

Sichuan University(四川大学);Xinjiang University(新疆大学);Fuzhou University(福州大学);Alibaba DAMO Academy(阿里巴巴 DAMO 院)

Yujie Lu, Jingwen Li, Sibo Ju, Yanzhou Su, he yao, Yisong Liu, Min Zhu, Junlong Cheng

AI总结:

提出SegMoTE框架,通过令牌级混合专家机制和渐进式提示令牌化,在极低标注成本下实现医学图像分割的跨模态自适应与SOTA性能。

摘要:

医学图像分割对于临床诊断和定量分析至关重要,但由于成像模态的异质性和像素级标注的高成本,仍然具有挑战性。尽管像SAM这样的通用交互式分割模型取得了显著进展,但它们向医学影像的迁移仍面临两个关键瓶颈:(i) 缺乏针对模态和解剖特定任务的自适应机制,限制了在分布外医学场景中的泛化能力;(ii) 当前的医学适应方法在没有选择的情况下对大型异构数据集进行微调,导致噪声监督、更高成本和负迁移。为了解决这些问题,我们提出了SegMoTE,一个高效且自适应的医学图像分割框架。SegMoTE保留了SAM原始的提示接口、高效推理和零样本泛化能力,同时仅引入少量可学习参数以动态适应不同模态和任务。此外,我们设计了一种渐进式提示令牌化机制,实现了全自动分割,显著减少了对标注的依赖。在MedSeg-HQ(一个精心策划的数据集,规模不到现有大型数据集的1%)上训练后,SegMoTE在多种成像模态和解剖任务中达到了SOTA性能。这是首次在极低标注成本下将通用分割模型高效、鲁棒且可扩展地适应到医学领域,推动了基础视觉模型在临床应用中的实际部署。

英文摘要:

Medical image segmentation is vital for clinical diagnosis and quantitative analysis, yet remains challenging due to the heterogeneity of imaging modalities and the high cost of pixel-level annotations. Although general interactive segmentation models like SAM have achieved remarkable progress, their transfer to medical imaging still faces two key bottlenecks: (i) the lack of adaptive mechanisms for modality- and anatomy-specific tasks, which limits generalization in out-of-distribution medical scenarios; and (ii) current medical adaptation methods fine-tune on large, heterogeneous datasets without selection, leading to noisy supervision, higher cost, and negative transfer. To address these issues, we propose SegMoTE, an efficient and adaptive framework for medical image segmentation. SegMoTE preserves SAM's original prompt interface, efficient inference, and zero-shot generalization while introducing only a small number of learnable parameters to dynamically adapt across modalities and tasks. In addition, we design a progressive prompt tokenization mechanism that enables fully automatic segmentation, significantly reducing annotation dependence. Trained on MedSeg-HQ, a curated dataset less than 1% of existing large-scale datasets, SegMoTE achieves SOTA performance across diverse imaging modalities and anatomical tasks. It represents the first efficient, robust, and scalable adaptation of general segmentation models to the medical domain under extremely low annotation cost, advancing the practical deployment of foundation vision models in clinical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑