arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.05433cs.CV

部件感知提示的段任意模型用于自适应分割

Part-aware Prompted Segment Anything Model for Adaptive Segmentation

Department of Computer Science and Engineering, University of Michigan(计算机科学与工程系,密歇根大学);Department of Electrical and Computer Engineering, University of Michigan(电气与计算机工程系,密歇根大学)

Chenhui Zhao, Liyue Shen

AI总结:

提出部件感知提示的段任意模型($P^2SAM$),无需微调,仅凭一次性数据即可自适应新患者,通过部件级多点提示和分布引导检索提升分割性能,在两个医学应用和自然图像任务中均显著提升。

摘要:

精准医疗,例如由医学图像分析辅助的患者自适应治疗,对分割算法在适应新患者方面提出了新的挑战,这源于不同患者之间的巨大差异以及每位患者标注数据的有限可用性。在本工作中,我们提出了一种数据高效的分割算法,即部件感知提示的段任意模型($P^2SAM$)。无需任何模型微调,$P^2SAM$仅依靠一次性患者特定数据即可无缝适应任何新患者。我们引入了一种新颖的部件感知提示机制,基于一次性数据的部件级特征选择多点提示,该机制可广泛集成到不同的可提示分割模型中,如SAM和SAM 2。此外,为了确定每个特定案例的最佳部件数量,我们提出了一种分布引导的检索方法,进一步增强了部件感知提示机制的鲁棒性。$P^2SAM$在两个不同的患者自适应分割应用中分别将平均Dice分数提升了+8.0%和+2.0%。此外,$P^2SAM$在自然图像领域的其他自适应分割任务中也展现出令人印象深刻的泛化能力,例如在个性化对象分割任务中mIoU提升了+6.4%。代码可在以下网址获取:https://github.com/Zch0414/p2sam

英文摘要:

Precision medicine, such as patient-adaptive treatments assisted by medical image analysis, poses new challenges for segmentation algorithms in adapting to new patients, due to the large variability across different patients and the limited availability of annotated data for each patient. In this work, we propose a data-efficient segmentation algorithm, namely Part-aware Prompted Segment Anything Model ($P^2SAM$). Without any model fine-tuning, $P^2SAM$ enables seamless adaptation to any new patients relying only on one-shot patient-specific data. We introduce a novel part-aware prompt mechanism to select multiple-point prompts based on the part-level features of the one-shot data, which can be extensively integrated into different promptable segmentation models, such as SAM and SAM 2. Moreover, to determine the optimal number of parts for each specific case, we propose a distribution-guided retrieval approach that further enhances the robustness of the part-aware prompt mechanism. $P^2SAM$ improves the performance by +8.0% and +2.0% mean Dice score for two different patient-adaptive segmentation applications, respectively. In addition, $P^2SAM$ also exhibits impressive generalizability in other adaptive segmentation tasks in the natural image domain, e.g., +6.4% mIoU within personalized object segmentation task. The code is available at: https://github.com/Zch0414/p2sam

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑