arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2509.24204cs.CVcs.AI

BALR-SAM:面向资源高效医学图像分割的SAM边界感知低秩适配

BALR-SAM: Boundary-Aware Low-Rank Adaptation of SAM for Resource-Efficient Medical Image Segmentation

Shanghai Jiao Tong University(上海交通大学)

Zelin Liu, Sicheng Dong, Bocheng Li, Yixuan Yang, Jiacheng Ruan, Chenxu Zhou, Suncheng Xiang

AI总结:

本文提出BALR-SAM框架,通过引入互补细节增强网络、低秩适配器和低秩张量注意力机制,在仅更新1.8%参数且无需提示的条件下,有效提升了SAM在医学图像分割中的性能与资源效率。

摘要:

像Segment Anything Model(SAM)这样在大规模自然图像数据集上预训练的视觉基础模型,由于缺乏领域特定的适配,在医学图像分割中往往表现不佳。在临床实践中,以极少的资源需求高效地微调此类模型以用于医学下游任务,同时保持强大的性能,是一项具有挑战性的工作。为了解决这些问题,我们提出了BALR-SAM,这是一个边界感知的低秩适配框架,旨在增强SAM在医学成像中的表现。该框架结合了三个量身定制的组件:(1)互补细节增强网络(CDEN),利用深度可分离卷积和多尺度融合来捕获对精确分割至关重要的边界敏感特征;(2)集成到SAM的Vision Transformer块中的低秩适配器,以优化医学语境下的特征表示和注意力,同时显著减少参数空间;(3)掩码解码器中的低秩张量注意力机制,将内存使用量削减75%并提升推理速度。在标准医学分割数据集上的实验表明,BALR-SAM在无需提示的情况下,仅更新其1.8%(11.7M)的参数,便优于包括完全微调的MedSAM在内的多种最先进(SOTA)方法。

英文摘要:

Vision foundation models like the Segment Anything Model (SAM), pretrained on large-scale natural image datasets, often struggle in medical image segmentation due to a lack of domain-specific adaptation. In clinical practice, fine-tuning such models efficiently for medical downstream tasks with minimal resource demands, while maintaining strong performance, is challenging. To address these issues, we propose BALR-SAM, a boundary-aware low-rank adaptation framework that enhances SAM for medical imaging. It combines three tailored components: (1) a Complementary Detail Enhancement Network (CDEN) using depthwise separable convolutions and multi-scale fusion to capture boundary-sensitive features essential for accurate segmentation; (2) low-rank adapters integrated into SAM's Vision Transformer blocks to optimize feature representation and attention for medical contexts, while simultaneously significantly reducing the parameter space; and (3) a low-rank tensor attention mechanism in the mask decoder, cutting memory usage by 75% and boosting inference speed. Experiments on standard medical segmentation datasets show that BALR-SAM, without requiring prompts, outperforms several state-of-the-art (SOTA) methods, including fully fine-tuned MedSAM, while updating just 1.8% (11.7M) of its parameters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑