arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2505.06133cs.CV

BrainSegDMlF:一种用于脑病变分割的动态融合增强SAM

BrainSegDMlF: A Dynamic Fusion-enhanced SAM for Brain Lesion Segmentation

Southern University of Science and Technology(南方科技大学);Jarvis Research Center, Tencent YouTu Lab(腾讯优图实验室);Westlake University(西湖大学);Shenzhen University of Advanced Technology(深圳先进技术大学);Tencent YouTu Lab(腾讯优图实验室);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究所,中国科学院)

Hongming Wang, Yifeng Wu, Huimin Huang, Hongtao Wu, Jia-Xuan Jiang, Xiaodong Zhang, Hao Zheng, Xian Wu, Yefeng Zheng, Jinping Xu, Jing Cheng

AI总结:

针对脑病变分割中多模态利用不足、小病变敏感度低及依赖外部提示的问题,提出BrainSegDMLF模型,通过动态模态交互融合、逐层上采样解码器和自动掩码生成实现全自动精准分割。

摘要:

在医学图像分割领域,对大面积脑病变的分割是一项重要且具有挑战性的任务。脑成像中的大面积脑病变表现出高度异质性,病变区域与正常脑组织之间的边界模糊。单层切片中的小病变难以识别,使得对异常区域的准确且可重复的分割及其特征描述变得非常复杂。现有方法存在以下局限性:1)它们仅依赖单模态信息进行学习,忽视了诊断中常用的多模态信息。这阻碍了从多个角度全面获取脑病变信息的能力,并阻止了多模态数据输入的有效整合和利用,从而限制了对病变的整体理解。2)它们受到可用数据量的限制,导致对小病变的敏感性低,难以检测细微的病理变化。3)当前基于SAM的模型依赖外部提示,无法实现自动分割,并在一定程度上影响诊断效率。为了解决这些问题,我们开发了一个专门用于脑病变分割的大规模全自动分割模型,命名为BrainSegDMLF。该模型具有以下特点:1)动态模态交互融合(DMIF)模块,在编码过程中处理并整合多模态数据,为SAM编码器提供更全面的模态信息。2)逐层上采样解码器,使模型即使在数据有限的情况下也能提取丰富的低级和高级特征,从而检测小病变的存在。3)自动分割掩码,使模型无需手动提示即可自动生成病变掩码。

英文摘要:

The segmentation of substantial brain lesions is a significant and challenging task in the field of medical image segmentation. Substantial brain lesions in brain imaging exhibit high heterogeneity, with indistinct boundaries between lesion regions and normal brain tissue. Small lesions in single slices are difficult to identify, making the accurate and reproducible segmentation of abnormal regions, as well as their feature description, highly complex. Existing methods have the following limitations: 1) They rely solely on single-modal information for learning, neglecting the multi-modal information commonly used in diagnosis. This hampers the ability to comprehensively acquire brain lesion information from multiple perspectives and prevents the effective integration and utilization of multi-modal data inputs, thereby limiting a holistic understanding of lesions. 2) They are constrained by the amount of data available, leading to low sensitivity to small lesions and difficulty in detecting subtle pathological changes. 3) Current SAM-based models rely on external prompts, which cannot achieve automatic segmentation and, to some extent, affect diagnostic efficiency.To address these issues, we have developed a large-scale fully automated segmentation model specifically designed for brain lesion segmentation, named BrainSegDMLF. This model has the following features: 1) Dynamic Modal Interactive Fusion (DMIF) module that processes and integrates multi-modal data during the encoding process, providing the SAM encoder with more comprehensive modal information. 2) Layer-by-Layer Upsampling Decoder, enabling the model to extract rich low-level and high-level features even with limited data, thereby detecting the presence of small lesions. 3) Automatic segmentation masks, allowing the model to generate lesion masks automatically without requiring manual prompts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑