arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2504.04034cs.CV
收藏

UCS: 一种通用的曲线结构分割模型

UCS: A Universal Model for Curvilinear Structure Segmentation

School of Computer Science and Technology, Wuhan University of Science and Technology(武汉理工大学计算机科学与技术学院);Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology(湖北省智能信息处理与实时工业系统重点实验室);Institute for Infocomm Research (I 2 R), Agency for Science, Technology and Research (A*STAR)(信息与通信研究所以及科技研究局)

Kai Zhu, Li Chen, Dianshuo Li, Yunxiang Cao, Jun Cheng

AI总结:

UCS模型通过改进SAM,专为曲线结构分割任务设计,提升跨领域泛化能力和开放集分割性能。

摘要:

曲线结构分割(CSS)在医学影像、景观分析、工业表面检测和植物分析等多个领域中至关重要。尽管现有方法在特定领域内能够实现高性能,但其泛化能力有限。另一方面,大规模模型如分割任何模型(SAM)表现出强大的泛化能力,但并未针对曲线结构进行优化。现有对SAM的改进主要集中在一般物体分割,缺乏专门设计用于CSS任务的结构。为弥合这一差距,我们提出了通用曲线结构分割(UCS)模型,该模型将SAM适应于CSS任务,并进一步增强了其跨领域泛化能力。UCS具有新颖的编码器架构,整合了预训练的SAM编码器,并引入了两个创新:稀疏适配器,战略性地插入以继承预训练SAM编码器的泛化能力,同时最小化微调参数的数量;以及提示生成模块,利用快速傅里叶变换与高通滤波器生成特定曲线的提示。此外,UCS还包含一个掩码解码器,通过双压缩模块消除对手动交互的依赖:层次特征压缩模块,通过聚合采样编码器的输出来增强细节保留;指导特征压缩模块,通过提取和压缩图像驱动的指导特征。在涵盖八个自然曲线结构的内部数据集上进行评估,UCS在医学、工程、自然和植物影像中均表现出最先进的泛化和开放集分割性能,建立了通用CSS的新基准。源代码可在https://github.com/kylechuuuuu/UCS上获取。

英文摘要:

Curvilinear structure segmentation (CSS) is essential in various domains, including medical imaging, landscape analysis, industrial surface inspection, and plant analysis. While existing methods achieve high performance within specific domains, their generalizability is limited. On the other hand, large-scale models such as Segment Anything Model (SAM) exhibit strong generalization but are not optimized for curvilinear structures. Existing adaptations of SAM primarily focus on general object segmentation and lack specialized design for CSS tasks. To bridge this gap, we propose the Universal Curvilinear structure Segmentation (UCS) model, which adapts SAM to CSS tasks while further enhancing its cross-domain generalization. UCS features a novel encoder architecture integrating a pretrained SAM encoder with two innovations: a Sparse Adapter, strategically inserted to inherit the pre-trained SAM encoder's generalization capability while minimizing the number of fine-tuning parameters, and a Prompt Generation module, which leverages Fast Fourier Transform with a high-pass filter to generate curve-specific prompts. Furthermore, the UCS incorporates a mask decoder that eliminates reliance on manual interaction through a dual-compression module: a Hierarchical Feature Compression module, which aggregates the outputs of the sampled encoder to enhance detail preservation, and a Guidance Feature Compression module, which extracts and compresses image-driven guidance features. Evaluated on a comprehensive multi-domain dataset, including an in-house dataset covering eight natural curvilinear structures, UCS demonstrates state-of-the-art generalization and open-set segmentation performance across medical, engineering, natural, and plant imagery, establishing a new benchmark for universal CSS. The source code is available at https://github.com/kylechuuuuu/UCS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑