arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.15901cs.AIcs.CV
收藏

MatchSeg:通过参考图像匹配实现更优分割

MatchSeg: Towards Better Segmentation via Reference Image Matching

School of Science, The Hong Kong University of Science and Technology(香港科技大学理学院);Sydney Smart Technology College, Northeastern University(东北大学悉尼智能科技学院)

Jiayu Huo, Ruiqiang Xiao, Haotian Zheng, Yang Liu, Sebastien Ourselin, Rachel Sparks

AI总结:

针对医学图像分割依赖大量标注数据的问题,提出MatchSeg框架,结合CLIP筛选相关参考样本与联合注意力模块强化特征交互,在四个公开数据集上实现更优分割性能与域泛化能力。

摘要:

近年来,基于深度学习的自动化医学图像分割方法已取得巨大成功。然而,这类方法严重依赖大规模标注数据集,而获取此类数据集成本高昂且耗时。少样本学习旨在通过使用小型标注数据集(即支持集)来指导为新的未标注图像(即查询集)预测标签,从而解决对标注数据的需求问题。受这一范式启发,我们提出了MatchSeg,这是一种通过策略性参考图像匹配来增强医学图像分割效果的新型框架。我们利用对比语言-图像预训练(CLIP)在构建支持集时筛选高度相关的样本。此外,我们设计了一个联合注意力模块,以强化支持特征与查询特征之间的交互,促进支持集与查询集之间更有效的知识迁移。我们在四个公开数据集上验证了所提方法。实验结果表明,在领域特定和跨域分割任务中,MatchSeg相较于现有方法具备更优的分割性能和强大的域泛化能力。我们的代码已发布于https://github.com/keeplearning-again/MatchSeg。

英文摘要:

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to overcome the need for annotated data by using a small labeled dataset, known as a support set, to guide predicting labels for new, unlabeled images, known as the query set. Inspired by this paradigm, we introduce MatchSeg, a novel framework that enhances medical image segmentation through strategic reference image matching. We leverage contrastive language-image pre-training (CLIP) to select highly relevant samples when defining the support set. Additionally, we design a joint attention module to strengthen the interaction between support and query features, facilitating a more effective knowledge transfer between support and query sets. We validated our method across four public datasets. Experimental results demonstrate superior segmentation performance and powerful domain generalization ability of MatchSeg against existing methods for domain-specific and cross-domain segmentation tasks. Our code is made available at https://github.com/keeplearning-again/MatchSeg

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑