arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.09440cs.CV
收藏

医学图像的无监督局部判别

Unsupervised Local Discrimination for Medical Images

Shanghai Jiao Tong University(上海交通大学);Xi’an Jiaotong University(西安交通大学);The University of Sydney(悉尼大学);Shanghai Tenth People’s Hospital, Tongji University(同济大学附属上海市第十人民医院);Changchun GeneScience Pharmaceutical Co. LTD(长春金赛药业股份有限公司)

Huai Chen, Renzhen Wang, Xiuying Wang, Jieyu Li, Qu Fang, Hui Li, Jianhao Bai, Qing Peng, Deyu Meng, Lisheng Wang

摘要:

对比学习的目的是从未标记的图像中捕获一般表示以初始化医学分析模型,已被证明在缓解对昂贵注释的高需求方面是有效的。目前的方法主要集中在实例比较学习全局判别特征,然而,忽略了局部细节,以区分微小的解剖结构,病变,和组织。为了解决这一挑战,在本文中,我们提出了一个通用的无监督表示学习框架,命名为本地歧视(LD),学习本地的歧视性特征的医学图像紧密嵌入语义相似的像素和识别区域的相似结构在不同的图像。具体来说,该模型配备了用于逐像素嵌入的嵌入模块和用于生成分割的聚类模块。这两个模块是统一的,通过优化我们的新的区域歧视损失函数在一个互利的机制,这使得我们的模型,以反映结构信息,以及衡量像素和区域的相似性。此外,基于LD,我们提出了一个中心敏感的一次性地标定位算法和形状引导的跨模态分割模型,以促进我们的模型的泛化能力。当转移到下游任务时,通过我们的方法学习的表示显示出更好的泛化能力,优于18种最先进的(SOTA)方法的表示,并在所有12个下游任务中赢得9个。特别是对于具有挑战性的病变分割任务,所提出的方法取得了显着更好的性能。源代码可在https://github.com/HuaiChen-1994/LDLearning上公开获得。

英文摘要:

Contrastive learning, which aims to capture general representation from unlabeled images to initialize the medical analysis models, has been proven effective in alleviating the high demand for expensive annotations. Current methods mainly focus on instance-wise comparisons to learn the global discriminative features, however, pretermitting the local details to distinguish tiny anatomical structures, lesions, and tissues. To address this challenge, in this paper, we propose a general unsupervised representation learning framework, named local discrimination (LD), to learn local discriminative features for medical images by closely embedding semantically similar pixels and identifying regions of similar structures across different images. Specifically, this model is equipped with an embedding module for pixel-wise embedding and a clustering module for generating segmentation. And these two modules are unified through optimizing our novel region discrimination loss function in a mutually beneficial mechanism, which enables our model to reflect structure information as well as measure pixel-wise and region-wise similarity. Furthermore, based on LD, we propose a center-sensitive one-shot landmark localization algorithm and a shape-guided cross-modality segmentation model to foster the generalizability of our model. When transferred to downstream tasks, the learned representation by our method shows a better generalization, outperforming representation from 18 state-of-the-art (SOTA) methods and winning 9 out of all 12 downstream tasks. Especially for the challenging lesion segmentation tasks, the proposed method achieves significantly better performances. The source codes are publicly available at https://github.com/HuaiChen-1994/LDLearning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑