arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.11356cs.CV

统计量中的魔鬼:缓解并利用统计差异以实现可泛化的半监督医学图像分割

The Devil is in the Statistics: Mitigating and Exploiting Statistics Difference for Generalizable Semi-supervised Medical Image Segmentation

State Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);National Institute of Healthcare Data Science, Nanjing University(南京大学健康医疗大数据国家研究院);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);School of Data and Computer Science, Shandong Women’s University(山东女子学院数据与计算机科学学院)

Muyang Qiu, Jian Zhang, Lei Qi, Qian Yu, Yinghuan Shi, Yang Gao

AI总结:

针对半监督域泛化医学图像分割中域偏移导致伪标签质量下降的问题,本文提出统计量独立分支与聚合分支相结合的方法,并通过图像级直方图匹配扰动和特征级随机批归一化选择来模拟未见域,在三个医学图像数据集上验证了其有效性。

摘要:

尽管域泛化最近在医学图像分割中取得了成功,但为所有源域进行逐体素标注仍然是巨大的负担。半监督域泛化最近被提出以应对这一挑战,其利用有限的标注数据以及从多个医疗机构收集的大量未标注数据,依赖于在提升泛化能力的同时精确利用未标注数据。在这项工作中,我们观察到医疗机构之间的域偏移会导致不同的特征统计量,由于意外的归一化过程,这会显著降低伪标签的质量。然而,这一现象可以被利用来促进对未见域的泛化。因此,我们提出:1)多个统计量独立分支,以缓解域偏移对可靠伪标签的影响;2)一个统计量聚合分支,用于域不变特征学习。此外,为了模拟具有统计差异的未见域,我们从两个方面着手,即在图像层面采用直方图匹配的扰动,以及在特征层面采用随机批归一化选择策略,从而产生多样化的统计量以扩展训练分布。在三个医学图像数据集上的评估结果表明,与最近的SOTA方法相比,我们的方法具有有效性。代码可在 https://github.com/qiumuyang/SIAB 获取。

英文摘要:

Despite the recent success of domain generalization in medical image segmentation, voxel-wise annotation for all source domains remains a huge burden. Semi-supervised domain generalization has been proposed very recently to combat this challenge by leveraging limited labeled data along with abundant unlabeled data collected from multiple medical institutions, depending on precisely harnessing unlabeled data while improving generalization simultaneously. In this work, we observe that domain shifts between medical institutions cause disparate feature statistics, which significantly deteriorates pseudo-label quality due to an unexpected normalization process. Nevertheless, this phenomenon could be exploited to facilitate unseen domain generalization. Therefore, we propose 1) multiple statistics-individual branches to mitigate the impact of domain shifts for reliable pseudo-labels and 2) one statistics-aggregated branch for domain-invariant feature learning. Furthermore, to simulate unseen domains with statistics difference, we approach this from two aspects, i.e., a perturbation with histogram matching at image level and a random batch normalization selection strategy at feature level, producing diverse statistics to expand the training distribution. Evaluation results on three medical image datasets demonstrate the effectiveness of our method compared with recent SOTA methods. The code is available at https://github.com/qiumuyang/SIAB.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑