arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.04690cs.CVcs.LG
收藏

在多样化病理数据集上对自监督学习进行基准评测

Benchmarking Self-Supervised Learning on Diverse Pathology Datasets

Lunit Inc.(Lunit公司)

Mingu Kang, Heon Song, Seonwook Park, Donggeun Yoo, Sérgio Pereira

AI总结:

本文通过大规模基准评测4种自监督学习方法在病理图像上的表现,证明领域对齐预训练持续优于ImageNet预训练,并提出领域特定技术及首次将SSL应用于细胞核实例分割,取得显著稳定的性能提升。

摘要:

计算病理学有助于挽救人类生命,但模型对标注需求很高,而病理图像的标注成本极为昂贵。自监督学习已被证明是利用未标注数据的有效方法,将其应用于病理学可极大提升下游任务的表现。然而,目前仍缺乏系统性的研究来比较各类自监督学习方法,并探讨如何针对病理学进行适配。为满足这一需求,我们开展了迄今为止最大规模的病理图像自监督预训练研究。本研究使用4种具有代表性的自监督学习方法,在多样化的下游任务上进行评估。我们证实,在病理学领域进行大规模、与领域对齐的预训练,在线性评估、微调评估以及低标注量场景等标准自监督学习设置下,均持续优于ImageNet预训练。此外,我们提出一组领域特定技术,并通过实验证明这些技术能够带来性能提升。最后,我们首次将自监督学习应用于具有挑战性的细胞核实例分割任务,并在多种设置下展示了显著且稳定的性能改进。

英文摘要:

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data, and its application to pathology could greatly benefit its downstream tasks. Yet, there are no principled studies that compare SSL methods and discuss how to adapt them for pathology. To address this need, we execute the largest-scale study of SSL pre-training on pathology image data, to date. Our study is conducted using 4 representative SSL methods on diverse downstream tasks. We establish that large-scale domain-aligned pre-training in pathology consistently out-performs ImageNet pre-training in standard SSL settings such as linear and fine-tuning evaluations, as well as in low-label regimes. Moreover, we propose a set of domain-specific techniques that we experimentally show leads to a performance boost. Lastly, for the first time, we apply SSL to the challenging task of nuclei instance segmentation and show large and consistent performance improvements under diverse settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑