arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.07570cs.CV
收藏

ScoreNet:学习非均匀注意和增强用于基于变换器的历史学图像分类

ScoreNet: Learning Non-Uniform Attention and Augmentation for Transformer-Based Histopathological Image Classification

EPFL(洛桑联邦理工学院);CHUV(洛桑大学附属医院);CIBM(生物医学成像中心)

Thomas Stegmüller, Behzad Bozorgtabar, Antoine Spahr, Jean-Philippe Thiran

摘要:

数字病理学的进展受到高分辨率图像和详尽的本地化注释的高昂成本的阻碍。病理图像分类的常用范例是基于块的处理,其通常结合多实例学习(MIL)来聚合局部块级表示,从而产生图像级预测。尽管如此,诊断相关区域可能只占整个组织的一小部分,并且当前基于MIL的方法通常均匀地处理图像,丢弃斑块间的相互作用。为了缓解这些问题,我们提出了ScoreNet,一个新的高效的Transformer,利用可区分的推荐阶段,提取有区别的图像区域,并相应地专用计算资源。建议的Transformer利用本地和全球的注意力的一些动态推荐的高分辨率区域在一个有效的计算成本。我们进一步引入了一种新的混合数据增强,即ScoreMix,利用图像的语义分布来指导数据混合,并产生连贯的样本标签对。ScoreMix非常简单,并且减轻了以前增强的缺陷,这些缺陷假设了统一的语义分布并冒着错误标记样本的风险。对苏木精和伊红(H&E)的三个乳腺癌组织学数据集的彻底实验和消融研究已经验证了我们的方法相对于现有技术的优越性,包括基于变换器的肿瘤感兴趣区域(TRoI)分类模型。配备了建议的ScoreMix增强的ScoreNet展示了更好的泛化能力,并实现了新的最先进的(SOTA)结果,与其他混合增强变体相比,只有50%的数据。最后,ScoreNet具有高效率,优于SOTA高效Transformers,即TransPath和SwinTransformer。

英文摘要:

Progress in digital pathology is hindered by high-resolution images and the prohibitive cost of exhaustive localized annotations. The commonly used paradigm to categorize pathology images is patch-based processing, which often incorporates multiple instance learning (MIL) to aggregate local patch-level representations yielding image-level prediction. Nonetheless, diagnostically relevant regions may only take a small fraction of the whole tissue, and current MIL-based approaches often process images uniformly, discarding the inter-patches interactions. To alleviate these issues, we propose ScoreNet, a new efficient transformer that exploits a differentiable recommendation stage to extract discriminative image regions and dedicate computational resources accordingly. The proposed transformer leverages the local and global attention of a few dynamically recommended high-resolution regions at an efficient computational cost. We further introduce a novel mixing data-augmentation, namely ScoreMix, by leveraging the image's semantic distribution to guide the data mixing and produce coherent sample-label pairs. ScoreMix is embarrassingly simple and mitigates the pitfalls of previous augmentations, which assume a uniform semantic distribution and risk mislabeling the samples. Thorough experiments and ablation studies on three breast cancer histology datasets of Haematoxylin & Eosin (H&E) have validated the superiority of our approach over prior arts, including transformer-based models on tumour regions-of-interest (TRoIs) classification. ScoreNet equipped with proposed ScoreMix augmentation demonstrates better generalization capabilities and achieves new state-of-the-art (SOTA) results with only 50% of the data compared to other mixing augmentation variants. Finally, ScoreNet yields high efficacy and outperforms SOTA efficient transformers, namely TransPath and SwinTransformer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑