arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.08770cs.CV
收藏

S $^3$ R:用于高光谱组织病理学图像分类的自监督光谱回归

S$^3$R: Self-supervised Spectral Regression for Hyperspectral Histopathology Image Classification

East China Normal University(华东师范大学)

Xingran Xie, Yan Wang, Qingli Li

摘要:

得益于高光谱图像(HSI)中丰富而详细的光谱信息,HSI为计算病理学等各种医学应用提供了巨大的潜力。但是,缺乏足够的注释数据和高空间光谱维度的HSI通常使分类网络容易过拟合。因此,学习一个可以转移到下游任务的一般表示是必要的。据我们所知,没有适当的自我监督的预训练方法已被设计用于组织病理学HSI。在本文中,我们介绍了一个高效和有效的自监督谱回归(S $^3$ R)方法,它利用了低秩的特点,在谱域的HSI。更具体地说,我们建议学习一组线性系数,通过屏蔽这些波段,这些线性系数可以用来表示剩余波段的一个波段。然后,通过使用学习的系数来重新加权剩余的频带来恢复频带。设计了两个文本前任务:(1)S $^3$ R-CR,对线性系数进行回归,使预训练后的模型理解HSI的内在结构和不同形态的病理特征;(2)S $^3$ R-BR,对缺失的带进行回归,使模型学习HSI的整体语义。与现有技术相比,对比学习方法,它侧重于自然图像,S $^3$ R收敛速度至少快3倍,并实现了显着提高高达14%的准确性时,转移到HSI分类任务。

英文摘要:

Benefited from the rich and detailed spectral information in hyperspectral images (HSI), HSI offers great potential for a wide variety of medical applications such as computational pathology. But, the lack of adequate annotated data and the high spatiospectral dimensions of HSIs usually make classification networks prone to overfit. Thus, learning a general representation which can be transferred to the downstream tasks is imperative. To our knowledge, no appropriate self-supervised pre-training method has been designed for histopathology HSIs. In this paper, we introduce an efficient and effective Self-supervised Spectral Regression (S$^3$R) method, which exploits the low rank characteristic in the spectral domain of HSI. More concretely, we propose to learn a set of linear coefficients that can be used to represent one band by the remaining bands via masking out these bands. Then, the band is restored by using the learned coefficients to reweight the remaining bands. Two pre-text tasks are designed: (1)S$^3$R-CR, which regresses the linear coefficients, so that the pre-trained model understands the inherent structures of HSIs and the pathological characteristics of different morphologies; (2)S$^3$R-BR, which regresses the missing band, making the model to learn the holistic semantics of HSIs. Compared to prior arts i.e., contrastive learning methods, which focuses on natural images, S$^3$R converges at least 3 times faster, and achieves significant improvements up to 14% in accuracy when transferring to HSI classification tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑