arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2501.17822eess.IVcs.AIcs.CVcs.IRq-bio.QM

数字病理中单向量WSI表示学习的聚合方案

Aggregation Schemes for Single-Vector WSI Representation Learning in Digital Pathology

KIMIA Lab, Department of Artificial Intelligence and Informatics, Mayo Clinic(KIMIA实验室,人工智能与信息学系, Mayo诊所)

Sobhan Hemati, Ghazal Alabtah, Saghir Alfasly, H. R. Tizhoosh

AI总结:

针对数字病理中全切片图像(WSI)需单向量表示的需求,评估了多种集合聚合技术在TCGA四个癌种数据集上的WSI检索性能,并与非聚合基准方法对比。

摘要:

在计算病理学中高效整合全切片图像(Whole Slide Images, WSIs)的关键步骤是为每张WSI分配单个高质量特征向量,即一个嵌入。随着众多预训练深度神经网络的存在以及基础模型的兴起,提取子图像(即图块或补丁)的嵌入已变得简单直接。然而,对于WSI而言,鉴于其高分辨率和十亿像素级的特性,将它们作为单张图像输入现有GPU是不可行的。因此,WSI通常被分割为众多补丁。将每个补丁输入预训练模型后,每张WSI便可由一组补丁表示,进而由一组嵌入表示。故而在此类设置下,WSI表示学习可归结为集合表示学习,即对于每张WSI,我们可获取一组补丁嵌入。为从每张WSI的补丁嵌入集合中得到单个嵌入,文献中已提出多种基于集合的学习方案。本文中,我们在TCGA的四个不同原发部位(包括膀胱、乳腺、肾脏和结肠)上,评估了多种近期开发的聚合技术(主要是集合表示学习技术)的WSI检索性能,这些技术包括简单平均或最大池化操作、Deep Sets、记忆网络、Focal attention、高斯混合模型(Gaussian Mixture Model, GMM)Fisher向量,以及深度稀疏与二值Fisher向量。此外,我们还将这些方法的检索性能与补丁嵌入最小距离的中位数这一用于WSI检索的非聚合方法进行了基准对比。

英文摘要:

A crucial step to efficiently integrate Whole Slide Images (WSIs) in computational pathology is assigning a single high-quality feature vector, i.e., one embedding, to each WSI. With the existence of many pre-trained deep neural networks and the emergence of foundation models, extracting embeddings for sub-images (i.e., tiles or patches) is straightforward. However, for WSIs, given their high resolution and gigapixel nature, inputting them into existing GPUs as a single image is not feasible. As a result, WSIs are usually split into many patches. Feeding each patch to a pre-trained model, each WSI can then be represented by a set of patches, hence, a set of embeddings. Hence, in such a setup, WSI representation learning reduces to set representation learning where for each WSI we have access to a set of patch embeddings. To obtain a single embedding from a set of patch embeddings for each WSI, multiple set-based learning schemes have been proposed in the literature. In this paper, we evaluate the WSI search performance of multiple recently developed aggregation techniques (mainly set representation learning techniques) including simple average or max pooling operations, Deep Sets, Memory networks, Focal attention, Gaussian Mixture Model (GMM) Fisher Vector, and deep sparse and binary Fisher Vector on four different primary sites including bladder, breast, kidney, and Colon from TCGA. Further, we benchmark the search performance of these methods against the median of minimum distances of patch embeddings, a non-aggregating approach used for WSI retrieval.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑