arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2407.03575eess.IVcs.CV

DGR-MIL:在全切片图像分类的多实例学习中探索多样化全局表示

DGR-MIL: Exploring Diverse Global Representation in Multiple Instance Learning for Whole Slide Image Classification

Washington University in St. Louis(圣路易斯华盛顿大学);Clemson University(克莱姆森大学);Arizona State University(亚利桑那州立大学)

Wenhui Zhu, Xiwen Chen, Peijie Qiu, Aristeidis Sotiras, Abolfazl Razi, Yalin Wang

AI总结:

针对多实例学习中实例多样性建模不足的问题,本文提出DGR-MIL方法,通过多样化全局向量、正实例对齐和行列式点过程学习范式,在WSI分类任务上显著超越现有方法。

摘要:

多实例学习(MIL)是弱监督学习中的一种强大方法,通常用于组织学全切片图像(WSI)分类以检测肿瘤病变。然而,现有的主流MIL方法侧重于建模实例之间的相关性,而忽视了实例之间固有的多样性。此外,很少有MIL方法以多样性建模为目标,这些方法在经验上表现出较差的性能且计算成本较高。为了弥补这一差距,我们提出了一种基于多样化全局表示的新型MIL聚合方法(DGR-MIL),通过一组作为所有实例摘要的全局向量来建模实例之间的多样性。首先,我们通过交叉注意力机制将实例相关性转化为实例嵌入与预定义全局向量之间的相似性。这源于这样一个事实:相似的实例嵌入通常会导致与某个全局向量具有更高的相关性。其次,我们提出了两种机制来增强全局向量之间的多样性,使其更能描述整个包:(i)正实例对齐和(ii)一种新颖、高效且具有理论保证的多样化学习范式。具体而言,正实例对齐模块鼓励全局向量与正实例(例如,WSI中包含肿瘤的实例)的中心对齐。为了进一步使全局表示多样化,我们提出了一种利用行列式点过程的新型多样化学习范式。所提出的模型在CAMELYON-16和TCGA-lung cancer数据集上以显著优势超越了最先进的MIL聚合模型。代码可在\url{https://github.com/ChongQingNoSubway/DGR-MIL}获取。

英文摘要:

Multiple instance learning (MIL) stands as a powerful approach in weakly supervised learning, regularly employed in histological whole slide image (WSI) classification for detecting tumorous lesions. However, existing mainstream MIL methods focus on modeling correlation between instances while overlooking the inherent diversity among instances. However, few MIL methods have aimed at diversity modeling, which empirically show inferior performance but with a high computational cost. To bridge this gap, we propose a novel MIL aggregation method based on diverse global representation (DGR-MIL), by modeling diversity among instances through a set of global vectors that serve as a summary of all instances. First, we turn the instance correlation into the similarity between instance embeddings and the predefined global vectors through a cross-attention mechanism. This stems from the fact that similar instance embeddings typically would result in a higher correlation with a certain global vector. Second, we propose two mechanisms to enforce the diversity among the global vectors to be more descriptive of the entire bag: (i) positive instance alignment and (ii) a novel, efficient, and theoretically guaranteed diversification learning paradigm. Specifically, the positive instance alignment module encourages the global vectors to align with the center of positive instances (e.g., instances containing tumors in WSI). To further diversify the global representations, we propose a novel diversification learning paradigm leveraging the determinantal point process. The proposed model outperforms the state-of-the-art MIL aggregation models by a substantial margin on the CAMELYON-16 and the TCGA-lung cancer datasets. The code is available at \url{https://github.com/ChongQingNoSubway/DGR-MIL}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑