arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01951cs.CV
收藏

利用多尺度金字塔网络实现渐进式全切片图像分析

Enabling Progressive Whole-slide Image Analysis with Multi-scale Pyramidal Network

Institute for Regeneration and Repair, University of Edinburgh(再生与修复研究所,爱丁堡大学);School of Informatics, University of Edinburgh(信息学院,爱丁堡大学);Indica Labs, 8700 Education Pl NW, Bldg. B Albuquerque, US(Indica实验室,美国阿尔伯克基8700教育大道西北区B座);Medical School, University of St Andrews(医学学校,圣安德鲁大学)

Shuyang Wu, Yifu Qiu, Ines P Nearchou, Sandrine Prost, Jonathan A Fallowfield, Hakan Bilen, Timothy J Kendall

AI总结:

提出多尺度金字塔网络(MSPN),一种即插即用模块,仅使用单一高倍输入实现渐进式多尺度全切片图像分析,通过网格重映射和粗引导网络学习粗粒度上下文,在多个任务和框架上一致提升MIL性能。

摘要:

多实例学习(MIL)常用于计算病理学(CPath),其中多尺度特征对于捕捉精细细胞细节和广泛组织结构至关重要。然而,现有的多尺度MIL方法通常依赖于不灵活的多倍率输入或计算成本高昂的架构。随着预训练基础模型(FMs)成为特征提取的趋势并推动轻量级模型的发展,我们重新思考并探索更高效的多尺度MIL方法。在本文中,我们提出了多尺度金字塔网络(MSPN),一种用于基于注意力的MIL的即插即用模块。MSPN仅使用单一高倍输入实现渐进式多尺度全切片图像分析。它由(1)基于网格的重映射组成,该重映射聚合高倍特征以导出空间感知的粗粒度特征图,以及(2)粗引导网络(CGN),该网络学习粗粒度上下文。我们将MSPN作为附加模块在4个基于注意力的框架上,针对5个临床相关任务,使用2个基础模型和一个预训练的MIL框架进行基准测试。我们的结果表明,MSPN在比较的配置和任务上一致地提高了MIL性能,同时保持轻量且易于使用。

英文摘要:

Multiple-instance Learning (MIL) is commonly used for computational pathology (CPath), where multi-scale features are essential for capturing both fine cellular details and broad tissue architecture. However, existing multi-scale MIL approaches typically rely on the inflexible multi-magnification inputs or the computationally expensive architectures. As pre-trained foundation models (FMs) become the trend for feature extraction and boost lightweight models, we rethink and explore a more efficient multi-scale MIL method. In this paper, we propose the Multi-scale Pyramidal Network (MSPN), a plug-and-play module for attention-based MIL. MSPN introduces progressive multi-scale whole-slide image analysis using only a single high-magnification input. It consists of (1) grid-based remapping that aggregates high-magnification features to derive spatially-aware coarse feature maps, and (2) the Coarse Guidance Network (CGN) that learns coarse contexts. We benchmark MSPN as an add-on module to 4 attention-based frameworks on 5 clinically relevant tasks with 2 foundation models, and a pre-trained MIL framework. Our results demonstrate that MSPN consistently improves MIL across the compared configurations and tasks, while being lightweight and easy-to-use.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑