arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.01737cs.CVcs.AIcs.LG
收藏

RLogist:基于深度强化学习的全切片图像快速观察策略

RLogist: Fast Observation Strategy on Whole-slide Images with Deep Reinforcement Learning

Tencent AI Lab(腾讯人工智能实验室);Shanghai Jiao Tong University(上海交通大学)

Boxuan Zhao, Jun Zhang, Deheng Ye, Jian Cao, Xiao Han, Qiang Fu, Wei Yang

摘要:

计算病理学中的全切片图像(WSI)具有高分辨率和千兆像素大小,但通常具有稀疏的感兴趣区域,这导致切片中每个区域的诊断相关性弱和数据效率低。大多数现有的方法依赖于多实例学习框架,该框架需要在高放大率下对局部补丁进行密集采样。在应用阶段,由于提取块级特征的计算量很大,其局限性是显而易见的。在本文中,我们开发了RLogist,这是一种用于WSI快速观察策略的基准深度强化学习(DRL)方法。模仿人类病理学家的诊断逻辑,我们的RL代理学习如何找到观察值区域并获得多个分辨率级别的代表性特征,而无需在高放大率下分析WSI的每个部分。我们基准我们的方法上的两个全载玻片水平的分类任务,包括检测转移的淋巴结切片的WSI,和肺癌的亚型。实验结果表明,与典型的多实例学习算法相比,RLogist具有较好的分类性能,同时具有较短的观察路径,并且RLogist给出的观察路径具有良好的决策可解释性,其阅读路径导航功能可供病理学家用于教育/辅助目的.我们的代码可从以下网址获得:\url{https://github.com/tencent-ailab/RLogist}。

英文摘要:

Whole-slide images (WSI) in computational pathology have high resolution with gigapixel size, but are generally with sparse regions of interest, which leads to weak diagnostic relevance and data inefficiency for each area in the slide. Most of the existing methods rely on a multiple instance learning framework that requires densely sampling local patches at high magnification. The limitation is evident in the application stage as the heavy computation for extracting patch-level features is inevitable. In this paper, we develop RLogist, a benchmarking deep reinforcement learning (DRL) method for fast observation strategy on WSIs. Imitating the diagnostic logic of human pathologists, our RL agent learns how to find regions of observation value and obtain representative features across multiple resolution levels, without having to analyze each part of the WSI at the high magnification. We benchmark our method on two whole-slide level classification tasks, including detection of metastases in WSIs of lymph node sections, and subtyping of lung cancer. Experimental results demonstrate that RLogist achieves competitive classification performance compared to typical multiple instance learning algorithms, while having a significantly short observation path. In addition, the observation path given by RLogist provides good decision-making interpretability, and its ability of reading path navigation can potentially be used by pathologists for educational/assistive purposes. Our code is available at: \url{https://github.com/tencent-ailab/RLogist}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑