Whole-slide images (WSI) in computational pathology have high resolution with gigapixel size, but are generally with sparse regions of interest, which leads to weak diagnostic relevance and data inefficiency for each area in the slide. Most of the existing methods rely on a multiple instance learning framework that requires densely sampling local patches at high magnification. The limitation is evident in the application stage as the heavy computation for extracting patch-level features is inevitable. In this paper, we develop RLogist, a benchmarking deep reinforcement learning (DRL) method for fast observation strategy on WSIs. Imitating the diagnostic logic of human pathologists, our RL agent learns how to find regions of observation value and obtain representative features across multiple resolution levels, without having to analyze each part of the WSI at the high magnification. We benchmark our method on two whole-slide level classification tasks, including detection of metastases in WSIs of lymph node sections, and subtyping of lung cancer. Experimental results demonstrate that RLogist achieves competitive classification performance compared to typical multiple instance learning algorithms, while having a significantly short observation path. In addition, the observation path given by RLogist provides good decision-making interpretability, and its ability of reading path navigation can potentially be used by pathologists for educational/assistive purposes. Our code is available at: \url{https://github.com/tencent-ailab/RLogist}.
多实例学习(MIL)是用于整个切片图像分类的优选方法。然而,大多数MIL方法不利用从整个幻灯片图像中提取的瓦片的相互依赖性,这可以为分类提供有价值的线索。本文提出了一种新的MIL方法,利用瓷砖的空间关系分类整个幻灯片图像。为此,从瓦片嵌入构建稀疏映射,然后通过稀疏输入CNN进行分类。它在涉及10000张全切片图像的癌症亚型分类方面获得了超过流行的MIL方法的最先进性能。我们的研究结果表明,所提出的方法可以(i)提高表示学习的实例和(ii)利用上下文的实例嵌入,以提高分类性能。这个工作的代码是开源的{github censored for review}。
Comparison of Different Methods for Tissue Segmentation in Histopathological Whole-Slide Images
Radboud University Medical Center(拉德堡德大学医学中心)
组织分割是数字病理学中高效准确诊断的重要前提。然而,众所周知,例如由于组织类型,或者由于弱染色,全载玻片扫描仪可能无法检测所有组织区域,因为它们的组织检测算法不够鲁棒。在本文中,我们介绍了两种不同的卷积神经网络架构的整个幻灯片图像分割,准确地识别组织切片。我们还比较了算法的出版的传统方法。我们从三个实验室收集了54张不同染色和组织类型的全载玻片图像,以验证我们的算法。我们发现,虽然这两种方法没有显着差异,但它们优于传统方法(Jaccard指数为0.937和0.929 vs. 0.870,p <0.01)。
University of Liverpool(利物浦大学);Cixi Institute of Biomedical Engineering, Chinese Academy of Sciences(中国科学院慈溪生物医学工程研究所);China Science IntelliCloud Technology Co., Ltd(中科智云科技有限公司);Remark AI UK Limited(Remark AI英国有限公司)
Restoration of marker occluded hematoxylin and eosin stained whole slide histology images using generative adversarial networks
Image Data Analytics, Informatics IT, Merck \& Co., Inc., West Point, PA 19486, USA Image Data Analytics, Informatics IT, Merck \& Co., Inc., Rahway, NJ 07065, USA
Whole-Slide Image Analysis under Realistic Few-Shot Annotation Protocols
Institute of Information and Communication Technologies, Electronics, and Applied Mathematics (ICTEAM), Université catholique de Louvain (UCLouvain)(天主教鲁汶大学信息与通信技术、电子与应用数学研究所)
针对现实 whole-slide 图像场景的小样本标注问题,提出 SlideCRF 模型,结合空间与生物线索优化预测,在四个数据集上宏观 F1 较现有转导方法更优,零样本预测提升显著。
A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model
The Hong Kong University of Science and Technology(香港科技大学);Southern Medical University(南方医科大学);Guangdong Provincial Key Laboratory of Molecular Tumor Pathology(广东省分子肿瘤病理学重点实验室);Jinfeng Laboratory(金凤实验室);Shandong First Medical University(山东第一医科大学);Shandong Provincial Qianfoshan Hospital(山东省千佛山医院);The Third Affiliated Hospital of Kunming Medical University(昆明医科大学第三附属医院);Yunnan Cancer Hospital(云南省肿瘤医院);The Chinese University of Hong Kong(香港中文大学);Prince of Wales Hospital(威尔士亲王医院);Sun Yat-sen University(中山大学)
WSI-VQA: Interpreting Whole Slide Images by Generative Visual Question Answering
Zhejiang University(浙江大学);Research Center for Industries of the Future, Westlake University(西湖大学未来产业研究中心);School of Engineering, Westlake University(西湖大学工程学院)
HistomicsML2.0: Fast interactive machine learning for whole slide imaging data
Weisberg Division of Computer Science, Marshall University(马歇尔大学魏斯伯格计算机科学分部);Kitware, Inc.(Kitware公司);Emory University School of Medicine(埃默里大学医学院);National Cancer Institute(美国国家癌症研究所);Cairo University(开罗大学);Northwestern University Feinberg School of Medicine(西北大学费恩伯格医学院)
Stony Brook University(石溪大学);Argonne National Laboratory(阿贡国家实验室);University of Chicago(芝加哥大学);The University of Utah(犹他大学);The University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)
Overcoming the limitations of patch-based learning to detect cancer in whole slide images
University of Toronto(多伦多大学);University of British Columbia(不列颠哥伦比亚大学);Sunnybrook Health Science Center(森尼布鲁克健康科学中心);Sunnybrook Research Institute(森尼布鲁克研究所)
Dynamic Residual Encoding with Slide-Level Contrastive Learning for End-to-End Whole Slide Image Representation
School of Computer Science and Enginecring, Central South University(计算机科学与工程学院,中南大学);School of Computer Science(计算机科学学院);Enginecring, Central South University(工程学院,中南大学)
Enhancing Whole Slide Image Classification through Supervised Contrastive Domain Adaptation
HUMAN-tech;Universidad Politécnica de Valencia (UPV)(瓦伦西亚理工大学);Valencian Graduate School and Research Network for Artificial Intelligence (valgrAI)(瓦伦西亚人工智能研究生学院及研究网络)
WsiCaption: Multiple Instance Generation of Pathology Reports for Gigapixel Whole-Slide Images
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Research Center for Industries of the Future, Westlake University(西湖大学未来产业研究中心);School of Engineering, Westlake University(西湖大学工程学院)
DPsurv: Dual-Prototype Evidential Fusion for Uncertainty-Aware and Interpretable Whole-Slide Image Survival Prediction
National University of Singapore;National University of Singapore Guangzhou Research Translation;Innovation Institute;Imperial College London;Peking Union Medical College Hospital, Chinese Academy of Medical Sciences \& Peking Union Medical College;Hunan University;Institute of High Performance Computing, Agency for Science, Technology;Research (A STAR)
Embedding Space Augmentation for Weakly Supervised Learning in Whole-Slide Images
University College London(伦敦大学学院);Brigham and Women's Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);Massachusetts General Hospital(麻省总医院);Broad Institute of Harvard and MIT(哈佛-麻省理工博德研究所);Dana-Farber Cancer Institute(达纳-法伯癌症研究所);University of Warwick(华威大学);University Hospitals Coventry and Warwickshire NHS Trust(考文垂与沃里克郡国民保健服务信托大学医院);The Alan Turing Institute(艾伦·图灵研究所)
EviPathBench: Benchmarking Evidence Acquisition and Reasoning in Vision-Language Models for Whole-Slide Pathology
National University of Singapore(新加坡国立大学);PuzzleLogic Pte Ltd(拼图逻辑私人有限公司);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学深圳校区);Peking Union Medical College Hospital(北京协和医院)