Whole Slide Images (WSIs) in digital pathology are used to diagnose cancer subtypes. The difference in procedures to acquire WSIs at various trial sites gives rise to variability in the histopathology images, thus making consistent diagnosis challenging. These differences may stem from variability in image acquisition through multi-vendor scanners, variable acquisition parameters, and differences in staining procedure; as well, patient demographics may bias the glass slide batches before image acquisition. These variabilities are assumed to cause a domain shift in the images of different hospitals. It is crucial to overcome this domain shift because an ideal machine-learning model must be able to work on the diverse sources of images, independent of the acquisition center. A domain generalization technique is leveraged in this study to improve the generalization capability of a Deep Neural Network (DNN), to an unseen histopathology image set (i.e., from an unseen hospital/trial site) in the presence of domain shift. According to experimental results, the conventional supervised-learning regime generalizes poorly to data collected from different hospitals. However, the proposed hospital-agnostic learning can improve the generalization considering the low-dimensional latent space representation visualization, and classification accuracy results.
Discrepancy Minimization Improves Cross-Hospital Robustness in Digital Pathology
Reichman University, Herzliya, Israel（以色列海法大学）；Institute of Pathology, Sheba Medical Center, Ramat-Gan, Israel（以色列沙巴医疗中心病理研究所）；Technion - Israel Institute of Technology, Haifa, Israel（以色列技术学院）
A Utility-preserving De-identification Pipeline for Cross-hospital Radiology Data Sharing
Shandong University（山东大学）；Australian National University（澳大利亚国立大学）；Hong Kong University of Science and Technology（香港科技大学）；Curtin University（科廷大学）；Edith Cowan University（埃迪斯科文大学）；University of Western Australia（西澳大利亚大学）
Deep learning (DL) has shown great potential in digital pathology applications. The robustness of a diagnostic DL-based solution is essential for safe clinical deployment. In this work we evaluate if adding uncertainty estimates for DL predictions in digital pathology could result in increased value for the clinical applications, by boosting the general predictive performance or by detecting mispredictions. We compare the effectiveness of model-integrated methods (MC dropout and Deep ensembles) with a model-agnostic approach (Test time augmentation, TTA). Moreover, four uncertainty metrics are…
The use of ImageNet pre-trained networks is becoming widespread in the medical imaging community. It enables training on small datasets, commonly available in medical imaging tasks. The recent emergence of a large Chest X-ray dataset opened the possibility for learning features that are specific to the X-ray analysis task. In this work, we demonstrate that the features learned allow for better classification results for the problem of Tuberculosis detection and enable generalization to an unseen dataset. To accomplish the task of feature learning, we train a DenseNet-121 CNN on 112K images fro…
Towards contrast- and pathology-agnostic clinical fetal brain MRI segmentation using SynthSeg
University Children’s Hospital Zurich（苏黎世大学儿童医院）；ETH Zurich（苏黎世联邦理工学院）；University of Zurich（苏黎世大学）；Medical University of Vienna（维也纳医科大学）；CIBM Center for Biomedical Imaging（CIBM生物医学成像中心）；University of Lausanne（洛桑大学）；Lausanne University Hospital（洛桑大学医院）；King's College London（伦敦国王学院）；University Hospital Erlangen（埃尔朗根大学医院）；Spanish National Research Council (CSIC)（西班牙国家研究委员会）；Universitat Politècnica de València（瓦伦西亚理工大学）
Xi’an Jiaotong University（西安交通大学）；Pennsylvania State University（宾夕法尼亚州立大学）；the First Affiliated Hospital of Xi’an Jiaotong University（西安交通大学第一附属医院）
Digital pathology plays a crucial role in the development of artificial intelligence in the medical field. The digital pathology platform can make the pathological resources digital and networked, and realize the permanent storage of visual data and the synchronous browsing processing without the limitation of time and space. It has been widely used in various fields of pathology. However, there is still a lack of an open and universal digital pathology platform to assist doctors in the management and analysis of digital pathological sections, as well as the management and structured descripti…
Korea Advanced Institute of Science and Technology (KAIST)（韩国科学技术院）；Kim Jaechul Graduate School of AI（金在彻人工智能研究生院）
Federated learning, which shares the weights of the neural network across clients, is gaining attention in the healthcare sector as it enables training on a large corpus of decentralized data while maintaining data privacy. For example, this enables neural network training for COVID-19 diagnosis on chest X-ray (CXR) images without collecting patient CXR data across multiple hospitals. Unfortunately, the exchange of the weights quickly consumes the network bandwidth if highly expressive network architecture is employed. So-called split learning partially solves this problem by dividing a neural…
HistoColAi: An Open-Source Web Platform for Collaborative Digital Histology Image Annotation with AI-Driven Predictive Integration
Instituto Universitario de Investigación en Tecnología Centrada en el Ser Humano, Universitat Politècnica de València（瓦伦西亚理工大学以人为中心技术大学研究院）；valgrAI: Valencian Graduate School and Research Network of Artificial Intelligence（瓦伦西亚人工智能研究生院及研究网络）；ÉTS Montréal（蒙特利尔工程学院）
Detecting Domain Shift in Multiple Instance Learning for Digital Pathology Using Fréchet Domain Distance
Center for Medical Imaging Science and Visualization, Linköping University, University Hospital（林雪平大学 医学影像科学与可视化中心，大学医院）；Department of Science and Technology, Linköping University（林雪平大学 科学技术系）；Department of Biomedical and Clinical Sciences, Linköping University（林雪平大学 生物医学与临床科学系）；Sectra AB（塞克特拉公司）
Feature-level Site Leakage Reduction for Cross-Hospital Chest X-ray Transfer via Self-Supervised Learning
University of Mentouri Brothers Constantine 1（君士坦丁兄弟门图里大学）；LRIA Laboratory, University of Science and Technology Houari Boumediene (USTHB)（LRIA实验室，胡阿里·布迈丁科技大学）；LSIACIO Laboratory, University of Mentouri Brothers Constantine 1（LSIACIO实验室，君士坦丁兄弟门图里大学）；University of Paris-VIII-Vincennes-Saint-Denis（巴黎第八大学）
Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs
University of Stavanger（斯塔万格大学）；University Medical Center Rotterdam（鹿特丹大学医学中心）；Erasmus MC Cancer Institute（伊拉斯姆斯大学医学中心癌症研究所）；Stavanger University Hospital（斯塔万格大学医院）；INCLIVA Biomedical Research Institute（INCLIVA生物医学研究所）；University of Valencia（瓦伦西亚大学）
From Whole-slide Image to Biomarker Prediction: A Protocol for End-to-End Deep Learning in Computational Pathology
Technical University Dresden（德累斯顿工业大学）；University of St Andrews（圣安德鲁斯大学）；Helmholtz Munich – German Research Center for Environment and Health（亥姆霍兹慕尼黑中心-德国环境与健康研究中心）；Technical University of Munich（慕尼黑工业大学）；University Hospital Aachen（亚琛大学医院）；University Medical Center Mainz（美因茨大学医学中心）；University of Leeds（利兹大学）；National Center for Tumor Diseases (NCT)（国家肿瘤疾病中心 (NCT)）；University Hospital Heidelberg（海德堡大学医院）；Technische Universität Dresden（德累斯顿工业大学）
MorphDistill: Distilling Unified Morphological Knowledge from Pathology Foundation Models for Colorectal Cancer Survival Prediction
Department of Pathology, College of Medicine, The Ohio State University Wexner Medical Center（俄亥俄州立大学医学学院病理学系，韦克斯纳医学中心）；Center for Artificial Intelligence Research, Wake Forest University School of Medicine（威克森林大学医学院人工智能研究中心）
Towards a Visual-Language Foundation Model for Computational Pathology
Brigham and Women’s Hospital（布莱根妇女医院）；Harvard Medical School（哈佛医学院）；Massachusetts General Hospital（麻省总医院）；Broad Institute of Harvard and MIT（哈佛-麻省理工学院博德研究所）；Dana-Farber Cancer Institute（丹娜-法伯癌症研究所）；Massachusetts Institute of Technology (MIT)（麻省理工学院）；Harvard-MIT（哈佛-麻省理工学院）；Harvard John A. Paulson School of Engineering And Applied Sciences, Harvard University（哈佛大学约翰·A·保尔森工程与应用科学学院）；Wexner Medical Center, Ohio State University（俄亥俄州立大学韦克斯纳医学中心）；Harvard Data Science Initiative, Harvard University（哈佛大学数据科学计划）
A General-Purpose Self-Supervised Model for Computational Pathology
Brigham and Women’s Hospital（布莱根妇女医院）；Harvard Medical School（哈佛医学院）；Massachusetts General Hospital（麻省总医院）；Broad Institute of Harvard and MIT（哈佛-麻省理工博德研究所）；Dana-Farber Cancer Institute（丹娜-法伯癌症研究所）；Massachusetts Institute of Technology（麻省理工学院）；Harvard John A. Paulson School of Engineering And Applied Sciences, Harvard University（哈佛大学约翰·A·保尔森工程与应用科学学院）；Harvard University（哈佛大学）
Digital pathology has attracted significant attention in recent years. Analysis of Whole Slide Images (WSIs) is challenging because they are very large, i.e., of Giga-pixel resolution. Identifying Regions of Interest (ROIs) is the first step for pathologists to analyse further the regions of diagnostic interest for cancer detection and other anomalies. In this paper, we investigate the use of RCNN, which is a deep machine learning technique, for detecting such ROIs only using a small number of labelled WSIs for training. For experimentation, we used real WSIs from a public hospital pathology s…
A multimodal vision foundation model for generalizable knee pathology
Beihang University（北京航空航天大学）；Peking University Third Hospital（北京大学第三医院）；Institute of Sports Medicine of Peking University（北京大学运动医学研究所）；Ministry of Education（教育部）
Can We Simplify Slide-level Fine-tuning of Pathology Foundation Models?
Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；University of Oxford（牛津大学）；The First Affiliated Hospital of Sun Yat-sen University（中山大学附属第一医院）；University of Washington（华盛顿大学）
Generative Deep Learning for Computational Destaining and Restaining of Unregistered Digital Pathology Images
Department of Computer Science University of California Irvine, CA, USA（计算机科学系 加州大学 伊藤市 加州 USA）；Department of Pathology Stanford University Stanford, CA, USA（病理学系 斯坦福大学 斯坦福市 加州 USA）
Suboptimal generalization of machine learning models on unseen data is a key challenge which hampers the clinical applicability of such models to medical imaging. Although various methods such as domain adaptation and domain generalization have evolved to combat this challenge, learning robust and generalizable representations is core to medical image understanding, and continues to be a problem. Here, we propose STRAP (Style TRansfer Augmentation for histoPathology), a form of data augmentation based on random style transfer from non-medical style source such as artistic paintings, for learni…
University of Leeds（利兹大学）；Newcastle University（纽卡斯尔大学）
Determining early-stage prognostic markers and stratifying patients for effective treatment are two key challenges for improving outcomes for melanoma patients. Previous studies have used tumour transcriptome data to stratify patients into immune subgroups, which were associated with differential melanoma specific survival and potential treatment strategies. However, acquiring transcriptome data is a time-consuming and costly process. Moreover, it is not routinely used in the current clinical workflow. Here we attempt to overcome this by developing deep learning models to classify gigapixel H&…
Modality-Agnostic Input Channels Enable Segmentation of Brain lesions in Multimodal MRI with Sequences Unavailable During Training
Department of Engineering Science, University of Oxford, Oxford, UK（工程科学系，牛津大学，牛津，英国）；Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK（牛津大学临床神经科学系，牛津，英国）
Decision support tools that rely on supervised learning require large amounts of expert annotations. Using past radiological reports obtained from hospital archiving systems has many advantages as training data above manual single-class labels: they are expert annotations available in large quantities, covering a population-representative variety of pathologies, and they provide additional context to pathology diagnoses, such as anatomical location and severity. Learning to auto-generate such reports from images present many challenges such as the difficulty in representing and generating long…
CoM$^3$eT: A foundation model for medical image analysis through federated, multidimensional context integration
Fraunhofer Institute for Digital Medicine MEVIS（弗劳恩霍夫数字医学MEVIS研究所）；RWTH Aachen University（亚琛工业大学）；Medizinische Hochschule Hannover（汉诺威医学院）；Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；Charité – Universitätsmedizin Berlin（柏林夏里特医学院）；Freie Universität Berlin（柏林自由大学）；Humboldt-Universität zu Berlin（柏林洪堡大学）
Pathology-Informed Latent Diffusion Model for Anomaly Detection in Lymph Node Metastasis
School of Electrical Engineering, Korea University, Seoul 02841, Korea（韩国大学电子工程学院）；Department of Pathology, Korea University Anam Hospital and Department of Biomedical Informatics, Korea University College of Medicine, Seoul 02841, Korea（韩国大学医学院病理学系）；Department of Hospital Pathology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Korea（韩国天主大学医学院圣玛丽医院医院病理学系）
Pediatric brain tumor classification using digital histopathology and deep learning: evaluation of SOTA methods on a multi-center Swedish cohort
Department of Biomedical Engineering, Linköping University, Sweden（生物医学工程系，利厄普大学）；Center for Medical Image Science and Visualization, Linköping University, Sweden（医学影像科学与可视化中心，利厄普大学）；Crown Princess Victoria Children’s Hospital and Department of Health, Medicine and Caring Sciences, Linköping University, Sweden（维多利亚公主儿童医院和健康、医学与关怀科学系，利厄普大学）；Department of Radiology and Department of Health, Medicine and Caring Sciences, Linköping University, Sweden（放射科和健康、医学与关怀科学系，利厄普大学）；Department of Oncology-Pathology, Karolinska Institutet, Solna, Sweden（肿瘤病理学系，卡罗林斯卡研究所，索纳）；Department of Clinical Pathology and Cancer Diagnostics, Karolinska University Hospital, Sweden（临床病理学和癌症诊断系，卡罗林斯卡大学医院）；Department of Radiation Physics and Department of Medical and Health Sciences, Linköping University, Sweden（放射物理系和医学与健康科学系，利厄普大学）
Tissue Aware Nuclei Detection and Classification Model for Histopathology Images
TIA Centre, Department of Computer Science, University of Warwick, UK（沃里克大学计算机科学系TIA中心，英国）；GSK, Artificial Intelligence and Machine Learning, London, UK（葛兰素史克人工智能与机器学习，英国）
