Whole slide image (WSI) processing is becoming part of the key components of standard clinical diagnosis for various diseases. However, the direct application of conventional image processing algorithms to WSI faces certain obstacles because of WSIs' distinct property: the super-high resolution. The performance of most WSI-related tasks relies on the efficacy of the backbone which extracts WSI patch feature representations. Hence, we proposed BROW, a foundation model for extracting better feature representations for WSIs, which can be conveniently adapted to downstream tasks without or with slight fine-tuning. The model takes transformer architecture, pretrained using self-distillation framework. To improve model's robustness, techniques such as patch shuffling have been employed. Additionally, the model leverages the unique properties of WSIs, utilizing WSI's multi-scale pyramid to incorporate an additional global view, thereby further enhancing its performance. We used both private and public data to make up a large pretraining dataset, containing more than 11000 slides, over 180M extracted patches, encompassing WSIs related to various organs and tissues. To assess the effectiveness of \ourmodel, we run a wide range of downstream tasks, including slide-level subtyping, patch-level classification and nuclei instance segmentation. The results confirmed the efficacy, robustness and good generalization ability of the proposed model. This substantiates its potential as foundation model for WSI feature extraction and highlights promising prospects for its application in WSI processing.
SlideGCD: Slide-based Graph Collaborative Training with Knowledge Distillation for Whole Slide Image Classification
School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机与信息工程学院);School of Software, Hefei University of Technology(合肥工业大学软件学院);Image Processing Center, School of Astronautics, Beihang University(北京航空航天大学宇航学院图像处理中心);Beijing Advanced Innovation Center on Biomedical Engineering(北京生物医学工程高精尖创新中心)
Pretraining Multiple Instance Learning Networks with Multi-Teacher Distillation from Pathology Slide Foundation Models
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);University of Washington(华盛顿大学);City University of Hong Kong (Dongguan)(香港城市大学(东莞));Medical Optical Technology R&D Center, Research Institute of Tsinghua(清华研究院医学光学技术研发中心);Jinfeng Laboratory(金凤实验室)
Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning
College of Computer Science, Sichuan University(四川大学计算机学院);Sichuan University-Pittsburgh Institute(四川大学匹兹堡研究院);Department of Pathology West China Hospital, Sichuan University(四川大学华西医院病理科部门);Institute of Clinical Pathology, West China Hospital, Sichuan University(四川大学华西医院临床病理研究所)
Magnification-Aware Distillation (MAD): A Self-Supervised Framework for Unified Representation Learning in Gigapixel Whole-Slide Images
Center for Applied Artificial Intelligence, University of Kentucky(应用人工智能中心,肯塔基大学);Sanders-Brown Center on Aging, University of Kentucky(老龄化桑德斯-布朗中心,肯塔基大学);Department of Electrical and Computer Engineering, University of Kentucky(电气与计算机工程系,肯塔基大学);Division of Neuropathology, University of Pittsburgh(神经病理学部,匹兹堡大学);Department of Biomedical Informatics, Emory University(生物医学信息学系,埃默里大学);Department of Pathology and Laboratory Medicine, University of California Davis(病理学与实验室医学系,加州大学戴维斯分校);Department of Laboratory Medicine and Pathology, University of Texas Health(实验室医学与病理学系,德克萨斯大学健康科学中心)
Advancing Multiple Instance Learning with Continual Learning for Whole Slide Imaging
Dept. of Computer Science(计算机科学系);City University of Hong Kong(香港城市大学);Noah’s Ark Lab, Huawei Canada(华为加拿大诺亚实验室);Guangzhou Bingli Technology Co., Ltd.(广州炳利科技有限公司)
Dataset Distillation for Histopathology Image Classification
Australian Institute of Health Innovation (AIHI), Macquarie University(澳大利亚麦考瑞大学澳大利亚健康创新研究所);School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);School of Computer Science, Peking University(北京大学计算机学院);School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院)
Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation
The Hong Kong University of Science and Technology(香港科技大学);Southern Medical University(南方医科大学);Guangdong Provincial Key Laboratory of Molecular Tumor Pathology(广东省分子肿瘤病理学重点实验室);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital(山东第一医科大学第一附属医院暨山东省千佛山医院);Sun Yat-sen University(中山大学);The Chinese University of Hong Kong(香港中文大学)
Fine-tuning a Multiple Instance Learning Feature Extractor with Masked Context Modelling and Knowledge Distillation
Institute for Biomedical Informatics, Faculty of Medicine(医学院生物医学信息学研究所);University Hospital Cologne, University of Cologne(科隆大学医院(科隆大学));Center for Molecular Medicine Cologne (CMMC), Faculty of Medicine(科隆分子医学中心(CMMC,医学院))
Enhancing WSI-Based Survival Analysis with Report-Auxiliary Self-Distillation
School of Informatics, Xiamen University, Xiamen, China(厦门大学信息学院);Shanghai Innovation Institution, Shanghai, China(上海创新机构);Nanfang Hospital, Southern Medical University, Guangzhou, China(南方医科大学珠江医院);School of Artificial Intelligence and Data Science, University of Science and Technology of China, Hefei, China(中国科学技术大学人工智能与数据科学学院);EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Ales, Ales, France(EuroMov数字健康运动);Service de Médecine Nucléaire, Centre Hospitalier Universitaire de Nîmes, Université de Montpellier, Nîmes, France(蒙彼利埃大学尼姆大学医院核医学服务)
Federated Distillation for Whole Slide Image via Gaussian-Mixture Feature Alignment and Curriculum Integration
School of Computer Science, Peking University, Beijing, China(北京大学计算机科学系);Center for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2113, Australia(健康信息学中心,澳大利亚健康创新研究所,麦考利大学,悉尼,NSW 2113,澳大利亚);School of Data Science, University of Virginia, Charlottesville, VA, USA(数据科学学院,弗吉尼亚大学,夏洛特维尔,VA,美国)
FedWSIDD: Federated Whole Slide Image Classification via Dataset Distillation
Union Hospital, Tongji Medical College, Huazhong University of Science and Technology(华中科技大学同济医学院附属同济医院);Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University(澳大利亚健康创新研究所健康信息中心,麦觉大学)
LadderMIL: Multiple Instance Learning with Coarse-to-Fine Self-Distillation
Institute for Regeneration and Repair, University of Edinburgh(再生与修复研究所,爱丁堡大学);School of Informatics, University of Edinburgh(信息学院,爱丁堡大学);Indica Labs(Indica实验室);School of Medicine, University of St Andrews(医学学院,圣安德鲁斯大学);Department of Basic Pathology, National Defense Medical College(基础病理学部门,国家防卫医疗学院)
Multi-Teacher Contrastive Distillation for Edge-Efficient Pathology Foundation Models
EKFZ for Digital Health(数字健康EKFZ);TU Dresden(德累斯顿工业大学);University of Augsburg(奥格斯堡大学);Bavarian Cancer Research Center (BZKF)(巴伐利亚癌症研究中心);Department of Medicine I, TU Dresden(德累斯顿工业大学第一医学院);NCT Heidelberg(海德堡NCT);University of Leeds(利兹大学)
ContiStain: Cross-Domain Relation-Preserving Distillation for Continual Multi-Domain Virtual IHC Staining
School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)计算机科学与技术学院);School of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
Scalable, Trustworthy Generative Model for Virtual Multi-Staining from H&E Whole Slide Images
Sorbonne Université(索邦大学);CNRS(法国国家科学研究中心);Inserm(法国国家健康与医学研究院);AP-HP(巴黎公共医疗集团);Inria(法国国家信息与自动化研究所);Paris Brain Institute-ICM(巴黎大脑研究所-脑研究所);Paris Cité University(巴黎城市大学);Necker-Enfants Malades University Hospitals(内克尔-儿童马尔代夫大学医院);Centre de recherche sur l’inflammation(炎症研究中心);Robert Debré University Hospitals(罗伯特德布雷大学医院)
University of Liverpool(利物浦大学);Cixi Institute of Biomedical Engineering, Chinese Academy of Sciences(中国科学院慈溪生物医学工程研究所);China Science IntelliCloud Technology Co., Ltd(中科智云科技有限公司);Remark AI UK Limited(Remark AI英国有限公司)
Fusion of Multi-scale Heterogeneous Pathology Foundation Models for Whole Slide Image Analysis
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China(中国科学技术大学生物医学工程学院);Division of Life Science, Department of Chemical and Biological Engineering, State Key Laboratory of Nervous System Disorders, The Hong Kong University of Science and Technology(香港科技大学生命科学系);SIAT-HKUST Joint Laboratory of Cell Evolution and Digital Health, HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute(深圳-香港联合创新研究院细胞进化与数字健康联合实验室);Department of Hepatobiliary Surgery, The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China(中国科学技术大学附属第一医院肝胆外科);Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, USTC, Suzhou, Jiangsu, China(中国科学技术大学苏州先进研究所);Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology, Suzhou, Jiangsu, China(江苏省多模态数字孪生技术重点实验室);Key Laboratory of Precision and Intelligent Chemistry, USTC, Hefei, Anhui, China(中国科学技术大学精准与智能化学重点实验室);Department of Pathology, Chinese PLA General Hospital, Beijing, China(中国人民解放军总医院病理科)
DISC: Latent Diffusion Models with Self-Distillation from Separated Conditions for Prostate Cancer Grading
Scientific Computing and Imaging Institute, University of Utah(犹他大学科学计算与成像研究所);The Catholic University of Korea College of Medicine(韩国天主教大学医学院);Case Western Reserve University(凯斯西储大学);Huntsman Cancer Institute, University of Utah Health(犹他大学健康亨茨曼癌症研究所);University of Utah(犹他大学)
StainNet: Scaling Self-Supervised Foundation Models on Immunohistochemistry and Special Stains for Computational Pathology
Tsinghua Shenzhen International Graduate School, Tsinghua University, China(清华大学深圳国际研究生院);Biomedical Engineering Programme, City University of Hong Kong (Dongguan)(香港城市大学(东莞)生物医学工程项目);Department of Pathology, Affiliated Hospital of Nantong University(南通大学附属医院病理科);Nantong University(南通大学)