While Multiple Instance Learning (MIL) has shown promising results in digital Pathology Whole Slide Image (WSI) classification, such a paradigm still faces performance and generalization problems due to challenges in high computational costs on Gigapixel WSIs and limited sample size for model training. To deal with the computation problem, most MIL methods utilize a frozen pretrained model from ImageNet to obtain representations first. This process may lose essential information owing to the large domain gap and hinder the generalization of model due to the lack of image-level training-time augmentations. Though Self-supervised Learning (SSL) proposes viable representation learning schemes, the improvement of the downstream task still needs to be further explored in the conversion from the task-agnostic features of SSL to the task-specifics under the partial label supervised learning. To alleviate the dilemma of computation cost and performance, we propose an efficient WSI fine-tuning framework motivated by the Information Bottleneck theory. The theory enables the framework to find the minimal sufficient statistics of WSI, thus supporting us to fine-tune the backbone into a task-specific representation only depending on WSI-level weak labels. The WSI-MIL problem is further analyzed to theoretically deduce our fine-tuning method. Our framework is evaluated on five pathology WSI datasets on various WSI heads. The experimental results of our fine-tuned representations show significant improvements in both accuracy and generalization compared with previous works. Source code will be available at https://github.com/invoker-LL/WSI-finetuning.
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Academy for Engineering and Technology, Fudan University(复旦大学工程与技术学院);Fudan University Shanghai Cancer Center(复旦大学附属肿瘤医院);Zhongshan Hospital, Fudan University(复旦大学中山医院)
Hybrid Supervision Learning for Pathology Whole Slide Image Classification
SenseTime Research(商汤科技研究院);Rutgers University(罗格斯大学);The Chinese University of Hong Kong(香港中文大学);Centre for Perceptual and Interactive Intelligence (CPII) Ltd(感知与交互智能中心有限公司)
Augmenting the Pathology Lab: An Intelligent Whole Slide Image Classification System for the Real World
Proscia Inc.(Proscia 公司);Boonshoft School of Medicine, Wright State University School of Medicine(莱特州立大学医学院布恩肖夫特医学院);Dermatopathology Laboratory of Central States(中部各州皮肤病理学实验室);University of Florida College of Medicine(佛罗里达大学医学院);Cockerell Dermatopathology(科克雷尔皮肤病理学机构);Sidney Kimmel Medical College at Thomas Jefferson University(托马斯杰斐逊大学西德尼·金梅尔医学院)
Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathology
Institute of Pathology, Technical University of Munich(慕尼黑工业大学病理研究所);Computer Aided Medical Procedures (CAMP), Technical University of Munich(慕尼黑工业大学计算机辅助医疗程序(CAMP));Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Department of Human Pathology, Juntendo University Graduate School of Medicine(顺天堂大学医学研究生院人体病理学部);The Hong Kong University of Science and Technology(香港科技大学);Munich Data Science Institute (MDSI)(慕尼黑数据科学研究所)
Memory-Augmented Incomplete Multimodal Survival Prediction via Cross-Slide and Gene-Attentive Hypergraph Learning
Faculty of Computing, Harbin Institute of Technology(哈尔滨工业大学计算机学院);School of Software, Tsinghua University(清华大学软件学院);School of Computer Science and Engineering, UNSW Sydney(新南威尔士大学计算机科学与工程学院)
Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception
College of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院);School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院)
Can We Simplify Slide-level Fine-tuning of Pathology Foundation Models?
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);University of Oxford(牛津大学);The First Affiliated Hospital of Sun Yat-sen University(中山大学附属第一医院);University of Washington(华盛顿大学)
QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide image
School of Biomedical Engineering, Division of Life Sciences;Medicine, University of Science;Technology of China, Hefei, Anhui, 230026, P.R. China Center for Medical Imaging, Robotics, Analytic Computing \& Learning (MIRACLE), Suzhou Institute for Advance Research, USTC, 215123, P.R. China Chinese PLA General Hospital Ninth Medical Center, China Hong Kong University of Science
CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathology
Westlake University(西湖大学);Zhejiang University(浙江大学);Harvard University(哈佛大学);The Ohio State University(俄亥俄州立大学);University of the Chinese Academy of Sciences(中国科学院大学)
ZeroSlide: Is Zero-Shot Classification Adequate for Lifelong Learning in Whole-Slide Image Analysis in the Era of Pathology Vision-Language Foundation Models?
Nara Institute of Science and Technology(奈良科学技术研究所)
A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model
The Hong Kong University of Science and Technology(香港科技大学);Southern Medical University(南方医科大学);Guangdong Provincial Key Laboratory of Molecular Tumor Pathology(广东省分子肿瘤病理学重点实验室);Jinfeng Laboratory(金凤实验室);Shandong First Medical University(山东第一医科大学);Shandong Provincial Qianfoshan Hospital(山东省千佛山医院);The Third Affiliated Hospital of Kunming Medical University(昆明医科大学第三附属医院);Yunnan Cancer Hospital(云南省肿瘤医院);The Chinese University of Hong Kong(香港中文大学);Prince of Wales Hospital(威尔士亲王医院);Sun Yat-sen University(中山大学)
Unified Multi-Foundation-Model Slide Representation for Pan-Cancer Recognition and Text-Guided Tumor Localization
Department of Pathology, College of Medicine, The Ohio State University Wexner Medical Center(病理学系,医学学院,俄亥俄州立大学韦克斯纳医学中心);Department of Biomedical Engineering, The Ohio State University(生物医学工程系,俄亥俄州立大学)
Department of Pathology and Laboratory Medicine, University of Pennsylvania(病理学与实验室医学系,宾夕法尼亚大学);Department of Biostatistics, Epidemiology & Informatics, University of Pennsylvania(生物统计学、流行病学与信息学系,宾夕法尼亚大学);Department of Pathology, University of California at San Francisco(病理学系,加州大学旧金山分校);Department of Pathology, Stanford University(病理学系,斯坦福大学);Department of Electrical and System Engineering, University of Pennsylvania(电气与系统工程系,宾夕法尼亚大学)
Fusion of Multi-scale Heterogeneous Pathology Foundation Models for Whole Slide Image Analysis
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China(中国科学技术大学生物医学工程学院);Division of Life Science, Department of Chemical and Biological Engineering, State Key Laboratory of Nervous System Disorders, The Hong Kong University of Science and Technology(香港科技大学生命科学系);SIAT-HKUST Joint Laboratory of Cell Evolution and Digital Health, HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute(深圳-香港联合创新研究院细胞进化与数字健康联合实验室);Department of Hepatobiliary Surgery, The First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China(中国科学技术大学附属第一医院肝胆外科);Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, USTC, Suzhou, Jiangsu, China(中国科学技术大学苏州先进研究所);Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology, Suzhou, Jiangsu, China(江苏省多模态数字孪生技术重点实验室);Key Laboratory of Precision and Intelligent Chemistry, USTC, Hefei, Anhui, China(中国科学技术大学精准与智能化学重点实验室);Department of Pathology, Chinese PLA General Hospital, Beijing, China(中国人民解放军总医院病理科)
WsiCaption: Multiple Instance Generation of Pathology Reports for Gigapixel Whole-Slide Images
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Research Center for Industries of the Future, Westlake University(西湖大学未来产业研究中心);School of Engineering, Westlake University(西湖大学工程学院)
MOOZY: A Patient-First Foundation Model for Computational Pathology
CSSE, Concordia University, Montr\' e al, Canada Mila -- Qu\' e bec AI Institute, Montr\' e al, Canada CHUM, Universit\' e de Montr\' e al, Montr\' e al, Canada IRIC, Universit\' e de Montr\' e al, Montr\' e al, Canada Universit\' e de Montr\' e al, Montr\' e al, Canada Canada CIFAR Chair, Polytechnique Montr\' e al, Montr\' e al, Canada Dept.\ of Pathology, McGill University, Montr\' e al, Canada
Information-driven Fusion of Pathology Foundation Models for Enhanced Disease Characterization
Case Western Reserve University(凯斯西储大学);Department of Biomedical Engineering(生物医学工程系);Cleveland Clinic(克利夫兰诊所);Department of Pathology(病理学系);Emory University(埃默里大学);Department of Pediatrics(儿科学系);Louis Stokes VA Cleveland Medical Center(路易斯·斯托克斯退伍军人医疗中心)
Foundation Models for Slide-level Cancer Subtyping in Digital Pathology
Instituto Universitario de Investigación en Tecnología Centrada en el Ser Humano (HUMAN-Tech)(以人为本技术大学研究院(HUMAN-Tech));Universitat Politécnica de Valencia(瓦伦西亚理工大学);Valencian Graduate School and Research Network for Artificial Intelligence (valgraAI)(瓦伦西亚人工智能研究生院与研究网络(valgraAI))
nnMIL: A generalizable multiple instance learning framework for computational pathology
Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA, USA(放射肿瘤科,斯坦福大学医学院,斯坦福,CA,USA);Stanford Institute for Human-Centered Artificial Intelligence, Stanford, CA, USA(斯坦福大学人本人工智能研究所,斯坦福,CA,USA)
PathFLIP: Fine-grained Language-Image Pretraining for Versatile Computational Pathology
Harbin Institute of Technology, Shenzhen, School of Computer Science and Technology(哈尔滨工业大学(深圳)计算机科学与技术学院);National University of Singapore, Department of Electronic and Computer Engineering(新加坡国立大学电子与计算机工程系)
Hepato-LLaVA: An Expert MLLM with Sparse Topo-Pack Attention for Hepatocellular Pathology Analysis on Whole Slide Images
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(人工智能学院,北京邮电大学);Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College(pathology department, 国家癌症中心/国家癌症临床研究中心/癌症医院, 中国医学科学院和北京协和医学院)
ALICE: Learning a General-Purpose Pathology Foundation Model from Vision, Vision-Language, and Slide-Level Experts
Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学生物医药与健康工程研究院,清华大学深圳国际研究生院);Department of Engineering Science, University of Oxford(牛津大学工程科学系);Department of Pathology, The First Affiliated Hospital of Sun Yat-sen University(中山大学附属第一医院病理科);Medical Optical Technology R&D Center, Research Institute of Tsinghua, Pearl River Delta(清华珠三角研究院医学光学技术研发中心)
From Whole-slide Image to Biomarker Prediction: A Protocol for End-to-End Deep Learning in Computational Pathology
Technical University Dresden(德累斯顿工业大学);University of St Andrews(圣安德鲁斯大学);Helmholtz Munich – German Research Center for Environment and Health(亥姆霍兹慕尼黑中心-德国环境与健康研究中心);Technical University of Munich(慕尼黑工业大学);University Hospital Aachen(亚琛大学医院);University Medical Center Mainz(美因茨大学医学中心);University of Leeds(利兹大学);National Center for Tumor Diseases (NCT)(国家肿瘤疾病中心 (NCT));University Hospital Heidelberg(海德堡大学医院);Technische Universität Dresden(德累斯顿工业大学)
Large scale digital prostate pathology image analysis combining feature extraction and deep neural network
Stony Brook University(石溪大学);Brigham and Women's Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);Dana-Farber Cancer Institute(丹娜-法伯癌症研究所);Fraunhofer Institute for Medical Image Computing MEVIS(弗劳恩霍夫医学图像计算研究所);University of Bremen(不来梅大学)
Ensemble learning of pathology foundation models for precision oncology
Department of Radiation Oncology, Stanford University School of Medicine(放射肿瘤科,斯坦福大学医学院);Department of Pathology, Stanford University School of Medicine(病理学系,斯坦福大学医学院);Department of Medicine (Oncology), Stanford University School of Medicine(医学系(肿瘤学),斯坦福大学医学院);Department of Neurosurgery, Stanford University School of Medicine(神经外科,斯坦福大学医学院);Stanford Institute for Human-Centered Artificial Intelligence(斯坦福大学人本人工智能研究所)