Multiple Instance Learning (MIL) models have proven effective for cancer prognosis from Whole Slide Images. However, the original MIL formulation incorrectly assumes the patches of the same image to be independent, leading to a loss of spatial context as information flows through the network. Incorporating contextual knowledge into predictions is particularly important given the inclination for cancerous cells to form clusters and the presence of spatial indicators for tumors. State-of-the-art methods often use attention mechanisms eventually combined with graphs to capture spatial knowledge. In this paper, we take a novel and transversal approach, addressing this issue through the lens of regularization. We propose Context-Aware Regularization for Multiple Instance Learning (CARMIL), a versatile regularization scheme designed to seamlessly integrate spatial knowledge into any MIL model. Additionally, we present a new and generic metric to quantify the Context-Awareness of any MIL model when applied to Whole Slide Images, resolving a previously unexplored gap in the field. The efficacy of our framework is evaluated for two survival analysis tasks on glioblastoma (TCGA GBM) and colon cancer data (TCGA COAD).
MergeSurv: Merging-Based Continual Learning for Survival Analysis on Whole-Slide Images
University of Information Technology(信息技术大学);Viet Nam National University Ho Chi Minh City(胡志明市越南国立大学);ETIS (UMR 8051), CY Cergy Paris University, ENSEA, CNRS, France(法国CY Cergy巴黎大学、ENSEA、法国国家科学研究中心联合建立的ETIS实验室(UMR 8051))
ZeroSlide: Is Zero-Shot Classification Adequate for Lifelong Learning in Whole-Slide Image Analysis in the Era of Pathology Vision-Language Foundation Models?
Nara Institute of Science and Technology(奈良科学技术研究所)
CHRep: Cross-modal Histology Representation and Post-hoc Calibration for Spatial Gene Expression Prediction
Beijing University of Posts and Telecommunications(北京邮电大学);Beijing Key Laboratory of Network System and Network Culture(北京网络系统与网络文化重点实验室);Peking University Third Hospital(北京大学第三医院)
Scalable, Trustworthy Generative Model for Virtual Multi-Staining from H&E Whole Slide Images
Sorbonne Université(索邦大学);CNRS(法国国家科学研究中心);Inserm(法国国家健康与医学研究院);AP-HP(巴黎公共医疗集团);Inria(法国国家信息与自动化研究所);Paris Brain Institute-ICM(巴黎大脑研究所-脑研究所);Paris Cité University(巴黎城市大学);Necker-Enfants Malades University Hospitals(内克尔-儿童马尔代夫大学医院);Centre de recherche sur l’inflammation(炎症研究中心);Robert Debré University Hospitals(罗伯特德布雷大学医院)
LGD-Net: Latent-Guided Dual-Stream Network for HER2 Scoring with Task-Specific Domain Knowledge
School of Mathematics and Statistics, Fujian Normal University(福建师范大学数学与统计学学院);Department of Oncology, Mengchao Hepatobiliary Hospital of Fujian Medical University(福建医科大学 Mengchao 肝胆医院肿瘤科)
Omni-Seg: A Scale-aware Dynamic Network for Renal Pathological Image Segmentation
Vanderbilt University(范德堡大学);Big Data Institute, Central South University(中南大学大数据研究院);Vanderbilt University Medical Center(范德堡大学医学中心);The University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)