Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data, and its application to pathology could greatly benefit its downstream tasks. Yet, there are no principled studies that compare SSL methods and discuss how to adapt them for pathology. To address this need, we execute the largest-scale study of SSL pre-training on pathology image data, to date. Our study is conducted using 4 representative SSL methods on diverse downstream tasks. We establish that large-scale domain-aligned pre-training in pathology consistently out-performs ImageNet pre-training in standard SSL settings such as linear and fine-tuning evaluations, as well as in low-label regimes. Moreover, we propose a set of domain-specific techniques that we experimentally show leads to a performance boost. Lastly, for the first time, we apply SSL to the challenging task of nuclei instance segmentation and show large and consistent performance improvements under diverse settings.
Accelerating Data Processing and Benchmarking of AI Models for Pathology
Harvard Medical School(哈佛医学院);Massachusetts General Hospital(麻省总医院);Broad Institute of Harvard and MIT(哈佛与麻省理工学院布罗德研究所);Harvard-MIT(哈佛-麻省理工学院);Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院)
Benchmarking Pathology Feature Extractors for Whole Slide Image Classification
University of St Andrews(圣安德鲁斯大学);Else Kröner Fresenius Center for Digital Health(埃尔瑟·克勒纳·弗雷森纽斯数字健康中心);TUD Dresden University of Technology(德累斯顿工业大学);University Hospital Aachen(亚琛大学医院);University Hospital Heidelberg(海德堡大学医院);University Hospital Dresden(德累斯顿大学医院)
Benchmarking Domain Generalization Algorithms in Computational Pathology
Tissue Image Analytics centre, Department of Computer Science(组织机构:组织机构,计算机科学系);Histofy Ltd(Histofy有限公司);ICMR-National Institute of Pathology(ICMR国家病理研究所)
Benchmarking Pathology Foundation Models for Breast Cancer Survival Prediction
Department of Medical Epidemiology and Biostatistics, Karolinska Institutet(卡罗林斯卡研究所医学流行病学与生物统计学系);Department of Engineering Science, University of Oxford(牛津大学工程科学系);Division of Oncology, Department of Clinical Sciences Lund, Lund University(卢德大学临床科学系肿瘤学系);Oxford Suzhou Centre for Advanced Research, University of Oxford(牛津大学苏州先进研究中心)
University Hospital and Faculty of Medicine Carl Gustav Carus, TUD Dresden University of Technology(德累斯顿工业大学卡尔·古斯塔夫·卡鲁斯大学医院及医学院);National Center for Tumor Diseases (NCT), University Hospital Heidelberg(海德堡大学医院国家肿瘤疾病中心);Leeds Institute of Medical Research at St James’s, University of Leeds(利兹大学圣詹姆斯利兹医学研究所)
Benchmarking Pathology Foundation Models for Spatial Domain Understanding
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Brainnetome Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所脑网膜工程中心);Beijing Key Laboratory of Brainnetome and Brain-Computer Interface, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所北京脑网膜与脑机接口重点实验室);DAMO Academy, Alibaba Group(阿里云达摩院);ShanghaiTech University(上海科技大学)
Mapping the landscape of histomorphological cancer phenotypes using self-supervised learning on unlabeled, unannotated pathology slides
University of Glasgow(格拉斯哥大学);New York University School of Medicine(纽约大学医学院);New York University Langone Health(纽约大学朗格尼医学中心);Karolinska Institutet(卡罗林斯卡学院);University College London Hospital(伦敦大学学院医院)
Efficient Self-Supervised Barlow Twins from Limited Tissue Slide Cohorts for Colonic Pathology Diagnostics
University of Concordia(康考迪亚大学);University of Montreal(蒙特利尔大学);Sunnybrook Health Science Centre(桑尼布鲁克健康科学中心);Kingston General Hospital(金斯顿总医院);Mila–Quebec Artificial Intelligence Institute(米拉-魁北克人工智能研究所)
A General-Purpose Self-Supervised Model for Computational Pathology
Brigham and Women’s Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);Massachusetts General Hospital(麻省总医院);Broad Institute of Harvard and MIT(哈佛-麻省理工博德研究所);Dana-Farber Cancer Institute(丹娜-法伯癌症研究所);Massachusetts Institute of Technology(麻省理工学院);Harvard John A. Paulson School of Engineering And Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院);Harvard University(哈佛大学)
Classification and Retrieval of Digital Pathology Scans: A New Dataset
University of Waterloo(滑铁卢大学);Amirkabir University(阿米尔卡比尔理工大学);Nanjing University of Science & Technology(南京理工大学);Deakin University(迪肯大学);University of Ontario Institute of Technology(安大略理工大学)
在本文中,我们介绍了一个新的数据集,\textbf{Kimia Path24},图像分类和检索数字病理。我们使用24种不同组织纹理的完整扫描图像生成1,325个尺寸为1000 $\times$ 1000(0.5 mm $\times$ 0.5 mm)的测试贴片。训练数据可以根据算法设计者的偏好生成,并且如果采用预设参数,则训练数据的范围可以从大约27,000到超过50,000个补丁。我们提出了一种复合补丁和扫描精度测量,使实现高精度相当具有挑战性。此外,我们通过应用LBP,字典方法和卷积神经网络(CNN)来设置基准线,并报告他们的结果。CNN的最高准确率为41.80%。
Hierarchical Generalized Category Discovery for Brain Tumor Classification in Digital Pathology
Institute of Clinical Epidemiology, Public Health, Health Economics, Medical Statistics and Informatics(临床流行病学、公共卫生、健康经济学、医学统计与信息学研究所);Institute of Neuropathology and Neuromolecular Pathology(神经病理学与神经分子病理学研究所)
Pathology-Aware Multi-View Contrastive Learning for Patient-Independent ECG Reconstruction
Department of Computer Science and Engineering, Indian Institute of Technology Roorkee(计算机科学与工程系,印度理工学院Roorkee);Department of Biosciences and Bioengineering, Indian Institute of Technology Roorkee(生物科学与生物工程系,印度理工学院Roorkee)
PathOrchestra: A Comprehensive Foundation Model for Computational Pathology with Over 100 Diverse Clinical-Grade Tasks
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Fourth Military Medical University(第四军医大学);Tsinghua University(清华大学);University of Science and Technology of China(中国科学技术大学);SenseTime Research(商汤科技研究院);Hong Kong University of Science and Technology(香港科技大学);Peking University(北京大学);Shengqiang Technology Co. Ltd.(胜强科技有限公司);Institute of Materials Research, Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院材料研究院)
Multimodal Whole Slide Foundation Model for Pathology
Mass General Brigham, Harvard Medical School(哈佛医学院,麻省总医院布里格姆医疗系统);Dana-Farber Cancer Institute(丹娜法伯癌症研究院);Broad Institute of Harvard and MIT(哈佛与麻省理工学院博德研究所);John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院);Helmholtz Munich – German Research Center for Environment and Health(亥姆霍兹慕尼黑中心——德国环境与健康研究中心);School of Computation, Information and Technology, Technical University of Munich(慕尼黑工业大学计算、信息与技术学院);Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology(麻省理工学院电气工程与计算机科学系);Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology(麻省理工学院哈佛-麻省卫生科学与技术分部);Department of Pathology, Pusan National University(釜山大学病理学系);Department of Pathology and Laboratory Medicine, Emory University School of Medicine(埃默里大学医学院病理学与检验医学系);Harvard Data Science Initiative, Harvard University(哈佛大学哈佛数据科学计划);Department of Systems Biology, Harvard Medical School(哈佛医学院系统生物学系);Department of Preventive Medicine, Graduate School of Medicine, The University of Tokyo(东京大学医学部预防医学系)
Fusing Pixels and Genes: Spatially-Aware Learning in Computational Pathology
College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院);Fysics Intelligence Technologies Co., Ltd. (Fysics AI)(菲茨斯智能科技有限公司(菲茨斯AI));Department of Biomedical Informatics, Harvard Medical School(哈佛医学院生物医学信息学系);Tencent Youtu Lab(腾讯优图实验室);ByteDance(字节跳动)
CORA: Generalizable coronary artery disease assessment and risk stratification from coronary CT angiography using pathology-centric representation learning
Department of Radiology, Northwestern University(西北大学放射学系);Department of Biomedical Engineering, Northwestern University(西北大学生物医学工程系);Department of Cardiology, Northwestern University(西北大学心脏病学系);Department of Preventive Medicine, Northwestern University(西北大学预防医学系)
Virchow: A Million-Slide Digital Pathology Foundation Model
Paige;Microsoft Research(微软研究院);NSW Health Pathology(新南威尔士州卫生病理学);St George Hospital(圣乔治医院);Memorial Sloan Kettering Cancer Center(纪念斯隆凯特琳癌症中心);University of Rochester(罗切斯特大学)
Semi-supervised Pathology Segmentation with Disentangled Representations
University of Edinburgh(爱丁堡大学);University of California(加利福尼亚大学);Cedars-Sinai Medical Center(西达赛奈医疗中心);University of Essex(埃塞克斯大学);The Alan Turing Institute(艾伦·图灵研究所)