TAKT: Target-Aware Knowledge Transfer for Whole Slide Image Classification
The Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology (HKUST)(香港科技大学);Tencent YouTu Lab(腾讯优图实验室);Nanyang Technological University(南洋理工大学)
Conghao Xiong, Yi Lin, Hao Chen, Hao Zheng, Dong Wei, Yefeng Zheng, Joseph J. Y. Sung, Irwin King
Transferring knowledge from a source domain to a target domain can be crucial for whole slide image classification, since the number of samples in a dataset is often limited due to high annotation costs. However, domain shift and task discrepancy between datasets can hinder effective knowledge transfer. In this paper, we propose a Target-Aware Knowledge Transfer framework, employing a teacher-student paradigm. Our framework enables the teacher model to learn common knowledge from the source and target domains by actively incorporating unlabelled target images into the training of the teacher model. The teacher bag features are subsequently adapted to supervise the training of the student model on the target domain. Despite incorporating the target features during training, the teacher model tends to overlook them under the inherent domain shift and task discrepancy. To alleviate this, we introduce a target-aware feature alignment module to establish a transferable latent relationship between the source and target features by solving the optimal transport problem. Experimental results show that models employing knowledge transfer outperform those trained from scratch, and our method achieves state-of-the-art performance among other knowledge transfer methods on various datasets, including TCGA-RCC, TCGA-NSCLC, and Camelyon16.
多实例学习(MIL)是用于整个切片图像分类的优选方法。然而,大多数MIL方法不利用从整个幻灯片图像中提取的瓦片的相互依赖性,这可以为分类提供有价值的线索。本文提出了一种新的MIL方法,利用瓷砖的空间关系分类整个幻灯片图像。为此,从瓦片嵌入构建稀疏映射,然后通过稀疏输入CNN进行分类。它在涉及10000张全切片图像的癌症亚型分类方面获得了超过流行的MIL方法的最先进性能。我们的研究结果表明,所提出的方法可以(i)提高表示学习的实例和(ii)利用上下文的实例嵌入,以提高分类性能。这个工作的代码是开源的{github censored for review}。
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Academy for Engineering and Technology, Fudan University(复旦大学工程与技术学院);Fudan University Shanghai Cancer Center(复旦大学附属肿瘤医院);Zhongshan Hospital, Fudan University(复旦大学中山医院)
Dual-stream attention-guided learning for weakly supervised whole slide image classification
College of Computer Science and Technology, College of Data Science, Taiyuan University of Technology(太原科技大学计算机科学与技术学院、数据科学学院);College of Humanities, Law and Foreign Languages, Taiyuan University of Technology(太原科技大学人文学院、法律与外语学院);College of Artificial Intelligence, Taiyuan University of Technology(太原科技大学人工智能学院);School of Cyberspace Security, Beijing University of Posts and Telecommunications(北京邮电大学网络安全学院);School of Mathematics, Taiyuan University of Technology(太原科技大学数学学院)
Augmenting the Pathology Lab: An Intelligent Whole Slide Image Classification System for the Real World
Proscia Inc.(Proscia 公司);Boonshoft School of Medicine, Wright State University School of Medicine(莱特州立大学医学院布恩肖夫特医学院);Dermatopathology Laboratory of Central States(中部各州皮肤病理学实验室);University of Florida College of Medicine(佛罗里达大学医学院);Cockerell Dermatopathology(科克雷尔皮肤病理学机构);Sidney Kimmel Medical College at Thomas Jefferson University(托马斯杰斐逊大学西德尼·金梅尔医学院)
Whole-Slide Image Analysis under Realistic Few-Shot Annotation Protocols
Institute of Information and Communication Technologies, Electronics, and Applied Mathematics (ICTEAM), Université catholique de Louvain (UCLouvain)(天主教鲁汶大学信息与通信技术、电子与应用数学研究所)
针对现实 whole-slide 图像场景的小样本标注问题,提出 SlideCRF 模型,结合空间与生物线索优化预测,在四个数据集上宏观 F1 较现有转导方法更优,零样本预测提升显著。
A Multimodal Knowledge-enhanced Whole-slide Pathology Foundation Model
The Hong Kong University of Science and Technology(香港科技大学);Southern Medical University(南方医科大学);Guangdong Provincial Key Laboratory of Molecular Tumor Pathology(广东省分子肿瘤病理学重点实验室);Jinfeng Laboratory(金凤实验室);Shandong First Medical University(山东第一医科大学);Shandong Provincial Qianfoshan Hospital(山东省千佛山医院);The Third Affiliated Hospital of Kunming Medical University(昆明医科大学第三附属医院);Yunnan Cancer Hospital(云南省肿瘤医院);The Chinese University of Hong Kong(香港中文大学);Prince of Wales Hospital(威尔士亲王医院);Sun Yat-sen University(中山大学)
WSI-VQA: Interpreting Whole Slide Images by Generative Visual Question Answering
Zhejiang University(浙江大学);Research Center for Industries of the Future, Westlake University(西湖大学未来产业研究中心);School of Engineering, Westlake University(西湖大学工程学院)
Dynamic Residual Encoding with Slide-Level Contrastive Learning for End-to-End Whole Slide Image Representation
School of Computer Science and Enginecring, Central South University(计算机科学与工程学院,中南大学);School of Computer Science(计算机科学学院);Enginecring, Central South University(工程学院,中南大学)
Enhancing Whole Slide Image Classification through Supervised Contrastive Domain Adaptation
HUMAN-tech;Universidad Politécnica de Valencia (UPV)(瓦伦西亚理工大学);Valencian Graduate School and Research Network for Artificial Intelligence (valgrAI)(瓦伦西亚人工智能研究生学院及研究网络)
Embedding Space Augmentation for Weakly Supervised Learning in Whole-Slide Images
University College London(伦敦大学学院);Brigham and Women's Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);Massachusetts General Hospital(麻省总医院);Broad Institute of Harvard and MIT(哈佛-麻省理工博德研究所);Dana-Farber Cancer Institute(达纳-法伯癌症研究所);University of Warwick(华威大学);University Hospitals Coventry and Warwickshire NHS Trust(考文垂与沃里克郡国民保健服务信托大学医院);The Alan Turing Institute(艾伦·图灵研究所)
EviPathBench: Benchmarking Evidence Acquisition and Reasoning in Vision-Language Models for Whole-Slide Pathology
National University of Singapore(新加坡国立大学);PuzzleLogic Pte Ltd(拼图逻辑私人有限公司);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学深圳校区);Peking Union Medical College Hospital(北京协和医院)
WsiCaption: Multiple Instance Generation of Pathology Reports for Gigapixel Whole-Slide Images
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Research Center for Industries of the Future, Westlake University(西湖大学未来产业研究中心);School of Engineering, Westlake University(西湖大学工程学院)
Restoration of marker occluded hematoxylin and eosin stained whole slide histology images using generative adversarial networks
Image Data Analytics, Informatics IT, Merck \& Co., Inc., West Point, PA 19486, USA Image Data Analytics, Informatics IT, Merck \& Co., Inc., Rahway, NJ 07065, USA