GUIDE-US: Grade-Informed Unpaired Distillation of Encoder Knowledge from Histopathology to Micro-UltraSound
University of British Columbia（不列颠哥伦比亚大学）；Queen’s University（皇后大学）；Exact Imaging
Emma Willis, Tarek Elghareb, Paul F. R. Wilson, Minh Nguyen Nhat To, Mohammad Mahdi Abootorabi, Amoon Jamzad, Brian Wodlinger, Parvin Mousavi, Purang Abolmaesumi
Purpose: Non-invasive grading of prostate cancer (PCa) from micro-ultrasound (micro-US) could expedite triage and guide biopsies toward the most aggressive regions, yet current models struggle to infer tissue micro-structure at coarse imaging resolutions.
Methods: We introduce an unpaired histopathology knowledge-distillation strategy that trains a micro-US encoder to emulate the embedding distribution of a pretrained histopathology foundation model, conditioned on International Society of Urological Pathology (ISUP) grades. Training requires no patient-level pairing or image registration, and histopathology inputs are not used at inference.
Results: Compared to the current state of the art, our approach increases sensitivity to clinically significant PCa (csPCa) at 60% specificity by 3.5% and improves overall sensitivity at 60% specificity by 1.2%.
Conclusion: By enabling earlier and more dependable cancer risk stratification solely from imaging, our method advances clinical feasibility. Source code will be publicly released upon publication.
Weakly Supervised Spatial Grounding for Discriminative Attention-Based Ultrasound-Histopathology Alignment in Prostate Cancer Grading
University of British Columbia（不列颠哥伦比亚大学）；Vector Institute（向量研究所）；Ordensklinikum Linz（林茨教团医院）；University of Alberta（阿尔伯塔大学）；Exact Imaging（Exact Imaging公司）
A Chain-of-thought Reasoning Breast Ultrasound Dataset Covering All Histopathology Categories
Peking University（北京大学）；Peking Union Medical College Hospital（北京大学人民医院）；Peking University Cancer Hospital & Institute（北京大学肿瘤医院）；National Cancer Center / National Clinical Research Center for Cancer / Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College（中国医学科学院国家癌症中心/国家癌症临床科研中心/癌症医院）；Shenzhen Maternity & Child Health Care Hospital（深圳妇幼保健医院）；Xi’an Jiaotong University（西安交通大学）；Yizhun Medical AI Co., Ltd（亿众医疗人工智能有限公司）
Fetal brain magnetic resonance imaging (MRI) offers exquisite images of the developing brain but is not suitable for anomaly screening. For this ultrasound (US) is employed. While expert sonographers are adept at reading US images, MR images are much easier for non-experts to interpret. Hence in this paper we seek to produce images with MRI-like appearance directly from clinical US images. Our own clinical motivation is to seek a way to communicate US findings to patients or clinical professionals unfamiliar with US, but in medical image analysis such a capability is potentially useful, for in…
Unpaired Multi-Domain Histopathology Virtual Staining using Dual Path Prompted Inversion
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；University of Chinese Academy of Sciences（中国科学院大学）；National innovation center for advanced medical devices（国家高性能医疗器械创新中心）
In the clinical setting of histopathology, whole-slide image (WSI) artifacts frequently arise, distorting regions of interest, and having a pernicious impact on WSI analysis. Image-to-image translation networks such as CycleGANs are in principle capable of learning an artifact removal function from unpaired data. However, we identify a surjection problem with artifact removal, and propose an weakly-supervised extension to CycleGAN to address this. We assemble a pan-cancer dataset comprising artifact and clean tiles from the TCGA database. Promising results highlight the soundness of our method…
Microsoft Research（微软研究院）；Beihang University（北京航空航天大学）；Tsinghua University（清华大学）
In this paper, we develop a new weakly-supervised learning algorithm to learn to segment cancerous regions in histopathology images. Our work is under a multiple instance learning framework (MIL) with a new formulation, deep weak supervision (DWS); we also propose an effective way to introduce constraints to our neural networks to assist the learning process. The contributions of our algorithm are threefold: (1) We build an end-to-end learning system that segments cancerous regions with fully convolutional networks (FCN) in which image-to-image weakly-supervised learning is performed. (2) We d…
Nuclei segmentation is a fundamental task that is critical for various computational pathology applications including nuclei morphology analysis, cell type classification, and cancer grading. Conventional vision-based methods for nuclei segmentation struggle in challenging cases and deep learning approaches have proven to be more robust and generalizable. However, CNNs require large amounts of labeled histopathology data. Moreover, conventional CNN-based approaches lack structured prediction capabilities which are required to distinguish overlapping and clumped nuclei. Here, we present an appr…
Distilling Missing Modality Knowledge from Ultrasound for Endometriosis Diagnosis with Magnetic Resonance Images
Australian Institute for Machine Learning, University of Adelaide（阿德莱德大学澳大利亚机器学习研究所）；Flinders Health and Medical Research Institute, Flinders University（弗林德斯大学弗林德斯健康与医学研究所）；Robinson Research Institute, University of Adelaide（阿德莱德大学罗宾逊研究所）；Centre for Vision, Speech and Signal Processing, University of Surrey（萨里大学视觉、语音与信号处理中心）
Queen’s University（女王大学）；University of British Columbia（不列颠哥伦比亚大学）；Exact Imaging
MOTIVATION: Detection of prostate cancer during transrectal ultrasound-guided biopsy is challenging. The highly heterogeneous appearance of cancer, presence of ultrasound artefacts, and noise all contribute to these difficulties. Recent advancements in high-frequency ultrasound imaging - micro-ultrasound - have drastically increased the capability of tissue imaging at high resolution. Our aim is to investigate the development of a robust deep learning model specifically for micro-ultrasound-guided prostate cancer biopsy. For the model to be clinically adopted, a key challenge is to design a so…
Interactive simulation of ultrasound imaging greatly facilitates sonography training. Although ray-tracing based methods have shown promising results, obtaining realistic images requires substantial modeling effort and manual parameter tuning. In addition, current techniques still result in a significant appearance gap between simulated images and real clinical scans. Herein we introduce a novel content-preserving image translation framework (ConPres) to bridge this appearance gap, while maintaining the simulated anatomical layout. We achieve this goal by leveraging both simulated images with …
University of California, San Francisco（加州大学旧金山分校）；Duke University（杜克大学）；University of Dusseldorf（杜塞尔多夫大学）；University of Washington（华盛顿大学）
Non-invasive prostate cancer detection from MRI has the potential to revolutionize patient care by providing early detection of clinically-significant disease (ISUP grade group >= 2), but has thus far shown limited positive predictive value. To address this, we present an MRI-based deep learning method for predicting clinically significant prostate cancer applicable to a patient population with subsequent ground truth biopsy results ranging from benign pathology to ISUP grade group~5. Specifically, we demonstrate that mixed supervision via diverse histopathological ground truth improves classi…
Shanghai Institute for Advanced Communication and Data Science（上海先进通信与数据科学研究院）；The First Affiliated Hospital of Anhui Medical University（安徽医科大学第一附属医院）；Fudan University Shanghai Cancer Center（复旦大学附属肿瘤医院）；Shanghai Medical College, Fudan University（复旦大学上海医学院）；School of Science, Shanghai University（上海大学理学院）
Elastography ultrasound (EUS) provides additional bio-mechanical in-formation about lesion for B-mode ultrasound (BUS) in the diagnosis of breast cancers. However, joint utilization of both BUS and EUS is not popular due to the lack of EUS devices in rural hospitals, which arouses a novel modality im-balance problem in computer-aided diagnosis (CAD) for breast cancers. Current transfer learning (TL) pay little attention to this special issue of clinical modality imbalance, that is, the source domain (EUS modality) has fewer labeled samples than those in the target domain (BUS modality). Moreov…
Unsupervised and unpaired domain translation using generative adversarial neural networks, and more precisely CycleGAN, is state of the art for the stain translation of histopathology images. It often, however, suffers from the presence of cycle-consistent but non structure-preserving errors. We propose an alternative approach to the set of methods which, relying on segmentation consistency, enable the preservation of pathology structures. Focusing on immunohistochemistry (IHC) and multiplexed immunofluorescence (mIF), we introduce a simple yet effective guidance scheme as a loss function that…
Rose-Hulman Institute of Technology（罗斯-霍曼理工学院）；Honeywell FM&T（霍尼韦尔FM&T）
Classification of cancer cellularity within tissue samples is currently a manual process performed by pathologists. This process of correctly determining cancer cellularity can be time intensive. Deep Learning (DL) techniques in particular have become increasingly more popular for this purpose, due to the accuracy and performance they exhibit, which can be comparable to the pathologists. This work investigates the capabilities of two DL approaches to assess cancer cellularity in whole slide images (WSI) in the SPIE-AAPM-NCI BreastPathQ challenge dataset. The effects of training on augmented da…
Cross-Modal MRI Ovary Segmentation in Endometriosis Using Unpaired TVUS Prototype Priors
Center for AI and Data Science (CAIDAS), Julius-Maximilians-Universität Würzburg（维尔茨堡大学人工智能与数据科学中心）；Institute for Computational Imaging and AI in Medicine (CompAI), Technical University of Munich（慕尼黑工业大学计算成像与医学人工智能研究所）；Pattern Recognition Lab, Friedrich-Alexander Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡大学模式识别实验室）；Department Artificial Intelligence in Biomedical Engineering (AIBE), Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡大学生物医学工程人工智能系）
Queen’s University（女王大学）；University of British Columbia（不列颠哥伦比亚大学）；Exact Imaging（Exact Imaging公司）
A large body of previous machine learning methods for ultrasound-based prostate cancer detection classify small regions of interest (ROIs) of ultrasound signals that lie within a larger needle trace corresponding to a prostate tissue biopsy (called biopsy core). These ROI-scale models suffer from weak labeling as histopathology results available for biopsy cores only approximate the distribution of cancer in the ROIs. ROI-scale models do not take advantage of contextual information that are normally considered by pathologists, i.e. they do not consider information about surrounding tissue and …
PAII Inc.（PAII 公司）；Chang Gung Memorial Hospital, Linkou Medical Center（长庚纪念医院林口医学中心）；Institute of Molecular and Genomic Medicine, National Health Research Institutes（国家卫生研究院分子与基因组医学研究所）；Ping An Insurance Group（平安保险集团）
Background & Aims: Hepatic steatosis is a major cause of chronic liver disease. 2D ultrasound is the most widely used non-invasive tool for screening and monitoring, but associated diagnoses are highly subjective. We developed a scalable deep learning (DL) algorithm for quantitative scoring of liver steatosis from 2D ultrasound images. Approach & Results: Using retrospectively collected multi-view ultrasound data from 3,310 patients, 19,513 studies, and 228,075 images, we trained a DL algorithm to diagnose steatosis stages (healthy, mild, moderate, or severe) from ultrasound diagnoses. Perform…
Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma by Integrating Multimodal Ultrasound and Clinical Data: A Multicenter Study
Shenzhen University（深圳大学）；Peking University Shenzhen Hospital（北京大学深圳医院）；Chinese PLA General Hospital（中国人民解放军总医院）
F2FLDM: Latent Diffusion Models with Histopathology Pre-Trained Embeddings for Unpaired Frozen Section to FFPE Translation
University of Utah（犹他大学）；The Catholic University of Korea College of Medicine（韩国天主教大学医学院）；Huntsman Cancer Institute（亨茨曼癌症研究所）；Scientific Computing and Imaging Institute（科学计算与成像研究所）
Pretext Matters: An Empirical Study of SSL Methods in Medical Imaging
Biomedical AI Research Lab, University of California, Los Angeles, Los Angeles, CA, USA（生物医学人工智能研究实验室，加州大学洛杉矶分校，洛杉矶，CA，USA）；Department of Radiology, University of California, Los Angeles, Los Angeles, CA, USA（放射学系，加州大学洛杉矶分校，洛杉矶，CA，USA）；Division of Endocrine Surgery, University of Texas Southwestern Medical Center, Dallas, TX, USA（内分泌外科 division，德克萨斯西南医学中心，达拉斯，TX，USA）；Department of Pathology, University of California, Los Angeles, Los Angeles, CA, USA（病理学系，加州大学洛杉矶分校，洛杉矶，CA，USA）；Department of Computational Medicine, University of California, Los Angeles, Los Angeles, CA, USA（计算医学系，加州大学洛杉矶分校，洛杉矶，CA，USA）；Department of Bioengineering, University of California, Los Angeles, Los Angeles, CA, USA（生物工程系，加州大学洛杉矶分校，洛杉矶，CA，USA）；Department of Electrical and Computer Engineering, University of California, Los Angeles, Los Angeles, CA, USA（电气与计算机工程系，加州大学洛杉矶分校，洛杉矶，CA，USA）
Queensland University of Technology（昆士兰科技大学）；University of Jaen（哈恩大学）；The University of Queensland（昆士兰大学）；University of Sumer（苏美尔大学）；University of Baghdad（巴格达大学）；The University of Information Technology & Communications（信息与通信技术大学）；University of Missouri（密苏里大学）
Deep Learning (DL) requires a large amount of training data to provide quality outcomes. However, the field of medical imaging suffers from the lack of sufficient data for properly training DL models because medical images require manual labelling carried out by clinical experts thus the process is time-consuming, expensive, and error-prone. Recently, transfer learning (TL) was introduced to reduce the need for the annotation procedure by means of transferring the knowledge performed by a previous task and then fine-tuning the result using a relatively small dataset. Nowadays, multiple classif…
MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging
Microsoft Health and Life Sciences（微软健康与生命科学部门）；Microsoft Research（微软研究院）；University of Wisconsin-Madison（威斯康星大学麦迪逊分校）；Microsoft Azure AI（微软Azure人工智能部门）
