In 2020, prostate cancer saw a staggering 1.4 million new cases, resulting in over 375,000 deaths. The accurate identification of clinically significant prostate cancer is crucial for delivering effective treatment to patients. Consequently, there has been a surge in research exploring the application of deep neural networks to predict clinical significance based on magnetic resonance images. However, these networks demand extensive datasets to attain optimal performance. Recently, transfer learning emerged as a technique that leverages acquired features from a domain with richer data to enhance the performance of a domain with limited data. In this paper, we investigate the improvement of clinically significant prostate cancer prediction in T2-weighted images through transfer learning from breast cancer. The results demonstrate a remarkable improvement of over 30% in leave-one-out cross-validation accuracy.
AI generated annotations for Breast, Brain, Liver, Lungs and Prostate cancer collections in National Cancer Institute Imaging Data Commons
BAMF Health（BAMF健康公司）；National Institute of Health（美国国立卫生研究院）；Frederick National Laboratory for Cancer Research（弗雷德里克国家癌症研究实验室）；Brigham and Women’s Hospital（布莱根妇女医院）；Harvard Medical School（哈佛医学院）
Towards Multi-modality Fusion and Prototype-based Feature Refinement for Clinically Significant Prostate Cancer Classification in Transrectal Ultrasound
School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University（深圳大学医学部生物医学工程学院）；Sun Yat-sen University Cancer Center（中山大学肿瘤防治中心）
Hybrid-View Attention Network for Clinically Significant Prostate Cancer Classification in Transrectal Ultrasound
Smart Medical Imaging, Learning and Engineering (SMILE) Lab（智能医学影像、学习与工程实验室）；Medical UltraSound Image Computing (MUSIC) Lab（超声影像计算（MUSIC）实验室）；School of Biomedical Engineering（生物医学工程学院）；Shenzhen University Medical School（深圳大学医学院）；Shenzhen University（深圳大学）；The Department of Ultrasound（超声科）；State Key Laboratory of Oncology in South China（南方肿瘤学关键实验室）；Guangdong Provincial Clinical Research Center for Cancer（广东省癌症临床研究中心）；Sun Yat-sen University Cancer Center（中山大学肿瘤中心）
Breast Ultrasound Tumor Generation via Mask Generator and Text-Guided Network:A Clinically Controllable Framework with Downstream Evaluation
School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China（生物医学工程学院，深圳大学医学院，深圳大学，深圳，中国）；Smart Medical Imaging, Learning and Engineering (SMILE) Lab, Shenzhen University, Shenzhen, China（智能医学影像、学习与工程（SMILE）实验室，深圳大学，深圳，中国）；Nuclear Medicine Department, the Seventh Affiliated Hospital, Sun Yat-Sen University, Shenzhen, China（核医学科，中山大学第七附属医院，中山大学，深圳，中国）；Department of Radiology, the Seventh Affiliated Hospital, Sun Yat-Sen University, Shenzhen, China（放射科，中山大学第七附属医院，中山大学，深圳，中国）；Shenzhen University of Advanced Technology, Shenzhen, China（深圳大学先进技术大学，深圳，中国）
Queen’s University（女王大学）；University of British Columbia（不列颠哥伦比亚大学）；Exact Imaging
MOTIVATION: Detection of prostate cancer during transrectal ultrasound-guided biopsy is challenging. The highly heterogeneous appearance of cancer, presence of ultrasound artefacts, and noise all contribute to these difficulties. Recent advancements in high-frequency ultrasound imaging - micro-ultrasound - have drastically increased the capability of tissue imaging at high resolution. Our aim is to investigate the development of a robust deep learning model specifically for micro-ultrasound-guided prostate cancer biopsy. For the model to be clinically adopted, a key challenge is to design a so…
University of California, San Francisco（加州大学旧金山分校）；Duke University（杜克大学）；University of Dusseldorf（杜塞尔多夫大学）；University of Washington（华盛顿大学）
Non-invasive prostate cancer detection from MRI has the potential to revolutionize patient care by providing early detection of clinically-significant disease (ISUP grade group >= 2), but has thus far shown limited positive predictive value. To address this, we present an MRI-based deep learning method for predicting clinically significant prostate cancer applicable to a patient population with subsequent ground truth biopsy results ranging from benign pathology to ISUP grade group~5. Specifically, we demonstrate that mixed supervision via diverse histopathological ground truth improves classi…
The Chinese University of Hong Kong（香港中文大学）；University of Cambridge（剑桥大学）；Inception Institute of Artificial Intelligence（启迪人工智能研究院）；The Hong Kong University of Science and Technology（香港科技大学）；Jinan University（暨南大学）；Southern University of Science and Technology（南方科技大学）；Chinese Academy of Sciences（中国科学院）
Automatic breast lesion segmentation in ultrasound helps to diagnose breast cancer, which is one of the dreadful diseases that affect women globally. Segmenting breast regions accurately from ultrasound image is a challenging task due to the inherent speckle artifacts, blurry breast lesion boundaries, and inhomogeneous intensity distributions inside the breast lesion regions. Recently, convolutional neural networks (CNNs) have demonstrated remarkable results in medical image segmentation tasks. However, the convolutional operations in a CNN often focus on local regions, which suffer from limit…
Mask Enhanced Deeply Supervised Prostate Cancer Detection on B-mode Micro-Ultrasound
Stanford University（斯坦福大学）；The Catholic University of Korea（韩国天主教大学）；University of Alberta（阿尔伯塔大学）；University of California Los Angeles（加州大学洛杉矶分校）；Humanitas University（乌尼塔斯大学）；IRCCS Humanitas Research Hospital（IRCCS乌尼塔斯研究医院）；University of Florida（佛罗里达大学）；University of California San Diego（加州大学圣地亚哥分校）
University of Stavanger（斯塔万格大学）；Stavanger University Hospital（斯塔万格大学医院）；University of Agder（阿格德尔大学）
Prostate cancer (PCa) is the second most common cancer diagnosed among men worldwide. The current PCa diagnostic pathway comes at the cost of substantial overdiagnosis, leading to unnecessary treatment and further testing. Bi-parametric magnetic resonance imaging (bp-MRI) based on apparent diffusion coefficient maps (ADC) and T2-weighted (T2w) sequences has been proposed as a triage test to differentiate between clinically significant (cS) and non-clinically significant (ncS) prostate lesions. However, analysis of the sequences relies on expertise, requires specialized training, and suffers fr…
Prostate cancer was the third most common cancer in 2020 internationally, coming after breast cancer and lung cancer. Furthermore, in recent years prostate cancer has shown an increasing trend. According to clinical experience, if this problem is detected and treated early, there can be a high chance of survival for the patient. One task that helps diagnose prostate cancer is prostate segmentation from magnetic resonance imaging. Manual segmentation performed by clinical experts has its drawbacks such as: the high time and concentration required from observers; and inter- and intra-observer va…
Advancing oncology with federated learning: transcending boundaries in breast, lung, and prostate cancer. A systematic review
Seoul National University Bundang Hospital（首尔大学盆唐医院）；Maastricht University（马斯特里赫特大学）；Pfizer Pharma GmbH（辉瑞制药有限公司）；Queen Mary University of London（伦敦玛丽女王大学）；University of Oxford（牛津大学）；Imperial College London（帝国理工学院）；Flower Labs；Academy of Athens（雅典科学院）；Helmholtz-Zentrum Dresden-Rossendorf（德累斯顿罗森多夫亥姆霍兹中心）；Pfizer Inc（辉瑞公司）
University of Washington（华盛顿大学）；University of Vermont College of Medicine（佛蒙特大学医学院）；University of California, Los Angeles（加利福尼亚大学洛杉矶分校）
Training end-to-end networks for classifying gigapixel size histopathological images is computationally intractable. Most approaches are patch-based and first learn local representations (patch-wise) before combining these local representations to produce image-level decisions. However, dividing large tissue structures into patches limits the context available to these networks, which may reduce their ability to learn representations from clinically relevant structures. In this paper, we introduce a novel attention-based network, the Holistic ATtention Network (HATNet) to classify breast biops…
We hypothesize that anatomical priors can be viable mediums to infuse domain-specific clinical knowledge into state-of-the-art convolutional neural networks (CNN) based on the U-Net architecture. We introduce a probabilistic population prior which captures the spatial prevalence and zonal distinction of clinically significant prostate cancer (csPCa), in order to improve its computer-aided detection (CAD) in bi-parametric MR imaging (bpMRI). To evaluate performance, we train 3D adaptations of the U-Net, U-SEResNet, UNet++ and Attention U-Net using 800 institutional training-validation scans, pa…
We propose and evaluate a novel method for automatically detecting clinically significant prostate cancer (csPCa) in bi-parametric magnetic resonance imaging (bpMRI). Prostate zones play an important role in the assessment of prostate cancer on MRI. We hypothesize that the inclusion of zonal information can improve the performance of a deep learning based csPCa lesion detection model. However, segmentation of prostate zones is challenging and therefore deterministic models are inaccurate. Hence, we investigated probabilistic zonal segmentation. Our baseline detection model is a 2DUNet trained …
Khalifa University（哈利法大学）；Beihang University（北京航空航天大学）；University of Louisville（路易斯维尔大学）
Prostate cancer (PCa) is the second deadliest form of cancer in males, and it can be clinically graded by examining the structural representations of Gleason tissues. This paper proposes \RV{a new method} for segmenting the Gleason tissues \RV{(patch-wise) in order to grade PCa from the whole slide images (WSI).} Also, the proposed approach encompasses two main contributions: 1) A synergy of hybrid dilation factors and hierarchical decomposition of latent space representation for effective Gleason tissues extraction, and 2) A three-tiered loss function which can penalize different semantic seg…
Queen’s University（女王大学）；University of British Columbia（不列颠哥伦比亚大学）；University of Alberta（阿尔伯塔大学）；Exact Imaging（Exact影像）
Purpose: Medical foundation models (FMs) offer a path to build high-performance diagnostic systems. However, their application to prostate cancer (PCa) detection from micro-ultrasound (μUS) remains untested in clinical settings. We present ProstNFound+, an adaptation of FMs for PCa detection from μUS, along with its first prospective validation. Methods: ProstNFound+ incorporates a medical FM, adapter tuning, and a custom prompt encoder that embeds PCa-specific clinical biomarkers. The model generates a cancer heatmap and a risk score for clinically significant PCa. Following training on multi…
The diagnosis of prostate cancer faces a problem with overdiagnosis that leads to damaging side effects due to unnecessary treatment. Research has shown that the use of multi-parametric magnetic resonance images to conduct biopsies can drastically help to mitigate the overdiagnosis, thus reducing the side effects on healthy patients. This study aims to investigate the use of deep learning techniques to explore computer-aid diagnosis based on MRI as input. Several diagnosis problems ranging from classification of lesions as being clinically significant or not to the detection and segmentation o…
Non-Invasive Detection of PROState Cancer with Novel Time-Dependent Diffusion MRI and AI-Enhanced Quantitative Radiological Interpretation: PROS-TD-AI
University of Chile（智利大学）；Clínica Dávila（达维拉诊所）；Zhejiang University（浙江大学）；Hospital Clinic, Universitat de Barcelona（巴塞罗那大学医院诊所）；San Sebastián University（圣塞巴斯蒂安大学）
Clinically significant prostate cancer has a better chance to be sampled during ultrasound-guided biopsy procedures, if suspected lesions found in pre-operative magnetic resonance (MR) images are used as targets. However, the diagnostic accuracy of the biopsy procedure is limited by the operator-dependent skills and experience in sampling the targets, a sequential decision making process that involves navigating an ultrasound probe and placing a series of sampling needles for potentially multiple targets. This work aims to learn a reinforcement learning (RL) policy that optimises the actions o…
Lunenfeld-Tanenbaum Research Institute（卢嫩菲尔德-塔南鲍姆研究所）；Sinai Health System（西奈卫生系统）；University of Toronto（多伦多大学）；Sunnybrook Research Institute（桑尼布鲁克研究所）
Prostate cancer is one of the most common forms of cancer and the third leading cause of cancer death in North America. As an integrated part of computer-aided detection (CAD) tools, diffusion-weighted magnetic resonance imaging (DWI) has been intensively studied for accurate detection of prostate cancer. With deep convolutional neural networks (CNNs) significant success in computer vision tasks such as object detection and segmentation, different CNNs architectures are increasingly investigated in medical imaging research community as promising solutions for designing more accurate CAD tools …
We present a multi-stage 3D computer-aided detection and diagnosis (CAD) model for automated localization of clinically significant prostate cancer (csPCa) in bi-parametric MR imaging (bpMRI). Deep attention mechanisms drive its detection network, targeting salient structures and highly discriminative feature dimensions across multiple resolutions. Its goal is to accurately identify csPCa lesions from indolent cancer and the wide range of benign pathology that can afflict the prostate gland. Simultaneously, a decoupled residual classifier is used to achieve consistent false positive reduction,…
College of Information Science and Technology, Northwest University（西北大学信息科学与技术学院）；University of Texas Southwestern Medical Center（德克萨斯大学西南医学中心）
Breast ultrasound (US) is an effective imaging modality for breast cancer detec-tion and diagnosis. The structural characteristics of breast lesion play an im-portant role in Computer-Aided Diagnosis (CAD). In this paper, a novel struc-ture-aware triplet path networks (SATPN) was designed to integrate classifica-tion and two image reconstruction tasks to achieve accurate diagnosis on US im-ages with small training dataset. Specifically, we enhance clinically-approved breast lesion structure characteristics though converting original breast US imag-es to BIRADS-oriented feature maps (BFMs) with…
Image quality assessment by overlapping task-specific and task-agnostic measures: application to prostate multiparametric MR images for cancer segmentation
University College London（伦敦大学学院）；City University of Hong Kong（香港城市大学）；InstaDeep（InstaDeep公司）；University College London Hospital NHS Foundation Trust（伦敦大学学院医院国民保健服务基金会信托）
FastMRI Prostate: A Publicly Available, Biparametric MRI Dataset to Advance Machine Learning for Prostate Cancer Imaging
New York University Grossman School of Medicine（纽约大学格罗斯曼医学院）；Siemens Medical Solutions USA（美国西门子医疗解决方案公司）；Courant Institute of Mathematical Sciences, New York University（纽约大学柯朗数学科学研究所）
Background: Transrectal ultrasound guided systematic biopsies of the prostate is a routine procedure to establish a prostate cancer diagnosis. However, the 10-12 prostate core biopsies only sample a relatively small volume of the prostate, and tumour lesions in regions between biopsy cores can be missed, leading to a well-known low sensitivity to detect clinically relevant cancer. As a proof-of-principle, we developed and validated a deep convolutional neural network model to distinguish between morphological patterns in benign prostate biopsy whole slide images from men with and without estab…
Focalyx Technologies（Focalyx科技公司）；City University of Hong Kong（香港城市大学）；University College London（伦敦大学学院）；Urological Research Network（泌尿外科研究网络）
Prostate cancer (PCa) is one of the leading causes of death for men worldwide. Multi-parametric magnetic resonance (mpMR) imaging has emerged as a non-invasive diagnostic tool for detecting and localising prostate tumours by specialised radiologists. These radiological examinations, for example, for differentiating malignant lesions from benign prostatic hyperplasia in transition zones and for defining the boundaries of clinically significant cancer, remain challenging and highly skill-and-experience-dependent. We first investigate experimental results in developing object detection neural net…
Univ Lyon（里昂大学）；CNRS（法国国家科学研究中心）；Inserm（法国国家健康与医学研究院）；INSA Lyon（里昂国立应用科学学院）；UCBL（里昂第一大学）；CREATIS（里昂影像与信息处理研究中心）；Hospices Civils de Lyon（里昂民用医院集团）；Hôpital Edouard Herriot（爱德华·埃里奥医院）；University of Sherbrooke（舍布鲁克大学）
Multiparametric magnetic resonance imaging (mp-MRI) has shown excellent results in the detection of prostate cancer (PCa). However, characterizing prostate lesions aggressiveness in mp-MRI sequences is impossible in clinical practice, and biopsy remains the reference to determine the Gleason score (GS). In this work, we propose a novel end-to-end multi-class network that jointly segments the prostate gland and cancer lesions with GS group grading. After encoding the information on a latent space, the network is separated in two branches: 1) the first branch performs prostate segmentation 2) th…
Deformable MRI Sequence Registration for AI-based Prostate Cancer Diagnosis
Radboudumc（拉德堡德大学医学中心）；Fraunhofer MEVIS（弗劳恩霍夫梅维斯研究所）；Universität zu Lübeck（吕贝克大学）；University Medical Center Groningen（格罗宁根大学医学中心）；Netherlands Cancer Institute（荷兰癌症研究所）；Norwegian University of Science and Technology（挪威科技大学）
AI-assisted prostate cancer detection and localisation on biparametric MR by classifying radiologist-positives
Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London（医学图像计算中心，医学物理与生物医学工程系，伦敦大学学院）；Div of Surgery & Interventional Sci, University College London（外科与介入科学部，伦敦大学学院）；School of Computer Science and Engineering, University of Westminster（计算机科学与工程学院，威斯敏斯特大学）
DeepHealth, Inc.（深健公司）；Rhode Island Hospital（罗德岛医院）；Brown University（布朗大学）；Henan Provincial People’s Hospital（河南省人民医院）；Medford Radiology Group（梅德福放射学集团）；University of Massachusetts Medical School（马萨诸塞大学医学院）
Breast cancer remains a global challenge, causing over 1 million deaths globally in 2018. To achieve earlier breast cancer detection, screening x-ray mammography is recommended by health organizations worldwide and has been estimated to decrease breast cancer mortality by 20-40%. Nevertheless, significant false positive and false negative rates, as well as high interpretation costs, leave opportunities for improving quality and access. To address these limitations, there has been much recent interest in applying deep learning to mammography; however, obtaining large amounts of annotated data p…
CHIMERA Challenge: Biochemical Recurrence Prediction in Prostate Cancer Patients using multimodal datasets
Radboud University Medical Center（拉德堡德大学医学中心）；Canisius Wilhelmina Hospital（卡尼修斯威廉明娜医院）；Oncode Institute（Oncode研究所）；Erasmus University Medical Center（伊拉斯姆斯大学医学中心）；Bydgoszcz University of Science and Technology（比得哥什科技大学）；Yerevan State Medical University（埃里温国立医科大学）；IMP Diagnostics（IMP诊断公司）
University of Pennsylvania（宾夕法尼亚大学）；Mayo Clinic（梅奥诊所）
Breast density is an important risk factor for breast cancer that also affects the specificity and sensitivity of screening mammography. Current federal legislation mandates reporting of breast density for all women undergoing breast screening. Clinically, breast density is assessed visually using the American College of Radiology Breast Imaging Reporting And Data System (BI-RADS) scale. Here, we introduce an artificial intelligence (AI) method to estimate breast percentage density (PD) from digital mammograms. Our method leverages deep learning (DL) using two convolutional neural network arch…
Brigham and Women's Hospital（布莱根和妇女医院）；Harvard Medical School（哈佛医学院）；Johns Hopkins School of Medicine（约翰斯·霍普金斯大学医学院）
Histology-based grade classification is clinically important for many cancer types in stratifying patients distinct treatment groups. In prostate cancer, the Gleason score is a grading system used to measure the aggressiveness of prostate cancer from the spatial organization of cells and the distribution of glands. However, the subjective interpretation of Gleason score often suffers from large interobserver and intraobserver variability. Previous work in deep learning-based objective Gleason grading requires manual pixel-level annotation. In this work, we propose a weakly-supervised approach …
VMRA-MaR: An Asymmetry-Aware Temporal Framework for Longitudinal Breast Cancer Risk Prediction
Department of Computer Science and Engineering, University of Bologna（博洛尼亚大学计算机科学与工程系）；Department of Physics and Technology, UiT The Arctic University of Norway（北极大学挪威分校物理与技术系）；Norwegian Computing Center, Oslo, Norway（奥斯陆挪威计算中心）
Magnetic resonance imaging (MRI) is an increasingly important tool for the diagnosis and treatment of prostate cancer. However, interpretation of MRI suffers from high inter-observer variability across radiologists, thereby contributing to missed clinically significant cancers, overdiagnosed low-risk cancers, and frequent false positives. Interpretation of MRI could be greatly improved by providing radiologists with an answer key that clearly shows cancer locations on MRI. Registration of histopathology images from patients who had radical prostatectomy to pre-operative MRI allows such mapping…
A cross-modal generative model for incomplete and degraded prostate MRI with multicentre clinical validation
College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算与数据科学学院）；School of Computer Science and Technology, Tongji University（同济大学计算机科学与技术学院）；Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属仁济医院）；National University of Singapore（新加坡国立大学）；Shanghai East Hospital, Tongji University School of Medicine（同济大学医学院附属东方医院）；McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston (UTHealth Houston)（德克萨斯大学休斯顿健康科学中心麦克威廉姆斯生物信息学院）；School of Transportation, Southeast University（东南大学交通学院）；Ningbo Hangzhou Bay Hospital（宁波杭州湾医院）；Changhai Hospital, Naval Medical University（海军军医大学长海医院）
Evaluating Computational Pathology Foundation Models for Prostate Cancer Grading under Distribution Shifts
Department of Medical Epidemiology and Biostatistics, Karolinska Institutet（卡罗林斯卡研究所医学流行病学与生物统计学系）；Department of Engineering Science, University of Oxford（牛津大学工程科学系）
