Model generalization capacity at domain shift (e.g., various imaging protocols and scanners) is crucial for deep learning methods in real-world clinical deployment. This paper tackles the challenging problem of domain generalization, i.e., learning a model from multi-domain source data such that it can directly generalize to an unseen target domain. We present a novel shape-aware meta-learning scheme to improve the model generalization in prostate MRI segmentation. Our learning scheme roots in the gradient-based meta-learning, by explicitly simulating domain shift with virtual meta-train and meta-test during training. Importantly, considering the deficiencies encountered when applying a segmentation model to unseen domains (i.e., incomplete shape and ambiguous boundary of the prediction masks), we further introduce two complementary loss objectives to enhance the meta-optimization, by particularly encouraging the shape compactness and shape smoothness of the segmentations under simulated domain shift. We evaluate our method on prostate MRI data from six different institutions with distribution shifts acquired from public datasets. Experimental results show that our approach outperforms many state-of-the-art generalization methods consistently across all six settings of unseen domains.
Prostate Age Gap (PAG): An MRI surrogate marker of aging for prostate cancer detection
University of Stavanger（斯塔万格大学）；Stavanger University Hospital（斯塔万格大学医院）；Karolinska Institutet（卡罗林斯卡学院）；Capio S:t Gorän Hospital（卡皮奥圣戈兰医院）；Danderyd Hospital（丹德里德医院）
Prostate cancer (PCa) is the most common cancer in men in the United States. Multiparametic magnetic resonance imaging (mp-MRI) has been explored by many researchers to targeted prostate biopsies and radiation therapy. However, assessment on mp-MRI can be subjective, development of computer-aided diagnosis systems to automatically delineate the prostate gland and the intraprostratic lesions (ILs) becomes important to facilitate with radiologists in clinical practice. In this paper, we first study the implementation of the Mask-RCNN model to segment the prostate and ILs. We trained and evaluate…
Istanbul Technical University（伊斯坦布尔理工大学）；Acibadem Mehmet Ali Aydinlar University School of Medicine（阿吉巴德姆·穆罕默德·阿里·艾丁拉尔大学医学院）；Bahcesehir University（巴耶塞特大学）
Biparametric MRI has emerged as an alternative to multiparametric prostate MRI, which eliminates the need for the potential harms to the patient due to the contrast medium. One major issue with biparametric MRI is difficulty to detect clinically significant prostate cancer (csPCA). Deep learning algorithms have emerged as an alternative solution to detect csPCA in cohort studies. We present a workflow which predicts csPCA on biparametric prostate MRI PI-CAI 2022 Challenge with over 10,000 carefully-curated prostate MRI exams. We propose to to segment the prostate gland first to the central gla…
Stavanger University Hospital（斯塔万格大学医院）；University of Stavanger（斯塔万格大学）
Masked Image Modelling (MIM) has been shown to be an efficient self-supervised learning (SSL) pre-training paradigm when paired with transformer architectures and in the presence of a large amount of unlabelled natural images. The combination of the difficulties in accessing and obtaining large amounts of labeled data and the availability of unlabelled data in the medical imaging domain makes MIM an interesting approach to advance deep learning (DL) applications based on 3D medical imaging data. Nevertheless, SSL and, in particular, MIM applications with medical imaging data are rather scarce …
The MRI Institute for Biomedical Research（MRI 生物医学研究所）；Uber Technologies Inc.（优步技术公司）；LinkedIn（领英公司）；USAA（美国汽车协会联合服务银行）
A novel deep learning architecture (XmasNet) based on convolutional neural networks was developed for the classification of prostate cancer lesions, using the 3D multiparametric MRI data provided by the PROSTATEx challenge. End-to-end training was performed for XmasNet, with data augmentation done through 3D rotation and slicing, in order to incorporate the 3D information of the lesion. XmasNet outperformed traditional machine learning models based on engineered features, for both train and test data. For the test data, XmasNet outperformed 69 methods from 33 participating groups and achieved …
University of California, Los Angeles (UCLA)（加利福尼亚大学洛杉矶分校）；The First Affiliated Hospital of China Medical University（中国医科大学附属第一医院）；VoxelCloud, Inc.（体素云公司）
Prostate cancer is the second leading cause of cancer death among men in the United States. The diagnosis of prostate MRI often relies on the accurate prostate zonal segmentation. However, state-of-the-art automatic segmentation methods often fail to produce well-contained volumetric segmentation of the prostate zones since certain slices of prostate MRI, such as base and apex slices, are harder to segment than other slices. This difficulty can be overcome by accounting for the cross-slice relationship of adjacent slices, but current methods do not fully learn and exploit such relationships. I…
Magnetic Resonance Imaging (MRI) is widely used for screening and staging prostate cancer. However, many prostate cancers have subtle features which are not easily identifiable on MRI, resulting in missed diagnoses and alarming variability in radiologist interpretation. Machine learning models have been developed in an effort to improve cancer identification, but current models localize cancer using MRI-derived features, while failing to consider the disease pathology characteristics observed on resected tissue. In this paper, we propose CorrSigNet, an automated two-step model that localizes p…
Mansoura University（曼苏拉大学）；Higher Institute of Engineering and Technology（高等工程技术学院）
Prostate cancer is the most dangerous cancer diagnosed in men worldwide. Prostate diagnosis has been affected by many factors, such as lesion complexity, observer visibility, and variability. Many techniques based on Magnetic Resonance Imaging (MRI) have been used for prostate cancer identification and classification in the last few decades. Developing these techniques is crucial and has a great medical effect because they improve the treatment benefits and the chance of patients' survival. A new technique that depends on MRI has been proposed to improve the diagnosis. This technique consists …
The Chinese University of Hong Kong（香港中文大学）；Stanford University（斯坦福大学）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）
Automated prostate segmentation in MRI is highly demanded for computer-assisted diagnosis. Recently, a variety of deep learning methods have achieved remarkable progress in this task, usually relying on large amounts of training data. Due to the nature of scarcity for medical images, it is important to effectively aggregate data from multiple sites for robust model training, to alleviate the insufficiency of single-site samples. However, the prostate MRIs from different sites present heterogeneity due to the differences in scanners and imaging protocols, raising challenges for effective ways o…
University of Waterloo（滑铁卢大学）；University of Toronto（多伦多大学）；Sunnybrook Health Sciences Centre（桑尼布鲁克健康科学中心）
Prostate cancer is the most diagnosed form of cancer in Canadian men, and is the third leading cause of cancer death. Despite these statistics, prognosis is relatively good with a sufficiently early diagnosis, making fast and reliable prostate cancer detection crucial. As imaging-based prostate cancer screening, such as magnetic resonance imaging (MRI), requires an experienced medical professional to extensively review the data and perform a diagnosis, radiomics-driven methods help streamline the process and has the potential to significantly improve diagnostic accuracy and efficiency, and thu…
Purpose: We aimed to develop deep machine learning (DL) models to improve the detection and segmentation of intraprostatic lesions (IL) on bp-MRI by using whole amount prostatectomy specimen-based delineations. We also aimed to investigate whether transfer learning and self-training would improve results with small amount labelled data. Methods: 158 patients had suspicious lesions delineated on MRI based on bp-MRI, 64 patients had ILs delineated on MRI based on whole mount prostatectomy specimen sections, 40 patients were unlabelled. A non-local Mask R-CNN was proposed to improve the segmentat…
Radiological imaging of prostate is becoming more popular among researchers and clinicians in searching for diseases, primarily cancer. Scans might be acquired at different times, with patient movement between scans, or with different equipment, resulting in multiple datasets that need to be registered. For this issue, we introduce a registration method using anatomical feature-guided mutual information. Prostate scans of the same patient taken in three different orientations are first aligned for the accurate detection of anatomical features in 3D. Then, our pipeline allows for multiple modal…
Continual atlas-based segmentation of prostate MRI
Technical University of Darmstadt（达姆施塔特工业大学）；Stanford University（斯坦福大学）；University of Cologne（科隆大学）；University of Frankfurt（法兰克福大学）；University Medical Center Mainz（美因茨大学医学中心）
University of California, San Francisco（加州大学旧金山分校）；Duke University（杜克大学）；University of Dusseldorf（杜塞尔多夫大学）；University of Washington（华盛顿大学）
Non-invasive prostate cancer detection from MRI has the potential to revolutionize patient care by providing early detection of clinically-significant disease (ISUP grade group >= 2), but has thus far shown limited positive predictive value. To address this, we present an MRI-based deep learning method for predicting clinically significant prostate cancer applicable to a patient population with subsequent ground truth biopsy results ranging from benign pathology to ISUP grade group~5. Specifically, we demonstrate that mixed supervision via diverse histopathological ground truth improves classi…
Springbok, Inc.（斯普林博克公司）；University of Kentucky（肯塔基大学）；University of Virginia（弗吉尼亚大学）
This paper proposes a two-stage segmentation model, variable-input based uncertainty measures and an uncertainty-guided post-processing method for prostate segmentation on 3D magnetic resonance images (MRI). The two-stage model was based on 3D dilated U-Nets with the first stage to localize the prostate and the second stage to obtain an accurate segmentation from cropped images. For data augmentation, we proposed the variable-input method which crops the region of interest with additional random variations. Similar to other deep learning models, the proposed model also faced the challenge of s…
Diffusion MRI preprocessing affects ADC estimation and automatic PI-RADS v2.1 classification in bi-parametric prostate MRI
Center for Image Sciences, University Medical Center Utrecht（乌得勒支大学医学中心影像科学中心）；Department of Radiotherapy, University Medical Center Utrecht（乌得勒支大学医学中心放射治疗科）；Cerebriu（Cerebriu公司）；Department of Diagnostic Radiology, Copenhagen University Hospital Rigshospitalet（哥本哈根大学医院 Rigshospitalet 诊断放射科）；Department of Diagnostic Radiology, Copenhagen University Hospital Herlev and Gentofte（哥本哈根大学医院海尔鲁夫与根措夫特医院诊断放射科）
Prostate cancer was the third most common cancer in 2020 internationally, coming after breast cancer and lung cancer. Furthermore, in recent years prostate cancer has shown an increasing trend. According to clinical experience, if this problem is detected and treated early, there can be a high chance of survival for the patient. One task that helps diagnose prostate cancer is prostate segmentation from magnetic resonance imaging. Manual segmentation performed by clinical experts has its drawbacks such as: the high time and concentration required from observers; and inter- and intra-observer va…
Radboud University Medical Centre Nijmegen（拉德堡德大学奈梅亨医学中心）
Convolutional networks have become state-of-the-art techniques for automatic medical image analysis, with the U-net architecture being the most popular at this moment. In this article we report the application of a 3D version of U-net to the automatic segmentation of prostate peripheral and transition zones in 3D MRI images. Our results are slightly better than recent studies that used 2D U-net and handcrafted feature approaches. In addition, we test ideas for improving the 3D U-net setup, by 1) letting the network segment surrounding tissues, making use of the fixed anatomy, and 2) adjusting …
University of California, San Francisco（加州大学旧金山分校）；Duke University（杜克大学）
Early prostate cancer detection and staging from MRI are extremely challenging tasks for both radiologists and deep learning algorithms, but the potential to learn from large and diverse datasets remains a promising avenue to increase their generalization capability both within- and across clinics. To enable this for prototype-stage algorithms, where the majority of existing research remains, in this paper we introduce a flexible federated learning framework for cross-site training, validation, and evaluation of deep prostate cancer detection algorithms. Our approach utilizes an abstracted rep…
The diagnosis of prostate cancer faces a problem with overdiagnosis that leads to damaging side effects due to unnecessary treatment. Research has shown that the use of multi-parametric magnetic resonance images to conduct biopsies can drastically help to mitigate the overdiagnosis, thus reducing the side effects on healthy patients. This study aims to investigate the use of deep learning techniques to explore computer-aid diagnosis based on MRI as input. Several diagnosis problems ranging from classification of lesions as being clinically significant or not to the detection and segmentation o…
University of Milano-Bicocca（米兰比可卡大学）；Italian National Research Council（意大利国家研究委员会）；University of Cambridge（剑桥大学）；Cancer Research UK Cambridge Centre（英国癌症研究中心剑桥中心）；The University of Tokyo（东京大学）；Wellcome Trust Sanger Institute（惠康基金会桑格研究所）
Prostate cancer is the most common malignant tumors in men but prostate Magnetic Resonance Imaging (MRI) analysis remains challenging. Besides whole prostate gland segmentation, the capability to differentiate between the blurry boundary of the Central Gland (CG) and Peripheral Zone (PZ) can lead to differential diagnosis, since tumor's frequency and severity differ in these regions. To tackle the prostate zonal segmentation task, we propose a novel Convolutional Neural Network (CNN), called USE-Net, which incorporates Squeeze-and-Excitation (SE) blocks into U-Net. Especially, the SE blocks ar…
To our knowledge, all deep computer-aided detection and diagnosis (CAD) systems for prostate cancer (PCa) detection consider bi-parametric magnetic resonance imaging (bp-MRI) only, including T2w and ADC sequences while excluding the 4D perfusion sequence,which is however part of standard clinical protocols for this diagnostic task. In this paper, we question strategies to integrate information from perfusion imaging in deep neural architectures. To do so, we evaluate several ways to encode the perfusion information in a U-Net like architecture, also considering early versus mid fusion strategi…
Hybrid Multi-Dimensional MRI Prostate Cancer Detection via Hadamard Network-Based Bias Correction and Residual Networks
Electrical and Computer Engineering Department, University of Illinois Chicago（伊利诺伊大学芝加哥分校电子与计算机工程系）；Machine and Hybrid Intelligence Lab, Northwestern University（西北大学机器与混合智能实验室）；Department of Radiology, University of Chicago（芝加哥大学放射学系）
In this work, we propose a deep U-Net based model to tackle the challenging task of prostate cancer segmentation by aggressiveness in MRI based on weak scribble annotations. This model extends the size constraint loss proposed by Kervadec et al. 1 in the context of multiclass detection and segmentation task. This model is of high clinical interest as it allows training on prostate biopsy samples and avoids time-consuming full annotation process. Performance is assessed on a private dataset (219 patients) where the full ground truth is available as well as on the ProstateX-2 challenge database,…
University of Stavanger（斯塔万格大学）；Stavanger University Hospital（斯塔万格大学医院）；University of Agder（阿格德尔大学）
Prostate cancer (PCa) is the second most common cancer diagnosed among men worldwide. The current PCa diagnostic pathway comes at the cost of substantial overdiagnosis, leading to unnecessary treatment and further testing. Bi-parametric magnetic resonance imaging (bp-MRI) based on apparent diffusion coefficient maps (ADC) and T2-weighted (T2w) sequences has been proposed as a triage test to differentiate between clinically significant (cS) and non-clinically significant (ncS) prostate lesions. However, analysis of the sequences relies on expertise, requires specialized training, and suffers fr…
Evaluating the Predictive Value of Preoperative MRI for Erectile Dysfunction Following Radical Prostatectomy
University of Amsterdam（阿姆斯特丹大学）；Antoni van Leeuwenhoek-Netherlands Cancer Institute（安托尼·范·列文霍克-荷兰癌症研究所）；Department of Urology（泌尿科部）；AI Technology for Life（人工智能技术生命）；Utrecht University（乌特勒支大学）；GROW School for Oncology and Developmental Biology（GROW肿瘤学与发育生物学学院）
Histopathological Spectrum-Guided Prostate Stratification via Segmentation-Assisted Diagnostic Transformer
College of Artificial Intelligence, Nankai University（南开大学人工智能学院）；Tianjin First Central Hospital（天津市第一中心医院）；School of Electronics and Information Engineering, Tiangong University（天津工业大学电子与信息工程学院）；School of Artificial Intelligence, Hebei University of Technology（河北工业大学人工智能学院）；North China Digital Health Technology Co., Ltd.（华北数字健康科技有限公司）；School of Computing and Information Systems, Singapore Management University（新加坡管理大学计算与信息系统学院）
Non-Invasive Detection of PROState Cancer with Novel Time-Dependent Diffusion MRI and AI-Enhanced Quantitative Radiological Interpretation: PROS-TD-AI
University of Chile（智利大学）；Clínica Dávila（达维拉诊所）；Zhejiang University（浙江大学）；Hospital Clinic, Universitat de Barcelona（巴塞罗那大学医院诊所）；San Sebastián University（圣塞巴斯蒂安大学）
University of Toronto（多伦多大学）；Lunenfeld-Tanenbaum Research Institute, Sinai Health System（Sinai Health System 伦内菲尔德-塔嫩鲍姆研究所）；Brigham and Women’s Hospital（布莱根妇女医院）；The Hospital for Sick Children（SickKids 医院）
The segmentation of prostate whole gland and transition zone in Diffusion Weighted MRI (DWI) are the first step in designing computer-aided detection algorithms for prostate cancer. However, variations in MRI acquisition parameters and scanner manufacturing result in different appearances of prostate tissue in the images. Convolutional neural networks (CNNs) which have shown to be successful in various medical image analysis tasks including segmentation are typically sensitive to the variations in imaging parameters. This sensitivity leads to poor segmentation performance of CNNs trained on a …
University of Magdeburg（马格德堡大学）；Fraunhofer Institute for Digital Medicine MEVIS（弗劳恩霍夫数字医学研究所 MEVIS）；Radboud University Medical Center（拉德堡德大学医学中心）；University Hospital Magdeburg（马格德堡大学医院）；University of Bremen（不来梅大学）
Background and Objective: Accurate and reliable segmentation of the prostate gland in MR images can support the clinical assessment of prostate cancer, as well as the planning and monitoring of focal and loco-regional therapeutic interventions. Despite the availability of multi-planar MR scans due to standardized protocols, the majority of segmentation approaches presented in the literature consider the axial scans only. Methods: We propose an anisotropic 3D multi-stream CNN architecture, which processes additional scan directions to produce a higher-resolution isotropic prostate segmentation.…
Interpretable Prostate Cancer Detection using a Small Cohort of MRI Images
Department of Computer Science, Boston University Metropolitan College（波士顿大学计算机科学系）；Department of Radiology, McMaster University（麦斯特大学放射科）；Department of Radiology, School of Medicine, 5th Azar Hospital, Golestan University of Medical Sciences（戈兰大学医学学院放射科，第五阿扎尔医院）；Department of Medical Imaging, Niagara Health System（尼亚加拉健康系统医学影像科）；Center of Excellence in Precision Medicine and Digital Health, Department of Physiology, Chulalongkorn University（朱拉隆梭大学精准医学与数字健康中心，生理学系）
A cross-modal generative model for incomplete and degraded prostate MRI with multicentre clinical validation
College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算与数据科学学院）；School of Computer Science and Technology, Tongji University（同济大学计算机科学与技术学院）；Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属仁济医院）；National University of Singapore（新加坡国立大学）；Shanghai East Hospital, Tongji University School of Medicine（同济大学医学院附属东方医院）；McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston (UTHealth Houston)（德克萨斯大学休斯顿健康科学中心麦克威廉姆斯生物信息学院）；School of Transportation, Southeast University（东南大学交通学院）；Ningbo Hangzhou Bay Hospital（宁波杭州湾医院）；Changhai Hospital, Naval Medical University（海军军医大学长海医院）
Leveraging Clinical Text and Class Conditioning for 3D Prostate MRI Generation
University of Toronto（多伦多大学）；Lunenfeld-Tanenbaum Research Institute, Mount Sinai Hospital（西奈山医院卢嫩菲尔德-塔南鲍姆研究所）；KITE Research Institute, Toronto Rehabilitation Institute, University Health Network（大学健康网络多伦多康复研究所KITE研究所）；Vector Institute（Vector研究所）；Princess Margaret Hospital（玛格丽特公主医院）；Sinai Health System（西奈健康系统）
Henry Ford Health System（亨利福特医疗系统）；Wayne State University（韦恩州立大学）
Deep learning models have had a great success in disease classifications using large data pools of skin cancer images or lung X-rays. However, data scarcity has been the roadblock of applying deep learning models directly on prostate multiparametric MRI (mpMRI). Although model interpretation has been heavily studied for natural images for the past few years, there has been a lack of interpretation of deep learning models trained on medical images. This work designs a customized workflow for the small and imbalanced data set of prostate mpMRI where features were extracted from a deep learning m…
MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal Prostate MRI Segmentation
School of Biomedical Engineering & Imaging Sciences, King’s College London, United Kingdom（生物医学工程与成像科学学院，伦敦国王学院，英国）；Department of Radiology, Guy’s and St Thomas’ NHS Foundation Trust, United Kingdom（放射科，盖茨和圣Thomas国家卫生信托基金会，英国）
Facebook（脸书）；Stanford University School of Medicine（斯坦福大学医学院）；Stanford University（斯坦福大学）；VA Palo Alto Health Care System（帕洛阿尔托退伍军人医疗保健系统）
Prostate cancer is the second deadliest cancer for American men. While Magnetic Resonance Imaging (MRI) is increasingly used to guide targeted biopsies for prostate cancer diagnosis, its utility remains limited due to high rates of false positives and false negatives as well as low inter-reader agreements. Machine learning methods to detect and localize cancer on prostate MRI can help standardize radiologist interpretations. However, existing machine learning methods vary not only in model architecture, but also in the ground truth labeling strategies used for model training. In this study, we…
Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）；Graz University of Technology（格拉茨工业大学）；GE Healthcare（GE医疗）
Purpose: To investigate feasibility of accelerating prostate diffusion-weighted imaging (DWI) by reducing the number of acquired averages and denoising the resulting image using a proposed guided denoising convolutional neural network (DnCNN). Materials and Methods: Raw data from the prostate DWI scans were retrospectively gathered (between July 2018 and July 2019) from six single-vendor MRI scanners. 118 data sets were used for training and validation (age: 64.3 +- 8 years) and 37 - for testing (age: 65.1 +- 7.3 years). High b-value diffusion-weighted (hb-DW) data were reconstructed into nois…
Leveraging multi-view data without annotations for prostate MRI segmentation: A contrastive approach
University of Stavanger（斯塔万格大学）；Karolinska Institute（卡罗林斯卡学院）；Capio S:t Göran Hospital（卡皮奥圣戈兰医院）；Danderyd Hospital（丹德吕德医院）；Stavanger University Hospital（斯塔万格大学医院）
Scaling Artificial Intelligence for Prostate Cancer Detection on MRI towards Organized Screening and Primary Diagnosis in a Global, Multiethnic Population (Study Protocol)
University of Electronic Science and Technology of China（电子科技大学）；University of Toronto（多伦多大学）；The Hospital for Sick Children (SickKids)（SickKids 儿童医院（病童医院））；Sinai Health System（西奈卫生系统）；University Health Network（大学健康网络）；Lunenfeld-Tanenbaum Research Institute（卢嫩菲尔德-塔南鲍姆研究所）；Sunnybrook Research Institute（桑尼布鲁克研究所）
Data augmentation refers to a group of techniques whose goal is to battle limited amount of available data to improve model generalization and push sample distribution toward the true distribution. While different augmentation strategies and their combinations have been investigated for various computer vision tasks in the context of deep learning, a specific work in the domain of medical imaging is rare and to the best of our knowledge, there has been no dedicated work on exploring the effects of various augmentation methods on the performance of deep learning models in prostate cancer detect…
Tumor likelihood estimation on MRI prostate data by utilizing k-Space information
Institute for AI in Medicine (IKIM)（人工智能医学研究所（IKIM））；University Hospital Essen（埃森大学医院）；Cancer Research Center Cologne Essen (CCCE)（科隆埃森癌症研究中心（CCCE））；University Medicine Essen（埃森大学医学部）；Department of Physics of the Technical University Dortmund（多特蒙德工业大学物理系）；Department of Urology, University Hospital Essen（埃森大学医院泌尿外科）
