Medical imaging based prostate cancer diagnosis procedure uses intra-operative transrectal ultrasound (TRUS) imaging to visualize the prostate shape and location to collect tissue samples. Correct tissue sampling from prostate requires accurate prostate segmentation in TRUS images. To achieve this, this study uses a novel residual connection based fully convolutional network. The advantage of this segmentation technique is that it requires no pre-processing of TRUS images to perform the segmentation. Thus, it offers a faster and straightforward prostate segmentation from TRUS images. Results show that the proposed technique can achieve around 86% Dice Similarity accuracy using only few TRUS datasets.
Queen’s University（女王大学）；University of British Columbia（不列颠哥伦比亚大学）；Exact Imaging
MOTIVATION: Detection of prostate cancer during transrectal ultrasound-guided biopsy is challenging. The highly heterogeneous appearance of cancer, presence of ultrasound artefacts, and noise all contribute to these difficulties. Recent advancements in high-frequency ultrasound imaging - micro-ultrasound - have drastically increased the capability of tissue imaging at high resolution. Our aim is to investigate the development of a robust deep learning model specifically for micro-ultrasound-guided prostate cancer biopsy. For the model to be clinically adopted, a key challenge is to design a so…
Siemens Healthineers（西门子医疗）；Imperial College London（帝国理工学院）
Real-time localization of prostate gland in trans-rectal ultrasound images is a key technology that is required to automate the ultrasound guided prostate biopsy procedures. In this paper, we propose a new deep learning based approach which is aimed at localizing several prostate landmarks efficiently and robustly. We propose a multitask learning approach primarily to make the overall algorithm more contextually aware. In this approach, we not only consider the explicit learning of landmark locations, but also build-in a mechanism to learn the contour of the prostate. This multitask learning i…
Queen’s University（女王大学）；University of British Columbia（不列颠哥伦比亚大学）；Exact Imaging（Exact Imaging公司）
A large body of previous machine learning methods for ultrasound-based prostate cancer detection classify small regions of interest (ROIs) of ultrasound signals that lie within a larger needle trace corresponding to a prostate tissue biopsy (called biopsy core). These ROI-scale models suffer from weak labeling as histopathology results available for biopsy cores only approximate the distribution of cancer in the ROIs. ROI-scale models do not take advantage of contextual information that are normally considered by pathologists, i.e. they do not consider information about surrounding tissue and …
Weakly Supervised Spatial Grounding for Discriminative Attention-Based Ultrasound-Histopathology Alignment in Prostate Cancer Grading
University of British Columbia（不列颠哥伦比亚大学）；Vector Institute（向量研究所）；Ordensklinikum Linz（林茨教团医院）；University of Alberta（阿尔伯塔大学）；Exact Imaging（Exact Imaging公司）
Radiological imaging of prostate is becoming more popular among researchers and clinicians in searching for diseases, primarily cancer. Scans might be acquired at different times, with patient movement between scans, or with different equipment, resulting in multiple datasets that need to be registered. For this issue, we introduce a registration method using anatomical feature-guided mutual information. Prostate scans of the same patient taken in three different orientations are first aligned for the accurate detection of anatomical features in 3D. Then, our pipeline allows for multiple modal…
The Chinese University of Hong Kong（香港中文大学）；Shenzhen University（深圳大学）；The Hong Kong Polytechnic University（香港理工大学）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）
Boundary incompleteness raises great challenges to automatic prostate segmentation in ultrasound images. Shape prior can provide strong guidance in estimating the missing boundary, but traditional shape models often suffer from hand-crafted descriptors and local information loss in the fitting procedure. In this paper, we attempt to address those issues with a novel framework. The proposed framework can seamlessly integrate feature extraction and shape prior exploring, and estimate the complete boundary with a sequential manner. Our framework is composed of three key modules. Firstly, we seria…
The size and geometry of the prostate are known to be pivotal quantities used by clinicians to assess the condition of the gland during prostate cancer screening. As an alternative to palpation, an increasing number of methods for estimation of the above-mentioned quantities are based on using imagery data of prostate. The necessity to process large volumes of such data creates a need for automatic segmentation tools which would allow the estimation to be carried out with maximum accuracy and efficiency. In particular, the use of transrectal ultrasound (TRUS) imaging in prostate cancer screeni…
Hybrid Multi-Dimensional MRI Prostate Cancer Detection via Hadamard Network-Based Bias Correction and Residual Networks
Electrical and Computer Engineering Department, University of Illinois Chicago（伊利诺伊大学芝加哥分校电子与计算机工程系）；Machine and Hybrid Intelligence Lab, Northwestern University（西北大学机器与混合智能实验室）；Department of Radiology, University of Chicago（芝加哥大学放射学系）
The advancements in deep learning technologies have produced immense contributions to biomedical image analysis applications. With breast cancer being the common deadliest disease among women, early detection is the key means to improve survivability. Medical imaging like ultrasound presents an excellent visual representation of the functioning of the organs; however, for any radiologist analysing such scans is challenging and time consuming which delays the diagnosis process. Although various deep learning based approaches are proposed that achieved promising results, the present article intr…
University of California, San Francisco（加州大学旧金山分校）；Duke University（杜克大学）；University of Dusseldorf（杜塞尔多夫大学）；University of Washington（华盛顿大学）
Non-invasive prostate cancer detection from MRI has the potential to revolutionize patient care by providing early detection of clinically-significant disease (ISUP grade group >= 2), but has thus far shown limited positive predictive value. To address this, we present an MRI-based deep learning method for predicting clinically significant prostate cancer applicable to a patient population with subsequent ground truth biopsy results ranging from benign pathology to ISUP grade group~5. Specifically, we demonstrate that mixed supervision via diverse histopathological ground truth improves classi…
Queen’s University（女王大学）；University of British Columbia（不列颠哥伦比亚大学）；Exact Imaging（Exact Imaging公司）
Deep learning-based analysis of high-frequency, high-resolution micro-ultrasound data shows great promise for prostate cancer detection. Previous approaches to analysis of ultrasound data largely follow a supervised learning paradigm. Ground truth labels for ultrasound images used for training deep networks often include coarse annotations generated from the histopathological analysis of tissue samples obtained via biopsy. This creates inherent limitations on the availability and quality of labeled data, posing major challenges to the success of supervised learning methods. On the other hand, …
In this work we propose to segment the prostate on a challenging dataset of trans-rectal ultrasound (TRUS) images using convolutional neural networks (CNNs) and statistical shape models (SSMs). TRUS is commonly used for a number of image-guided interventions on the prostate. Fast and accurate segmentation on the organ in these images is crucial to planning and fusion with other modalities such as magnetic resonance images (MRIs) . However, TRUS has limited soft tissue contrast and signal to noise ratio which makes the task of segmenting the prostate challenging and subject to inter-observer an…
Stanford University（斯坦福大学）；University College London（伦敦大学学院）；University of California Los Angeles（加利福尼亚大学洛杉矶分校）
Prostate biopsy and image-guided treatment procedures are often performed under the guidance of ultrasound fused with magnetic resonance images (MRI). Accurate image fusion relies on accurate segmentation of the prostate on ultrasound images. Yet, the reduced signal-to-noise ratio and artifacts (e.g., speckle and shadowing) in ultrasound images limit the performance of automated prostate segmentation techniques and generalizing these methods to new image domains is inherently difficult. In this study, we address these challenges by introducing a novel 2.5D deep neural network for prostate segm…
Institute of Cancer Research（癌症研究所）；University College London（伦敦大学学院）
Effective transperineal ultrasound image guidance in prostate external beam radiotherapy requires consistent alignment between probe and prostate at each session during patient set-up. Probe placement and ultrasound image inter-pretation are manual tasks contingent upon operator skill, leading to interoperator uncertainties that degrade radiotherapy precision. We demonstrate a method for ensuring accurate probe placement through joint classification of images and probe position data. Using a multi-input multi-task algorithm, spatial coordinate data from an optically tracked ultrasound probe is…
A Narrative Review of Image Processing Techniques Related to Prostate Ultrasound
School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University（深圳大学医学部生物医学工程学院）；Department of Computer Science and Engineering, The Chinese University of Hong Kong（香港中文大学计算机科学与工程学系）
University of Waterloo（滑铁卢大学）；Suez Canal University（苏伊士运河大学）
Quantifying the accuracy of segmentation and manual delineation of organs, tissue types and tumors in medical images is a necessary measurement that suffers from multiple problems. One major shortcoming of all accuracy measures is that they neglect the anatomical significance or relevance of different zones within a given segment. Hence, existing accuracy metrics measure the overlap of a given segment with a ground-truth without any anatomical discrimination inside the segment. For instance, if we understand the rectal wall or urethral sphincter as anatomical zones, then current accuracy measu…
3D EAGAN: 3D edge-aware attention generative adversarial network for prostate segmentation in transrectal ultrasound images
Nanchang Hangkong University（南昌航空大学）；Nanjing University of Information Science and Technology（南京信息工程大学）；The First Affiliated Hospital of Nanchang University（南昌大学第一附属医院）
OpenPros: A Large-Scale Dataset for Limited View Prostate Ultrasound Computed Tomography
The University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）；Johns Hopkins University（约翰霍普金斯大学）；The Pennsylvania State University（宾夕法尼亚州立大学）；QT Imaging, Inc.（QT影像公司）；National Institutes of Health（美国国立卫生研究院）；Iowa State University（爱荷华州立大学）；Google DeepMind（谷歌DeepMind）
Mask Enhanced Deeply Supervised Prostate Cancer Detection on B-mode Micro-Ultrasound
Stanford University（斯坦福大学）；The Catholic University of Korea（韩国天主教大学）；University of Alberta（阿尔伯塔大学）；University of California Los Angeles（加州大学洛杉矶分校）；Humanitas University（乌尼塔斯大学）；IRCCS Humanitas Research Hospital（IRCCS乌尼塔斯研究医院）；University of Florida（佛罗里达大学）；University of California San Diego（加州大学圣地亚哥分校）
Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasound
Shenzhen University（深圳大学）；The Chinese University of Hong Kong（香港中文大学）；The Hong Kong Polytechnic University（香港理工大学）；Sun Yat-Sen University（中山大学）；the First Affiliated Hospital（第一附属医院）
Despite the great success of convolutional neural networks (CNN) in 3D medical image segmentation tasks, the methods currently in use are still not robust enough to the different protocols utilized by different scanners, and to the variety of image properties or artefacts they produce. To this end, we introduce OOCS-enhanced networks, a novel architecture inspired by the innate nature of visual processing in the vertebrates. With different 3D U-Net variants as the base, we add two 3D residual components to the second encoder blocks: on and off center-surround (OOCS). They generalise the gangli…
A multi-architecture study of specificity refinement and false-positive mechanism analysis in prostate MRI
The Second Xiangya Hospital of Central South University（中南大学湘雅医学院第二医院）；School of Life Sciences, Central South University（中南大学生命科学学院）；Hunan Provincial Key Laboratory of Medical Information Research (Central South University)（湖南省医学信息研究重点实验室（中南大学））；Hunan Provincial Clinical Medical Research Center for Cardiovascular Intelligent Medicine（湖南省心血管智能医学临床医学研究中心）
Learning Prostate Anatomy at Test Time for Cancer Detection in Micro-Ultrasound
University of British Columbia（不列颠哥伦比亚大学）；Vector Institute（向量研究所）；Ordensklinikum Linz（林茨 Ordenklinikum 医院）；University of Alberta（阿尔伯塔大学）；Exact Imaging（Exact Imaging 公司）
Towards Multi-modality Fusion and Prototype-based Feature Refinement for Clinically Significant Prostate Cancer Classification in Transrectal Ultrasound
School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University（深圳大学医学部生物医学工程学院）；Sun Yat-sen University Cancer Center（中山大学肿瘤防治中心）
Intelligent Diagnosis Using Dual-Branch Attention Network for Rare Thyroid Carcinoma Recognition with Ultrasound Imaging
Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University（上海多维信息处理重点实验室，华东师范大学）；School of Mathematics and Physics, Xi'an Jiaotong-Liverpool University（西安交通大学利物浦大学数学与物理学院）；Department of Ultrasound, Shanghai Tenth People's Hospital（上海第十人民医院超声科）；Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Tongji University School of Medicine（上海超声诊断与治疗工程研究中心，同济大学医学院）；Department of Mathematical Sciences, University of Liverpool（利物浦大学数学科学系）
Hybrid-View Attention Network for Clinically Significant Prostate Cancer Classification in Transrectal Ultrasound
Smart Medical Imaging, Learning and Engineering (SMILE) Lab（智能医学影像、学习与工程实验室）；Medical UltraSound Image Computing (MUSIC) Lab（超声影像计算（MUSIC）实验室）；School of Biomedical Engineering（生物医学工程学院）；Shenzhen University Medical School（深圳大学医学院）；Shenzhen University（深圳大学）；The Department of Ultrasound（超声科）；State Key Laboratory of Oncology in South China（南方肿瘤学关键实验室）；Guangdong Provincial Clinical Research Center for Cancer（广东省癌症临床研究中心）；Sun Yat-sen University Cancer Center（中山大学肿瘤中心）
Distilling Temporal Coherence into 2D Networks for Transrectal Ultrasound Prostate Video Segmentation
Interdisciplinary Program in Bioengineering, Seoul National University（首尔大学生物工程跨学科项目）；Department of Transdisciplinary Medicine, Seoul National University Hospital（首尔大学医院跨学科医学系）；Department of Artificial Intelligence, Yonsei University（延世大学人工智能系）；Department of Radiology, Seoul National University Hospital（首尔大学医院放射科）
What neurosurgeons need to see: synthetic intra-operative MRI from ultrasound for brain-shift compensation in brain tumour surgery
Department of Neurosurgery, Neurovascular Unit, Río Hortega University Hospital, Valladolid, Spain（西班牙巴利亚多利德里奥·奥尔特加大学医院神经外科神经血管科）；Specialized Group in Biomedical Imaging and Computational Analysis (GEIBAC), Instituto de Investigación Biosanitaria de Valladolid (IBioVALL), Valladolid, Spain（西班牙巴利亚多利德生物医学研究与计算分析专业组(GEIBAC)，巴利亚多利德生物健康研究所(IBioVALL)）
Prostate cancer is one of the most prevalent cancers worldwide. One of the key factors in reducing its mortality is based on early detection. The computer-aided diagnosis systems for this task are based on the glandular structural analysis in histology images. Hence, accurate gland detection and segmentation is crucial for a successful prediction. The methodological basis of this work is a prostate gland segmentation based on U-Net convolutional neural network architectures modified with residual and multi-resolution blocks, trained using data augmentation techniques. The residual configuratio…
Bridging MRI and PET physiology: Untangling complementarity through orthogonal representations
Dept. of diagnostic and interventional Radiology and Neuroradiology, University Hospital Augsburg, Germany（德国奥格斯堡大学医院诊断与介入放射学及神经放射学系）；Digital Medicine, University Hospital Augsburg, Germany（德国奥格斯堡大学医院数字医学）；Chair for Computer Aided Medical Procedures and Augmented Reality, Technical University of Munich, Germany（德国慕尼黑工业大学计算机辅助医疗流程与增强现实教席）；Bavarian Center for Cancer Research (BZKF) Augsburg, Germany（德国奥格斯堡巴伐利亚癌症研究中心）；Dept. of Nuclear Medicine, University Hospital Augsburg, Germany（德国奥格斯堡大学医院核医学系）；Dept. of Urology, University Hospital Augsburg, Germany（德国奥格斯堡大学医院泌尿外科）；Center for Advanced Analytics and Predictive Sciences, University of Augsburg, Germany（德国奥格斯堡大学高级分析与预测科学中心）
Worldwide, prostate cancer is one of the main cancers affecting men. The final diagnosis of prostate cancer is based on the visual detection of Gleason patterns in prostate biopsy by pathologists. Computer-aided-diagnosis systems allow to delineate and classify the cancerous patterns in the tissue via computer-vision algorithms in order to support the physicians' task. The methodological core of this work is a U-Net convolutional neural network for image segmentation modified with residual blocks able to segment cancerous tissue according to the full Gleason system. This model outperforms othe…
Université J. Fourier（傅里叶大学）；CNRS（法国国家科学研究中心）；Koelis SAS（Koelis SAS公司）；La Pitié-Salpêtrière Hospital（皮蒂耶-萨尔佩特里埃医院）
Transrectal biopsies under 2D ultrasound (US) control are the current clinical standard for prostate cancer diagnosis. The isoechogenic nature of prostate carcinoma makes it necessary to sample the gland systematically, resulting in a low sensitivity. Also, it is difficult for the clinician to follow the sampling protocol accurately under 2D US control and the exact anatomical location of the biopsy cores is unknown after the intervention. Tracking systems for prostate biopsies make it possible to generate biopsy distribution maps for intra- and post-interventional quality control and 3D visua…
Multi-parametric MR images have been shown to be effective in the non-invasive diagnosis of prostate cancer. Automated segmentation of the prostate eliminates the need for manual annotation by a radiologist which is time consuming. This improves efficiency in the extraction of imaging features for the characterization of prostate tissues. In this work, we propose a fully automated cascaded deep learning architecture with residual blocks, Cascaded MRes-UNET, for segmentation of the prostate gland and the peripheral zone in one pass through the network. The network yields high Dice scores ($0.91…
Influence of High-Performance Image-to-Image Translation Networks on Clinical Visual Assessment and Outcome Prediction: Utilizing Ultrasound to MRI Translation in Prostate Cancer
Samrat Ashok Technological Institute（萨姆拉特·阿肖克技术学院）；Department of Trg. & Technical Education, Govt. of NCT Delhi（德里国家首都辖区政府培训与技术教育局）
Digital image plays a vital role in the early detection of cancers, such as prostate cancer, breast cancer, lungs cancer, cervical cancer. Ultrasound imaging method is also suitable for early detection of the abnormality of fetus. The accurate detection of region of interest in ultrasound image is crucial. Since the result of reflection, refraction and deflection of ultrasound waves from different types of tissues with different acoustic impedance. Usually, the contrast in ultrasound image is very low and weak edges make the image difficult to identify the fetus region in the ultrasound image.…
King’s College London（伦敦国王学院）；Imperial College London（帝国理工学院）
Ultrasound (US) is the most widely used fetal imaging technique. However, US images have limited capture range, and suffer from view dependent artefacts such as acoustic shadows. Compounding of overlapping 3D US acquisitions into a high-resolution volume can extend the field of view and remove image artefacts, which is useful for retrospective analysis including population based studies. However, such volume reconstructions require information about relative transformations between probe positions from which the individual volumes were acquired. In prenatal US scans, the fetus can move indepen…
Clinically significant prostate cancer has a better chance to be sampled during ultrasound-guided biopsy procedures, if suspected lesions found in pre-operative magnetic resonance (MR) images are used as targets. However, the diagnostic accuracy of the biopsy procedure is limited by the operator-dependent skills and experience in sampling the targets, a sequential decision making process that involves navigating an ultrasound probe and placing a series of sampling needles for potentially multiple targets. This work aims to learn a reinforcement learning (RL) policy that optimises the actions o…
Towards Trustworthy Breast Tumor Segmentation in Ultrasound using Monte Carlo Dropout and Deep Ensembles for Epistemic Uncertainty Estimation
Department of Computer Engineering, Kwame Nkrumah University of Science and Technology（计算机工程系，加纳科拉布大学科学与技术大学）；Global Health and Infectious Disease Group, Kumasi Centre for Collaborative Research in Tropical Medicine（全球卫生与传染病组，科拉布热带医学协作研究中心）；Department of Radiology, National Hospital Abuja（放射科，阿布贾国家医院）；Computer Science Department, FAST National University of Computer and Emerging Sciences（计算机科学系，FAST国家计算机与新兴科学大学）；Medical Artificial Intelligence Lab, Lagos, Nigeria（医学人工智能实验室，尼日利亚拉各斯）；Department of Biomedical Engineering, McGill University（生物医学工程系，麦吉尔大学）；Perelman School of Medicine, University of Pennsylvania（佩尔曼医学学院，宾夕法尼亚大学）；Nnamdi Azikiwe University Teaching Hospital（纳曼迪·阿齐基韦大学教学医院）
Rensselaer Polytechnic Institute（伦斯勒理工学院）；National Institutes of Health（美国国立卫生研究院）；National Cancer Institute（美国国家癌症研究所）
Prostate cancer biopsy benefits from accurate fusion of transrectal ultrasound (TRUS) and magnetic resonance (MR) images. In the past few years, convolutional neural networks (CNNs) have been proved powerful in extracting image features crucial for image registration. However, challenging applications and recent advances in computer vision suggest that CNNs are quite limited in its ability to understand spatial correspondence between features, a task in which the self-attention mechanism excels. This paper aims to develop a self-attention mechanism specifically for cross-modal image registrati…
