Domain and Geometry Agnostic CNNs for Left Atrium Segmentation in 3D Ultrasound
Technische Universität München(慕尼黑工业大学);TOMTEC Imaging Systems GmbH(TOMTEC成像系统有限公司);Whiting School of Engineering, Johns Hopkins University(约翰斯·霍普金斯大学怀廷工程学院)
Markus A. Degel, Nassir Navab, Shadi Albarqouni
发表信息:
Medical Image Computing and Computer Assisted Intervention (MICCAI 2018)
Segmentation of the left atrium and deriving its size can help to predict and detect various cardiovascular conditions. Automation of this process in 3D Ultrasound image data is desirable, since manual delineations are time-consuming, challenging and observer-dependent. Convolutional neural networks have made improvements in computer vision and in medical image analysis. They have successfully been applied to segmentation tasks and were extended to work on volumetric data. In this paper we introduce a combined deep-learning based approach on volumetric segmentation in Ultrasound acquisitions with incorporation of prior knowledge about left atrial shape and imaging device. The results show, that including a shape prior helps the domain adaptation and the accuracy of segmentation is further increased with adversarial learning.
A Computational Pipeline for Advanced Analysis of 4D Flow MRI in the Left Atrium
PhySense, Department of Information and Communication Technologies, Universitat Pompeu Fabra(PhySense,信息与通信技术系,庞培法布拉大学);Auckland Bioengineering Institute, University of Auckland(奥克兰生物工程研究所,奥克兰大学);Faculty of Health and Environmental Sciences, Auckland University of Technology(健康与环境科学学院,奥克兰技术大学);University Hospital Centre Zagreb(Zagreb大学医院中心);Cardiovascular Institute, Hospital Clínic, Universitat de Barcelona(心血管研究所,医院临床,巴塞罗那大学);Institut d’investigacions biomèdiques august pi i sunyer (IDIBAPS)(生物医学研究机构August Pi i Sunyer(IDIBAPS));Institute for Medical Engineering and Science, Massachusetts Institute of Technology(医学工程与科学研究所,麻省理工学院);Karolinska Institutet, Department of Molecular Medicine and Surgery(Karolinska研究所,分子医学与外科学系)
Technische Universität München(慕尼黑工业大学);Ludwig-Maximilians-University (LMU)(路德维希-马克西米利安大学(慕尼黑大学))
In this work we propose a novel approach to perform segmentation by leveraging the abstraction capabilities of convolutional neural networks (CNNs). Our method is based on Hough voting, a strategy that allows for fully automatic localisation and segmentation of the anatomies of interest. This approach does not only use the CNN classification outcomes, but it also implements voting by exploiting the features produced by the deepest portion of the network. We show that this learning-based segmentation method is robust, multi-region, flexible and can be easily adapted to different modalities. In …
Center for Research in Computer Vision (CRCV), University of Central Florida(中佛罗里达大学计算机视觉研究中心);Diagnostic Radiology Department, Florida Hospital(佛罗里达医院放射诊断科)
Non-invasive detection of cardiovascular disorders from radiology scans requires quantitative image analysis of the heart and its substructures. There are well-established measurements that radiologists use for diseases assessment such as ejection fraction, volume of four chambers, and myocardium mass. These measurements are derived as outcomes of precise segmentation of the heart and its substructures. The aim of this paper is to provide such measurements through an accurate image segmentation algorithm that automatically delineates seven substructures of the heart from MRI and/or CT scans. O…
HDC: Hierarchical Distillation for Multi-level Noisy Consistency in Semi-Supervised Fetal Ultrasound Segmentation
University of Information Technology(信息科技大学);Ho Chi Minh University of Technology(胡志明市技术大学);University of Science(科学大学);Vietnam National University(越南国家大学);Boston University(波士顿大学);Taipei Medical University(台北医学大学);Posts and Telecommunications Institute of Technology(邮电技术学院);New Mexico State University(新墨西哥州立大学)
Politecnico di Milano(米兰理工大学);Istituto Italiano di Tecnologia(意大利技术研究院);Università Politecnica delle Marche(马尔凯理工大学)
Breast cancer is one of the deadliest cancer worldwide. Timely detection could reduce mortality rates. In the clinical routine, classifying benign and malignant tumors from ultrasound (US) imaging is a crucial but challenging task. An automated method, which can deal with the variability of data is therefore needed. In this paper, we compared different Convolutional Neural Networks (CNNs) and transfer learning methods for the task of automated breast tumor classification. The architectures investigated in this study were VGG-16 and Inception V3. Two different training strategies were investiga…
Institute of Fundamental Technological Research, \ Academy of Sciences, Warsaw, Poland Corresponding author, e-mail
Attenuation coefficient (AC) is a fundamental measure of tissue acoustical properties, which can be used in medical diagnostics. In this work, we investigate the feasibility of using convolutional neural networks (CNNs) to directly estimate AC from radio-frequency (RF) ultrasound signals. To develop the CNNs we used RF signals collected from tissue mimicking numerical phantoms for the AC values in a range from 0.1 to 1.5 dB/(MHz*cm). The models were trained based on 1-D patches of RF data. We obtained mean absolute AC estimation errors of 0.08, 0.12, 0.20, 0.25 for the patch lengths: 10 mm, 5 …
Institute of Fundamental Technological Research, Polish Academy of Sciences(波兰科学院基础技术研究所);Medical University of Warsaw(华沙医科大学)
Convolutional neural networks (CNNs) have achieved remarkable success in medical image analysis tasks. In ultrasound (US) imaging, CNNs have been applied to object classification, image reconstruction and tissue characterization. However, CNNs can be vulnerable to adversarial attacks, even small perturbations applied to input data may significantly affect model performance and result in wrong output. In this work, we devise a novel adversarial attack, specific to ultrasound (US) imaging. US images are reconstructed based on radio-frequency signals. Since the appearance of US images depends on …
Convolutional neural networks (CNNs) have attracted a rapidly growing interest in a variety of different processing tasks in the medical ultrasound community. However, the performance of CNNs is highly reliant on both the amount and fidelity of the training data. Therefore, scarce data is almost always a concern, particularly in the medical field, where clinical data is not easily accessible. The utilization of synthetic data is a popular approach to address this challenge. However, but simulating a large number of images using packages such as Field II is time-consuming, and the distribution …
University of Sherbrooke(舍布鲁克大学);University of Bourgogne Franche-Comte(勃艮第-弗朗什孔泰大学);CASIS inc.(CASIS公司);University of Lyon(里昂大学)
Convolutional neural networks (CNN) have had unprecedented success in medical imaging and, in particular, in medical image segmentation. However, despite the fact that segmentation results are closer than ever to the inter-expert variability, CNNs are not immune to producing anatomically inaccurate segmentations, even when built upon a shape prior. In this paper, we present a framework for producing cardiac image segmentation maps that are guaranteed to respect pre-defined anatomical criteria, while remaining within the inter-expert variability. The idea behind our method is to use a well-trai…
Rensselaer Polytechnic Institute(伦斯勒理工学院);National Institutes of Health(美国国立卫生研究院);National Cancer Institute(美国国家癌症研究所)
Prostate cancer biopsy benefits from accurate fusion of transrectal ultrasound (TRUS) and magnetic resonance (MR) images. In the past few years, convolutional neural networks (CNNs) have been proved powerful in extracting image features crucial for image registration. However, challenging applications and recent advances in computer vision suggest that CNNs are quite limited in its ability to understand spatial correspondence between features, a task in which the self-attention mechanism excels. This paper aims to develop a self-attention mechanism specifically for cross-modal image registrati…
Echocardiography Segmentation Using Neural ODE-based Diffeomorphic Registration Field
University of Engineering and Technology, Vietnam National University(越南国立大学工程技术大学);VinUniversity(文梅大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Auckland Bioengineering Institute, University of Auckland(奥克兰大学生物工程研究所);Beihang University(北京航空航天大学);Peking University(北京大学);SenseTime Inc(商汤科技);Tencent Jarvis Laboratory(腾讯Jarvis实验室);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学);The Chinese University of Hong Kong(香港中文大学);Shenzhen University(深圳大学);Wuhan University(武汉大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);EPITA Research and Development Laboratory(EPITA研发实验室);Imperial College London(伦敦帝国学院);Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学);Harbin Institute of Technology(哈尔滨工业大学);University of Bologna(博洛尼亚大学);Eindhoven University of Technology(埃因霍温理工大学);Kings College London(伦敦国王学院);University of Magdeburg(马格德堡大学);Heidelberg University Hospital(海德堡大学医院);Leiden University Medical Center(莱顿大学医学中心);Universitat Pompeu Fabra(庞培法布拉大学);Physense(Physense机构)
Segmentation of cardiac images, particularly late gadolinium-enhanced magnetic resonance imaging (LGE-MRI) widely used for visualizing diseased cardiac structures, is a crucial first step for clinical diagnosis and treatment. However, direct segmentation of LGE-MRIs is challenging due to its attenuated contrast. Since most clinical studies have relied on manual and labor-intensive approaches, automatic methods are of high interest, particularly optimized machine learning approaches. To address this, we organized the "2018 Left Atrium Segmentation Challenge" using 154 3D LGE-MRIs, currently the…
Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206(里昂大学、里昂国立应用科学学院、里昂第一大学(克洛德·贝尔纳里昂第一大学)、圣艾蒂安大学、法国国家科学研究中心、法国国家健康与医学研究院、CREATIS联合研究所);CH Avignon(阿维尼翁中心医院)
Preterm neonates are highly likely to suffer from ventriculomegaly, a dilation of the Cerebral Ventricular System (CVS). This condition can develop into life-threatening hydrocephalus and is correlated with future neuro-developmental impairments. Consequently, it must be detected and monitored by physicians. In clinical routing, manual 2D measurements are performed on 2D ultrasound (US) images to estimate the CVS volume but this practice is imprecise due to the unavailability of 3D information. A way to tackle this problem would be to develop automatic CVS segmentation algorithms for 3D US dat…
School of Computing, University of Buckingham(白金汉大学计算学院)
Deep Convolutional Neural Networks (CNN) provides an "end-to-end" solution for image pattern recognition with impressive performance in many areas of application including medical imaging. Most CNN models of high performance use hand-crafted network architectures that require expertise in CNNs to utilise their potentials. In this paper, we applied the Efficient Neural Architecture Search (ENAS) method to find optimal CNN architectures for classifying breast lesions from ultrasound (US) images. Our empirical study with a dataset of 524 US images shows that the optimal models generated by using …
Eindhoven University of Technology(埃因霍温理工大学);Shandong University of Science and Technology(山东科技大学);Philips Research(飞利浦研究院)
Accurate and efficient catheter segmentation in 3D ultrasound (US) is essential for cardiac intervention. Currently, the state-of-the-art segmentation algorithms are based on convolutional neural networks (CNNs), which achieved remarkable performances in a standard Cartesian volumetric data. Nevertheless, these approaches suffer the challenges of low efficiency and GPU unfriendly image size. Therefore, such difficulties and expensive hardware requirements become a bottleneck to build accurate and efficient segmentation models for real clinical application. In this paper, we propose a novel Fru…
Image-guided radiation therapy can benefit from accurate motion tracking by ultrasound imaging, in order to minimize treatment margins and radiate moving anatomical targets, e.g., due to breathing. One way to formulate this tracking problem is the automatic localization of given tracked anatomical landmarks throughout a temporal ultrasound sequence. For this, we herein propose a fully-convolutional Siamese network that learns the similarity between pairs of image regions containing the same landmark. Accordingly, it learns to localize and thus track arbitrary image features, not only predefine…
Ultrasound-guided regional anesthesia (UGRA) can replace general anesthesia (GA), improving pain control and recovery time. This method can be applied on the brachial plexus (BP) after clavicular surgeries. However, identification of the BP from ultrasound (US) images is difficult, even for trained professionals. To address this problem, convolutional neural networks (CNNs) and more advanced deep neural networks (DNNs) can be used for identification and segmentation of the BP nerve region. In this paper, we propose a hybrid model consisting of a classification model followed by a segmentation …
Ultrasound imaging provides information from a large part of the muscle. It has recently been shown that ultrafast ultrasound imaging can be used to record and analyze the mechanical response of individual MUs using blind source separation. In this work, we present an alternative method - a deep learning pipeline - to identify active MUs in ultrasound image sequences, including segmentation of their territories and signal estimation of their mechanical responses (twitch train). We train and evaluate the model using simulated data mimicking the complex activation pattern of tens of activated MU…
The Chinese University of Hong Kong(香港中文大学);University of Cambridge(剑桥大学);Inception Institute of Artificial Intelligence(启迪人工智能研究院);The Hong Kong University of Science and Technology(香港科技大学);Jinan University(暨南大学);Southern University of Science and Technology(南方科技大学);Chinese Academy of Sciences(中国科学院)
Automatic breast lesion segmentation in ultrasound helps to diagnose breast cancer, which is one of the dreadful diseases that affect women globally. Segmenting breast regions accurately from ultrasound image is a challenging task due to the inherent speckle artifacts, blurry breast lesion boundaries, and inhomogeneous intensity distributions inside the breast lesion regions. Recently, convolutional neural networks (CNNs) have demonstrated remarkable results in medical image segmentation tasks. However, the convolutional operations in a CNN often focus on local regions, which suffer from limit…
BAAF: A benchmark attention adaptive framework for medical ultrasound image segmentation tasks
College of Biomedical Engineering and Technology, Tianjin Medical University(天津医科大学生物医学工程学院);College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院);Department of Urology, Fourth Medical Center of PLA General Hospital(中国人民解放军第四医学中心泌尿外科科);Department of Urology, Civil Aviation General Hospital(民航总医院泌尿外科科);College of Artificial Intelligence, Nankai University(南开大学人工智能学院);Department of Ultrasonography, Tianjin Medical University Second Hospital(天津医科大学第二医院超声科)
In this work we propose to segment the prostate on a challenging dataset of trans-rectal ultrasound (TRUS) images using convolutional neural networks (CNNs) and statistical shape models (SSMs). TRUS is commonly used for a number of image-guided interventions on the prostate. Fast and accurate segmentation on the organ in these images is crucial to planning and fusion with other modalities such as magnetic resonance images (MRIs) . However, TRUS has limited soft tissue contrast and signal to noise ratio which makes the task of segmenting the prostate challenging and subject to inter-observer an…
Carotid atherosclerosis is the major cause of ischemic stroke resulting in significant rates of mortality and disability annually. Early diagnosis of such cases is of great importance, since it enables clinicians to apply a more effective treatment strategy. This paper introduces an interpretable classification approach of carotid ultrasound images for the risk assessment and stratification of patients with carotid atheromatous plaque. To address the highly imbalanced distribution of patients between the symptomatic and asymptomatic classes (16 vs 58, respectively), an ensemble learning scheme…
Fudan University(复旦大学);Shanghai Center for Brain Science and Brain-inspired Technology(上海脑科学与类脑研究中心)
The performance of medical image classification has been enhanced by deep convolutional neural networks (CNNs), which are typically trained with cross-entropy (CE) loss. However, when the label presents an intrinsic ordinal property in nature, e.g., the development from benign to malignant tumor, CE loss cannot take into account such ordinal information to allow for better generalization. To improve model generalization with ordinal information, we propose a novel meta ordinal regression forest (MORF) method for medical image classification with ordinal labels, which learns the ordinal relatio…
Intrapartum Ultrasound Image Segmentation of Pubic Symphysis and Fetal Head Using Dual Student-Teacher Framework with CNN-ViT Collaborative Learning
College of Information Science and Technology, Jinan University(暨南大学信息科学技术学院);Guangdong Provincial Key Laboratory of Traditional Chinese Medicine Information Technology, Jinan University(暨南大学广东省中医信息技术重点实验室);Auckland Bioengineering Institute, University of Auckland(奥克兰大学生物工程研究所);Universitat de Barcelona(巴塞罗那大学);Institució Catalana de Recerca i Estudis Avançats (ICREA)(加泰罗尼亚研究与高级研究学院(ICREA))
BioMedIA, Imperial College London(帝国理工学院BioMedIA);HeartFlow;Medical Informatics, University of Luebeck(吕贝克大学医学信息学)
We propose a novel attention gate (AG) model for medical image analysis that automatically learns to focus on target structures of varying shapes and sizes. Models trained with AGs implicitly learn to suppress irrelevant regions in an input image while highlighting salient features useful for a specific task. This enables us to eliminate the necessity of using explicit external tissue/organ localisation modules when using convolutional neural networks (CNNs). AGs can be easily integrated into standard CNN models such as VGG or U-Net architectures with minimal computational overhead while incre…
Santa Clara University(圣克拉拉大学);Harvard Medical School(哈佛医学院);Massachusetts General Hospital(麻省总医院);University of Utah(犹他大学)
Objective: Employing transfer learning (TL) with convolutional neural networks (CNNs), well-trained on non-medical ImageNet dataset, has shown promising results for medical image analysis in recent years. We aimed to conduct a scoping review to identify these studies and summarize their characteristics in terms of the problem description, input, methodology, and outcome. Materials and Methods: To identify relevant studies, MEDLINE, IEEE, and ACM digital library were searched. Two investigators independently reviewed articles to determine eligibility and to extract data according to a study pro…
Korea University(高丽大学);Korea Basic Science Institute(韩国基础科学研究院);Korea Artificial Organ Center(韩国人工器官中心);ICT Convergence Technology for Health and Safety(健康安全信息通信融合技术);Department of Electronics and Information Engineering(电子与信息工程系);Bioimaging Research Team(生物成像研究团队)
Purpose: To acquire the real-time interactive temperature map for aqueous and adipose tissue, the problems of long acquisition and processing time must be addressed. To overcome these major challenges, this paper proposes a cascaded convolutional neural network (CNN) framework and multi-echo gradient echo (meGRE) with a single reference variable flip angle (srVFA). Methods: To optimize the echo times for each method, MR images are acquired using a meGRE sequence; meGRE images with two flip angles (FAs) and meGRE images with a single FA are acquired during the pretreatment and treatment stages,…
University of Bradford(布拉德福德大学);University of Auckland(奥克兰大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
The ReLU activation function (AF) has been extensively applied in deep neural networks, in particular Convolutional Neural Networks (CNN), for image classification despite its unresolved dying ReLU problem, which poses challenges to reliable applications. This issue has obvious important implications for critical applications, such as those in healthcare. Recent approaches are just proposing variations of the activation function within the same unresolved dying ReLU challenge. This contribution reports a different research direction by investigating the development of an innovative quantum app…
Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation
Department of Computing, Abasyn University Islamabad Campus (AUIC)(阿巴斯扬大学伊斯兰堡校区计算机系);School of Computer Science and Informatics, De Montfort University(德蒙福特大学计算机科学与信息学学院);Naif Arab University for Security Sciences(纳夫阿拉伯安全科学大学);School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院);Center of Excellence in Precision Medicine and Digital Health, Chulalongkorn University(朱拉隆功大学精准医学与数字健康卓越中心);School of Biomedical Engineering, UNSW Sydney(新南威尔士大学悉尼分校生物医学工程学院)
Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Learning spatiotemporal features is an important task for efficient video understanding especially in medical images such as echocardiograms. Convolutional neural networks (CNNs) and more recent vision transformers (ViTs) are the most commonly used methods with limitations per each. CNNs are good at capturing local context but fail to learn global information across video frames. On the other hand, vision transformers can incorporate global details and long sequences but are computationally expensive and typically require more data to train. In this paper, we propose a method that addresses th…
HyFormer-Net: A Synergistic CNN-Transformer with Interpretable Multi-Scale Fusion for Breast Lesion Segmentation and Classification in Ultrasound Images
Department of Computer Science and Engineering, Ahsanullah University of Science and Technology(计算机科学与工程系,阿沙努尔大学科学与技术学院)
MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentation
School of Communication and Information Engineering, Shanghai University(上海大学通信与信息工程学院);The SMART (Smart Medicine and AI-based Radiology Technology) Lab, Shanghai Institute for Advanced Communication and Data Science, Shanghai University(上海大学先进通信与数据科学研究院智能医学与AI放射技术实验室);School of Health Science and Engineering, University of Shanghai for Science and Technology(上海科技大学健康科学与工程学院);Department of Pediatric Cardiology, Shanghai Children's Medical Center, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院儿童心脏科部);School of Medical Instruments, Shanghai University of Medicine and Health Sciences(医学仪器学院,上海医学院与健康科学大学)
Diff-CL: A Novel Cross Pseudo-Supervision Method for Semi-supervised Medical Image Segmentation
School of Mathematical Science(数学科学学院);Academy for Multidisciplinary Studies(交叉学科研究院);International Information and Software Institute(国际信息与软件学院);Dalian University of Technology(大连理工大学)
Exploring the Role of Convolutional Neural Networks (CNN) in Dental Radiography Segmentation: A Comprehensive Systematic Literature Review
Research Groups in Intelligent Machines (REGIM Lab), University of Sfax, National Engineering School of Sfax (ENIS)(智能机器研究组(REGIM实验室),斯法克斯大学,斯法克斯国家工程学院)
A Data Augmentation Pipeline to Generate Synthetic Labeled Datasets of 3D Echocardiography Images using a GAN
GE Vingmed Ultrasound - GE Healthcare(GE Vingmed超声 - GE医疗);CARIM School for Cardiovascular Diseases(CARIM心血管疾病学院);Maastricht University Medical Center(马斯特里赫特大学医学中心)
University Hospitals Leuven(鲁汶大学医院);King’s College London(伦敦国王学院);KU Leuven(鲁汶大学);INESC TEC - Institute for Systems and Computer Engineering, Technology and Science(INESC TEC - 系统与计算机工程、技术与科学研究所)
Automatic medical image segmentation via convolutional neural networks (CNNs) has shown promising results. However, they may not always be robust enough for clinical use. Sub-optimal segmentation would require clinician's to manually delineate the target object, causing frustration. To address this problem, a novel interactive CNN-based segmentation framework is proposed in this work. The aim is to represent the CNN segmentation contour as B-splines by utilising B-spline explicit active surfaces (BEAS). The interactive element of the framework allows the user to precisely edit the contour in r…
FEMTO-ST institute(FEMTO-ST研究所);Univ. Bourgogne Franche-Comté(勃艮第-弗朗什-孔泰大学);CNRS(法国国家科学研究中心);ENSMM(国立高等机械与微技术学院);University of Oviedo(奥维耶多大学);Universidad Autonoma del Caribe(加勒比自治大学);Batna University(巴特纳大学);University of Biskra(比斯克拉大学)
Micro Abstract: A recent study from GLOBOCAN disclosed that during 2018 two million women worldwide had been diagnosed from breast cancer. This study presents a computer-aided diagnosis system based on convolutional neural networks as an alternative diagnosis methodology for breast cancer diagnosis with thermal images. Experimental results showed that lower false-positives and false-negatives classification rates are obtained when data pre-processing and data augmentation techniques are implemented in these thermal images. Background: There are many types of breast cancer screening techniques …
University of Sherbrooke(舍布鲁克大学);Univ Lyon(里昂大学);Université Claude Bernard Lyon 1(里昂第一大学);UJM-Saint Etienne(圣艾蒂安大学);CNRS(法国国家科学研究中心);Inserm(法国国家健康与医学研究院);Institut Universitaire de France(法国大学研究院)
Convolutional neural networks (CNN) have demonstrated their ability to segment 2D cardiac ultrasound images. However, despite recent successes according to which the intra-observer variability on end-diastole and end-systole images has been reached, CNNs still struggle to leverage temporal information to provide accurate and temporally consistent segmentation maps across the whole cycle. Such consistency is required to accurately describe the cardiac function, a necessary step in diagnosing many cardiovascular diseases. In this paper, we propose a framework to learn the 2D+time apical long-axi…