Z-disks are complex structures that delineate repeating sarcomeres in striated muscle. They play significant roles in cardiomyocytes such as providing mechanical stability for the contracting sarcomere, cell signalling and autophagy. Changes in Z-disk architecture have been associated with impaired cardiac function. Hence, there is a strong need to create tools to segment Z-disks from microscopy images, that overcome traditional limitations such as variability in image brightness and staining technique. In this study, we apply deep learning based segmentation models to extract Z-disks in images of striated muscle tissue. We leverage a novel Airyscan confocal dataset, which comprises high resolution images of Z-disks of healthy heart tissue, stained with Affimers for specific Z-disk proteins. We employed an interactive labelling tool, Ilastik to obtain ground truth segmentation masks and use the resulting data set to train and evaluate the performance of several state-of-the-art segmentation networks. On the test set, UNet++ achieves best segmentation performance for Z-disks in cardiomyocytes, with an average Dice score of 0.91 and outperforms other established segmentation methods including UNet, FPN, DeepLabv3+ and pix2pix. However, pix2pix demonstrates improved generalisation, when tested on an additional dataset of cardiomyocytes with a titin mutation. This is the first study to demonstrate that automated machine learning-based segmentation approaches may be used effectively to segment Z-disks in confocal microscopy images. Automated segmentation approaches and predicted segmentation masks could be used to derive morphological features of Z-disks (e.g. width and orientation), and subsequently, to quantify disease-related changes to cardiac microstructure.
An Improved Approach for Cardiac MRI Segmentation based on 3D UNet Combined with Papillary Muscle Exclusion
Higher Institute of Medical Technologies of Tunis(突尼斯高等医疗技术学院);University of Tunis El Manar(突尼斯埃尔马纳尔大学);Faculty of Medicine of Monastir(莫纳斯提尔医学院);University of Monastir(莫纳斯提尔大学);Artificial Intelligence Research Centre, Ajman University(阿治曼大学人工智能研究中心);Ajman University(阿治曼大学);National Engineering School of Tunis(突尼斯国立工程师学院);IPEIEM(突尼斯高等预科工程与技术学院(IPEIEM))
Isfahan University of Technology(伊斯法罕理工大学);University of Michigan(密歇根大学)
Medical image analysis, especially segmenting a specific organ, has an important role in developing clinical decision support systems. In cardiac magnetic resonance (MR) imaging, segmenting the left and right ventricles helps physicians diagnose different heart abnormalities. There are challenges for this task, including the intensity and shape similarity between left ventricle and other organs, inaccurate boundaries and presence of noise in most of the images. In this paper we propose an automated method for segmenting the left ventricle in cardiac MR images. We first automatically extract th…
Assessing the structure and function of the right ventricle (RV) is important in the diagnosis of several cardiac pathologies. However, it remains more challenging to segment the RV than the left ventricle (LV). In this paper, we focus on segmenting the RV in both short (SA) and long-axis (LA) cardiac MR images simultaneously. For this task, we propose a new multi-input/output architecture, hybrid 2D/3D geometric spatial TransformEr Multi-Pass fEature pyRAmid (Tempera). Our feature pyramid extends current designs by allowing not only a multi-scale feature output but multi-scale SA and LA input…
Imperial College London(帝国理工学院);Royal Brompton Hospital(皇家布朗普顿医院)
Segmentation of cardiac fibrosis and scar are essential for clinical diagnosis and can provide invaluable guidance for the treatment of cardiac diseases. Late Gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR) has been successful for its efficacy in guiding the clinical diagnosis and treatment reliably. For LGE CMR, many methods have demonstrated success in accurately segmenting scarring regions. Co-registration with other non-contrast-agent (non-CA) modalities, balanced steady-state free precession (bSSFP) and cine magnetic resonance imaging (MRI) for example, can further en…
Insight Centre for Data Analytics, Dublin City University(都柏林城市大学数据洞察中心);Sports Medicine Department, Sports Surgery Clinic(运动外科诊所运动医学部);School of Health and Human Performance, Dublin City University(都柏林城市大学健康与人体运动学院)
In this paper we present an interactive tool that can be used to quantify fat infiltration in lumbar muscles, which is useful in studying fat infiltration and lower back pain (LBP) in adults. Currently, a qualitative assessment by visual grading via a 5-point scale is used to study fat infiltration in lumbar muscles from an axial view of lumbar-spine MR Images. However, a quantitative approach (on a continuous scale of 0-100\%) may provide a greater insight. In this paper, we propose a method to precisely quantify the fat deposition / infiltration in a user-defined region of the lumbar muscles…
In this study, segmentation of quadriceps muscle heads of ultra-endurance athletes was done using a multi-atlas segmentation and corrective leaning framework where the registration based multi-atlas segmentation step was replaced with weakly supervised U-Net. For the case with remarkably different morphology, our method produced improved accuracy, while reduced significantly the computation time.
University of Pittsburgh School of Medicine(匹兹堡大学医学院);VA Pittsburgh Healthcare System(匹兹堡退伍军人医疗系统)
Purpose: To develop and validate a computer tool for automatic and simultaneous segmentation of body composition depicted on computed tomography (CT) scans for the following tissues: visceral adipose (VAT), subcutaneous adipose (SAT), intermuscular adipose (IMAT), skeletal muscle (SM), and bone. Approach: A cohort of 100 CT scans acquired from The Cancer Imaging Archive (TCIA) was used - 50 whole-body positron emission tomography (PET)-CTs, 25 chest, and 25 abdominal. Five different body compositions were manually annotated (VAT, SAT, IMAT, SM, and bone). A training-while-annotating strategy w…
Muscle volume quantification: guiding transformers with anatomical priors
Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);Technical University of Munich (TUM)(慕尼黑工业大学);INSEP(法国国家体育学院);Fédération Française de Badminton(法国羽毛球联合会)
Automatic Left Ventricular Cavity Segmentation via Deep Spatial Sequential Network in 4D Computed Tomography Studies
School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);School of Computer Science, University of Sydney(悉尼大学计算机学院);Ruijin Hospital, Shanghai Jiaotong University School of Medicine(上海交通大学医学院附属瑞金医院)
Latents of latents to delineate pixels: hybrid Matryoshka autoencoder-to-U-Net pairing for segmenting large medical images in GPU-poor and low-data regimes
School of Mathematics and Computer Science, Institute of Business Administration(商业管理学院数学与计算机科学学院)
CineMyoPS: Segmenting Myocardial Pathologies from Cine Cardiac MR
School of Medical Imaging, Fujian Medical University(福建医科大学医学影像学院);College of Physics and Information Engineering, Fuzhou University(福州大学物理与信息工程学院);Department of Biomedical Engineering, National University of Singapore(新加坡国立大学生物医学工程系);School of Data Science, Fudan University(复旦大学数据科学学院);Department of Radiology, Renji Hospital, School of Medicine, Shanghai Jiao Tong University(上海交通大学医学院仁济医院放射科)
University Medical Center Utrecht(乌得勒支大学医学中心);Eindhoven University of Technology(埃因霍温理工大学)
Automatic segmentation of medical images is an important task for many clinical applications. In practice, a wide range of anatomical structures are visualised using different imaging modalities. In this paper, we investigate whether a single convolutional neural network (CNN) can be trained to perform different segmentation tasks. A single CNN is trained to segment six tissues in MR brain images, the pectoral muscle in MR breast images, and the coronary arteries in cardiac CTA. The CNN therefore learns to identify the imaging modality, the visualised anatomical structures, and the tissue clas…
ScarNet: A Novel Foundation Model for Automated Myocardial Scar Quantification from LGE in Cardiac MRI
Northwestern University(西北大学);Feinberg School of Medicine(费林伯格医学院);University of Miami Miller School of Medicine(迈阿密大学米勒医学院);Cedars-Sinai Medical Center(西达赛奈医疗中心)
Peking University(北京大学);Peking University First Hospital(北京大学第一医院);MGH/BWH Center for Clinical Data Science(麻省总医院/布莱根妇女医院临床数据科学中心)
Segmenting coronary arteries is challenging, as classic unsupervised methods fail to produce satisfactory results and modern supervised learning (deep learning) requires manual annotation which is often time-consuming and can some time be infeasible. To solve this problem, we propose a knowledge transfer based shape-consistent generative adversarial network (SC-GAN), which is an annotation-free approach that uses the knowledge from publicly available annotated fundus dataset to segment coronary arteries. The proposed network is trained in an end-to-end fashion, generating and segmenting synthe…
Multi-view Hybrid Graph Convolutional Network for Volume-to-mesh Reconstruction in Cardiovascular MRI
Institute for Signals, Systems, and Computational Intelligence, sinc(i) CONICET-UNL(信号、系统与计算智能研究所,sinc(i) CONICET-UNL);Centre for Computational Imaging and Simulation Technologies in Biomedicine (CISTIB), School of Computing, University of Leeds(生物医学计算成像与模拟技术中心(CISTIB),计算学院,莱斯特大学);Christabel Pankhurst Institute, The University of Manchester(克里斯特贝尔·潘克赫斯特研究所,曼彻斯特大学);Centre for Computational Imaging and Modelling in Medicine (CIMIM), Department of Computer Science, School of Engineering, and Division of Informatics Imaging and Data Science, School of Health Sciences, The University of Manchester(医学计算成像与建模中心(CIMIM),计算机科学系,工程学院,信息学成像与数据科学系,健康科学学院,曼彻斯特大学);Medical Imaging Research Centre (MIRC), Department of Cardiovascular Sciences, KU Leuven(医学影像研究中心(MIRC),心血管科学系,鲁汶大学)
Segmenting human left ventricle (LV) in magnetic resonance imaging (MRI) images and calculating its volume are important for diagnosing cardiac diseases. In 2016, Kaggle organized a competition to estimate the volume of LV from MRI images. The dataset consisted of a large number of cases, but only provided systole and diastole volumes as labels. We designed a system based on neural networks to solve this problem. It began with a detector combined with a neural network classifier for detecting regions of interest (ROIs) containing LV chambers. Then a deep neural network named hypercolumns fully…
Istanbul Technical University(伊斯坦布尔理工大学);King’s College London(伦敦国王学院)
Segmenting anatomical structures in medical images has been successfully addressed with deep learning methods for a range of applications. However, this success is heavily dependent on the quality of the image that is being segmented. A commonly neglected point in the medical image analysis community is the vast amount of clinical images that have severe image artefacts due to organ motion, movement of the patient and/or image acquisition related issues. In this paper, we discuss the implications of image motion artefacts on cardiac MR segmentation and compare a variety of approaches for joint…
Auckland Bioengineering Institute, University of Auckland(奥克兰大学生物工程研究所);Beihang University(北京航空航天大学);Peking University(北京大学);SenseTime Inc(商汤科技);Tencent Jarvis Laboratory(腾讯Jarvis实验室);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学);The Chinese University of Hong Kong(香港中文大学);Shenzhen University(深圳大学);Wuhan University(武汉大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);EPITA Research and Development Laboratory(EPITA研发实验室);Imperial College London(伦敦帝国学院);Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学);Harbin Institute of Technology(哈尔滨工业大学);University of Bologna(博洛尼亚大学);Eindhoven University of Technology(埃因霍温理工大学);Kings College London(伦敦国王学院);University of Magdeburg(马格德堡大学);Heidelberg University Hospital(海德堡大学医院);Leiden University Medical Center(莱顿大学医学中心);Universitat Pompeu Fabra(庞培法布拉大学);Physense(Physense机构)
Segmentation of cardiac images, particularly late gadolinium-enhanced magnetic resonance imaging (LGE-MRI) widely used for visualizing diseased cardiac structures, is a crucial first step for clinical diagnosis and treatment. However, direct segmentation of LGE-MRIs is challenging due to its attenuated contrast. Since most clinical studies have relied on manual and labor-intensive approaches, automatic methods are of high interest, particularly optimized machine learning approaches. To address this, we organized the "2018 Left Atrium Segmentation Challenge" using 154 3D LGE-MRIs, currently the…
Rutgers University(罗格斯大学);SenseBrain Research(SenseBrain研究院);University of Arkansas for Medical Sciences(阿肯色大学医学院);Lund University(隆德大学);New York University(纽约大学)
Joint 2D cardiac segmentation and 3D volume reconstruction are fundamental to building statistical cardiac anatomy models and understanding functional mechanisms from motion patterns. However, due to the low through-plane resolution of cine MR and high inter-subject variance, accurately segmenting cardiac images and reconstructing the 3D volume are challenging. In this study, we propose an end-to-end latent-space-based framework, DeepRecon, that generates multiple clinically essential outcomes, including accurate image segmentation, synthetic high-resolution 3D image, and 3D reconstructed volu…
The inverse mechano-electrical problem in cardiac electrophysiology is the attempt to reconstruct electrical excitation or action potential wave patterns from the heart's mechanical deformation that occurs in response to electrical excitation. Because heart muscle cells contract upon electrical excitation due to the excitation-contraction coupling mechanism, the resulting deformation of the heart should reflect macroscopic action potential wave phenomena. However, whether the relationship between macroscopic electrical and mechanical phenomena is well-defined and furthermore unique enough to b…
In this work, we develop a neural network-based method to convert a noisy motion signal generated from segmenting rebinned list-mode cardiac SPECT images, to that of a high-quality surrogate signal, such as those seen from external motion tracking systems (EMTs). This synthetic surrogate will be used as input to our pre-existing motion correction technique developed for EMT surrogate signals. In our method, we test two families of neural networks to translate noisy internal motion to external surrogate: 1) fully connected networks and 2) convolutional neural networks. Our dataset consists of c…
University of Notre Dame(圣母大学);Guangdong Provincial People’s Hospital(广东省人民医院);Zhejiang University(浙江大学);University of New Mexico(新墨西哥大学)
Accurately segmenting temporal frames of cine magnetic resonance imaging (MRI) is a crucial step in various real-time MRI guided cardiac interventions. To achieve fast and accurate visual assistance, there are strict requirements on the maximum latency and minimum throughput of the segmentation framework. State-of-the-art neural networks on this task are mostly hand-crafted to satisfy these constraints while achieving high accuracy. On the other hand, while existing literature have demonstrated the power of neural architecture search (NAS) in automatically identifying the best neural architect…
King’s College London(伦敦国王学院);Guy’s and St Thomas’ NHS Foundation Trust(盖伊和圣托马斯国民保健基金会信托);University Medical Center Utrecht(乌得勒支大学医学中心)
Current artificial intelligence (AI) algorithms for short-axis cardiac magnetic resonance (CMR) segmentation achieve human performance for slices situated in the middle of the heart. However, an often-overlooked fact is that segmentation of the basal and apical slices is more difficult. During manual analysis, differences in the basal segmentations have been reported as one of the major sources of disagreement in human interobserver variability. In this work, we aim to investigate the performance of AI algorithms in segmenting basal and apical slices and design strategies to improve their segm…
Body tissue composition is a long-known biomarker with high diagnostic and prognostic value in cardiovascular, oncological and orthopaedic diseases, but also in rehabilitation medicine or drug dosage. In this study, the aim was to develop a fully automated, reproducible and quantitative 3D volumetry of body tissue composition from standard CT examinations of the abdomen in order to be able to offer such valuable biomarkers as part of routine clinical imaging. Therefore an in-house dataset of 40 CTs for training and 10 CTs for testing were fully annotated on every fifth axial slice with five di…
Cardiovascular Research Institute, University of California, San Francisco(加州大学旧金山分校心血管研究所);Yale School of Medicine, Yale University(耶鲁大学耶鲁医学院);School of Physics, Georgia Institute of Technology(佐治亚理工学院物理学院)
The analysis of electrical impulse phenomena in cardiac muscle tissue is important for the diagnosis of heart rhythm disorders and other cardiac pathophysiology. Cardiac mapping techniques acquire local temporal measurements and combine them to visualize the spread of electrophysiological wave phenomena across the heart surface. However, low spatial resolution, sparse measurement locations, noise and other artifacts make it challenging to accurately visualize spatio-temporal activity. For instance, electro-anatomical catheter mapping is severely limited by the sparsity of the measurements, and…
The University of Winnipeg(温尼伯大学);Qatar University(卡塔尔大学);Hamad Medical Corporation(哈马德医疗公司)
Cardiac imaging known as echocardiography is a non-invasive tool utilized to produce data including images and videos, which cardiologists use to diagnose cardiac abnormalities in general and myocardial infarction (MI) in particular. Echocardiography machines can deliver abundant amounts of data that need to be quickly analyzed by cardiologists to help them make a diagnosis and treat cardiac conditions. However, the acquired data quality varies depending on the acquisition conditions and the patient's responsiveness to the setup instructions. These constraints are challenging to doctors especi…
Imperial College London(帝国理工学院);University College London(伦敦大学学院);Barts Heart Centre, St Bartholomew’s Hospital(巴茨心脏中心,圣巴塞洛缪医院);Queen Mary University of London(伦敦玛丽女王大学)
Convolutional neural network (CNN) based segmentation methods provide an efficient and automated way for clinicians to assess the structure and function of the heart in cardiac MR images. While CNNs can generally perform the segmentation tasks with high accuracy when training and test images come from the same domain (e.g. same scanner or site), their performance often degrades dramatically on images from different scanners or clinical sites. We propose a simple yet effective way for improving the network generalization ability by carefully designing data normalization and augmentation strateg…
We introduce a method for training neural networks to perform image or volume segmentation in which prior knowledge about the topology of the segmented object can be explicitly provided and then incorporated into the training process. By using the differentiable properties of persistent homology, a concept used in topological data analysis, we can specify the desired topology of segmented objects in terms of their Betti numbers and then drive the proposed segmentations to contain the specified topological features. Importantly this process does not require any ground-truth labels, just prior k…
Salzburg University of Applied Sciences(萨尔茨堡应用科学大学);RWTH Aachen University(亚琛工业大学);University Hospital Aachen(亚琛大学医院)
Generative adversarial networks using a cycle-consistency loss facilitate unpaired training of image-translation models and thereby exhibit a very high potential in manifold medical applications. However, the fact that images in one domain potentially map to more than one image in another domain (e.g. in case of pathological changes) exhibits a major challenge for training the networks. In this work, we offer a solution to improve the training process in case of many-to-one mappings by modifying the cycle-consistency loss. We show formally and empirically that the proposed method improves the …
Delineation of the cardiac structures from 2D echocardiographic images is a common clinical task to establish a diagnosis. Over the past decades, the automation of this task has been the subject of intense research. In this paper, we evaluate how far the state-of-the-art encoder-decoder deep convolutional neural network methods can go at assessing 2D echocardiographic images, i.e segmenting cardiac structures as well as estimating clinical indices, on a dataset especially designed to answer this objective. We therefore introduce the Cardiac Acquisitions for Multi-structure Ultrasound Segmentat…
Integrating Deep Learning in Cardiology: A Comprehensive Review of Atrial Fibrillation, Left Atrial Scar Segmentation, and the Frontiers of State-of-the-Art Techniques
University of Auckland(奥克兰大学);Auckland Bioengineering Institute(奥克兰生物工程研究所)
University of Central Florida(中佛罗里达大学);Nvidia(英伟达);Ege University(爱琴海大学);Johns Hopkins University(约翰斯·霍普金斯大学)
Our work expands the use of capsule networks to the task of object segmentation for the first time in the literature. This is made possible via the introduction of locally-constrained routing and transformation matrix sharing, which reduces the parameter/memory burden and allows for the segmentation of objects at large resolutions. To compensate for the loss of global information in constraining the routing, we propose the concept of "deconvolutional" capsules to create a deep encoder-decoder style network, called SegCaps. We extend the masked reconstruction regularization to the task of segme…
Anhui University(安徽大学);Royal Brompton Hospital(皇家布朗普顿医院);National Heart & Lung Institute, Imperial College London(帝国理工学院国家心肺研究所);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University College London(伦敦大学学院);Alan Turing Institute(艾伦·图灵研究所);Imperial College London(帝国理工学院)
Late Gadolinium Enhanced Cardiac MRI (LGE-CMRI) for detecting atrial scars in atrial fibrillation (AF) patients has recently emerged as a promising technique to stratify patients, guide ablation therapy and predict treatment success. Visualisation and quantification of scar tissues require a segmentation of both the left atrium (LA) and the high intensity scar regions from LGE-CMRI images. These two segmentation tasks are challenging due to the cancelling of healthy tissue signal, low signal-to-noise ratio and often limited image quality in these patients. Most approaches require manual superv…
Sun Yat-sen University(中山大学);Royal Brompton Hospital(皇家布朗普顿医院);Imperial College London(帝国理工学院)
Automated and accurate segmentations of left atrium (LA) and atrial scars from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images are in high demand for quantifying atrial scars. The previous quantification of atrial scars relies on a two-phase segmentation for LA and atrial scars due to their large volume difference (unbalanced atrial targets). In this paper, we propose an inter-cascade generative adversarial network, namely JAS-GAN, to segment the unbalanced atrial targets from LGE CMR images automatically and accurately in an end-to-end way. Firstly, JAS-GAN investigates a…
A Semi-Supervised Approach with Error Reflection for Echocardiography Segmentation
Shanghai University(上海大学);Shanghai Institute for Advanced Communication and Data Science(上海先进通信与数据科学研究院);Shanghai Jiao Tong University(上海交通大学);East China Normal University(华东师范大学)