Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challenge
Image Sciences Institute, UMC Utrecht, Utrecht University（乌得勒支大学医学中心（UMC Utrecht）影像科学研究所）；Brain Center Rudolf Magnus, UMC Utrecht, Utrecht University（乌得勒支大学医学中心（UMC Utrecht）鲁道夫·马格努斯脑中心）；Department of Radiology, UMC Utrecht, the Netherlands（乌得勒支大学医学中心放射科（荷兰））；Department of Radiology, LUMC, Leiden, the Netherlands（莱顿大学医学中心（LUMC）放射科（荷兰））；Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland（巴塞尔大学生物医学工程系（瑞士奥尔施维尔））；Radiology and Clinical Neuroscience, Hotchkiss Brain Institute, University of Calgary, AB, Canada（卡尔加里大学（加拿大阿尔伯塔省）霍奇基斯脑研究所放射学与临床神经科学部）；NLP Logix；Skolkovo Institute of Science and Technology（斯科尔科沃科学技术研究所）；School of Biomedical Engineering and Im（生物医学工程与...学院（原文未完整显示））
Hugo J. Kuijf, J. Matthijs Biesbroek, Jeroen de Bresser, Rutger Heinen, Simon Andermatt, Mariana Bento, Matt Berseth, Mikhail Belyaev, M. Jorge Cardoso, Adrià C… 展开作者
Hugo J. Kuijf, J. Matthijs Biesbroek, Jeroen de Bresser, Rutger Heinen, Simon Andermatt, Mariana Bento, Matt Berseth, Mikhail Belyaev, M. Jorge Cardoso, Adrià Casamitjana, D. Louis Collins, Mahsa Dadar, Achilleas Georgiou, Mohsen Ghafoorian, Dakai Jin, April Khademi, Jesse Knight, Hongwei Li, Xavier Lladó, Miguel Luna, Qaiser Mahmood, Richard McKinley, Alireza Mehrtash, Sébastien Ourselin, Bo-yong Park, Hyunjin Park, Sang Hyun Park, Simon Pezold, Elodie Puybareau, Leticia Rittner, Carole H. Sudre, Sergi Valverde, Verónica Vilaplana, Roland Wiest, Yongchao Xu, Ziyue Xu, Guodong Zeng, Jianguo Zhang, Guoyan Zheng, Christopher Chen, Wiesje van der Flier, Frederik Barkhof, Max A. Viergever, Geert Jan Biessels
备注：
Accepted for publication in IEEE Transactions on Medical Imaging
Quantification of cerebral white matter hyperintensities (WMH) of presumed vascular origin is of key importance in many neurological research studies. Currently, measurements are often still obtained from manual segmentations on brain MR images, which is a laborious procedure. Automatic WMH segmentation methods exist, but a standardized comparison of the performance of such methods is lacking. We organized a scientific challenge, in which developers could evaluate their method on a standardized multi-center/-scanner image dataset, giving an objective comparison: the WMH Segmentation Challenge (https://wmh.isi.uu.nl/).
Sixty T1+FLAIR images from three MR scanners were released with manual WMH segmentations for training. A test set of 110 images from five MR scanners was used for evaluation. Segmentation methods had to be containerized and submitted to the challenge organizers. Five evaluation metrics were used to rank the methods: (1) Dice similarity coefficient, (2) modified Hausdorff distance (95th percentile), (3) absolute log-transformed volume difference, (4) sensitivity for detecting individual lesions, and (5) F1-score for individual lesions. Additionally, methods were ranked on their inter-scanner robustness.
Twenty participants submitted their method for evaluation. This paper provides a detailed analysis of the results. In brief, there is a cluster of four methods that rank significantly better than the other methods, with one clear winner. The inter-scanner robustness ranking shows that not all methods generalize to unseen scanners.
The challenge remains open for future submissions and provides a public platform for method evaluation.
University of Arizona（亚利桑那大学）；Mallinckrodt Institute of Radiology, Washington University（华盛顿大学马林克罗放射学研究所）；University of Utah（犹他大学）
The relationship between cognition and white matter hyperintensities (WMH) volumes often depends on the accuracy of the lesion segmentation algorithm used. As such, accurate detection and quantification of WMH is of great interest. Here, we use a deep learning-based WMH segmentation algorithm, StackGen-Net, to detect and quantify WMH on 3D FLAIR volumes from ADNI. We used a subset of subjects (n=20) and obtained manual WMH segmentations by an experienced neuro-radiologist to demonstrate the accuracy of our algorithm. On a larger cohort of subjects (n=290), we observed that larger WMH volumes c…
Comparative evaluation of training strategies using partially labelled datasets for segmentation of white matter hyperintensities and stroke lesions in FLAIR MRI
Sun Yat-sen University（中山大学）；University of Dundee（邓迪大学）；Technical University of Munich（慕尼黑工业大学）
White matter hyperintensities (WMH) are commonly found in the brains of healthy elderly individuals and have been associated with various neurological and geriatric disorders. In this paper, we present a study using deep fully convolutional network and ensemble models to automatically detect such WMH using fluid attenuation inversion recovery (FLAIR) and T1 magnetic resonance (MR) scans. The algorithm was evaluated and ranked 1 st in the WMH Segmentation Challenge at MICCAI 2017. In the evaluation stage, the implementation of the algorithm was submitted to the challenge organizers, who then in…
Erasmus MC（伊拉斯谟医学中心）；Delft University of Technology（代尔夫特理工大学）；University of Copenhagen（哥本哈根大学）
To measure the volume of specific image structures, a typical approach is to first segment those structures using a neural network trained on voxel-wise (strong) labels and subsequently compute the volume from the segmentation. A more straightforward approach would be to predict the volume directly using a neural network based regression approach, trained on image-level (weak) labels indicating volume. In this article, we compared networks optimized with weak and strong labels, and study their ability to generalize to other datasets. We experimented with white matter hyperintensity (WMH) volum…
P-Count: Persistence-based Counting of White Matter Hyperintensities in Brain MRI
Martinos Center for Biomedical Imaging, MGH and Harvard Medical School（马蒂诺斯生物医学成像中心，麻省总医院与哈佛医学院）；Center for Medical Image Computing, University College London（伦敦大学学院医学影像计算中心）；Amsterdam University Medical Center（阿姆斯特丹大学医学中心）；Danish Research Centre for Magnetic Resonance, Copenhagen University Hospital（哥本哈根大学医院丹麦磁共振研究中心）；Computer Science and Artificial Intelligence Laboratory, MIT（麻省理工学院计算机科学与人工智能实验室）
Segmenting white matter hyperintensities on isotropic three-dimensional Fluid Attenuated Inversion Recovery magnetic resonance images: Assessing deep learning tools on norwegian imaging database
University of Oslo（奥斯陆大学）；Akershus University Hospital（阿克什胡斯大学医院）；University of Toronto（多伦多大学）；Sunnybrook Research Institute（桑尼布鲁克研究所）；Vestfold Hospital Trust（西福尔医院信托）
National Institute of Allergy and Infectious Diseases（美国国家过敏和传染病研究所）
Segmentation and quantification of white matter hyperintensities (WMHs) are of great importance in studying and understanding various neurological and geriatric disorders. Although automatic methods have been proposed for WMH segmentation on magnetic resonance imaging (MRI), manual corrections are often necessary to achieve clinically practical results. Major challenges for WMH segmentation stem from their inhomogeneous MRI intensities, random location and size distributions, and MRI noise. The presence of other brain anatomies or diseases with enhanced intensities adds further difficulties. T…
Technical University of Munich（慕尼黑工业大学）；Klinikum rechts der Isar（伊萨尔河畔临床医院）；University of Dundee（邓迪大学）
Segmentation of both large and small white matter hyperintensities/lesions in brain MR images is a challenging task which has drawn much attention in recent years. We propose a multi-scale aggregation model framework to deal with volume-varied lesions. Firstly, we present a specifically-designed network for small lesion segmentation called Stack-Net, in which multiple convolutional layers are connected, aiming to preserve rich local spatial information of small lesions before the sub-sampling layer. Secondly, we aggregate multi-scale Stack-Nets with different receptive fields to learn multi-sc…
White Matter Hyperintensities (WMH) are the most common manifestation of cerebral small vessel disease (cSVD) on the brain MRI. Accurate WMH segmentation algorithms are important to determine cSVD burden and its clinical consequences. Most of existing WMH segmentation algorithms require both fluid attenuated inversion recovery (FLAIR) images and T1-weighted images as inputs. However, T1-weighted images are typically not part of standard clinicalscans which are acquired for patients with acute stroke. In this paper, we propose a novel brain atlas guided attention U-Net (BAGAU-Net) that leverage…
Ohio University（俄亥俄大学）；University of Kentucky（肯塔基大学）
In this paper, we develop a two-stage neural network solution for the challenging task of white-matter lesion segmentation. To cope with the vast vari- ability in lesion sizes, we sample brain MR scans with patches at three differ- ent dimensions and feed them into separate fully convolutional neural networks (FCNs). In the second stage, we process large and small lesion separately, and use ensemble-nets to combine the segmentation results generated from the FCNs. A novel activation function is adopted in the ensemble-nets to improve the segmen- tation accuracy measured by Dice Similarity Coef…
AICURA medical（AICURA医疗公司）；University of Edinburgh（爱丁堡大学）；Technische Universität Dresden（德累斯顿工业大学）；Max Planck Institute for Human Cognitive and Brain Sciences（马克斯·普朗克人类认知与脑科学研究所）；National Center of Tumor Diseases (NCT) Partner Site Dresden（国家肿瘤疾病中心德累斯顿分中心）；Center for Scalable Data Analytics and Artificial Intelligence ScaDS.AI（可扩展数据分析与人工智能中心ScaDS.AI）
Machine learning algorithms underpin modern diagnostic-aiding software, which has proved valuable in clinical practice, particularly in radiology. However, inaccuracies, mainly due to the limited availability of clinical samples for training these algorithms, hamper their wider applicability, acceptance, and recognition amongst clinicians. We present an analysis of state-of-the-art automatic quality control (QC) approaches that can be implemented within these algorithms to estimate the certainty of their outputs. We validated the most promising approaches on a brain image segmentation task ide…
Universidad Técnica Particular de Loja（洛哈技术大学）；University of Waterloo（滑铁卢大学）；Universitat Politècnica de València（瓦伦西亚理工大学）；Consejo Superior de Investigaciones Científicas (CSIC)（西班牙国家研究委员会）
Medical brain image analysis is a necessary step in Computer Assisted /Aided Diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of White Matter Hyperintensities (WMHs) of brain MRI images specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used the bibliometric networks. Out of a total of 140 do…
