The midline related pathological image features are crucial for evaluating the severity of brain compression caused by stroke or traumatic brain injury (TBI). The automated midline delineation not only improves the assessment and clinical decision making for patients with stroke symptoms or head trauma but also reduces the time of diagnosis. Nevertheless, most of the previous methods model the midline by localizing the anatomical points, which are hard to detect or even missing in severe cases. In this paper, we formulate the brain midline delineation as a segmentation task and propose a three-stage framework. The proposed framework firstly aligns an input CT image into the standard space. Then, the aligned image is processed by a midline detection network (MD-Net) integrated with the CoordConv Layer and Cascade AtrousCconv Module to obtain the probability map. Finally, we formulate the optimal midline selection as a pathfinding problem to solve the problem of the discontinuity of midline delineation. Experimental results show that our proposed framework can achieve superior performance on one in-house dataset and one public dataset.
Skolkovo Institute of Science and Technology（斯科尔科沃科学技术研究院）；Kharkevich Institute for Information Transmission Problems（哈尔克维奇信息传输问题研究所）；Moscow Institute of Physics and Technology（莫斯科物理技术学院）；Center for Diagnostics and Telemedicine（诊断与远程医疗中心）；Burdenko Neurosurgery Institute（布尔坚科神经外科研究所）
Midline shift (MLS) is a well-established factor used for outcome prediction in traumatic brain injury, stroke and brain tumors. The importance of automatic estimation of MLS was recently highlighted by ACR Data Science Institute. In this paper we introduce a novel deep learning based approach for the problem of MLS detection, which exploits task-specific structural knowledge. We evaluate our method on a large dataset containing heterogeneous images with significant MLS and show that its mean error approaches the inter-expert variability. Finally, we show the robustness of our approach by vali…
University of Isfahan（伊斯法罕大学）；Geneva University Hospital（日内瓦大学医院）
Brain tumor segmentation is highly contributive in diagnosing and treatment planning. The manual brain tumor delineation is a time-consuming and tedious task and varies depending on the radiologists skill. Automated brain tumor segmentation is of high importance, and does not depend on either inter or intra-observation. The objective of this study is to automate the delineation of brain tumors from the FLAIR, T1 weighted, T2 weighted, and T1 weighted contrast-enhanced MR sequences through a deep learning approach, with a focus on determining which MR sequence alone or which combination thereof…
Detailed delineation of the fetal brain in diffusion MRI via multi-task learning
Harvard Medical School（哈佛医学院）；Elmhurst Hospital Center（埃尔姆赫斯特医院中心）；Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院）；Massachusetts General Hospital（麻省总医院）；University of California Irvine（加州大学欧文分校）
Massachusetts General Hospital（麻省总医院）；Massachusetts Institute of Technology（麻省理工学院）；National Taiwan University Hospital（台湾大学医院）；Vysioneer Inc.（Vysioneer公司）
Stereotactic radiosurgery (SRS), which delivers high doses of irradiation in a single or few shots to small targets, has been a standard of care for brain metastases. While very effective, SRS currently requires manually intensive delineation of tumors. In this work, we present a deep learning approach for automated detection and segmentation of brain metastases using multimodal imaging and ensemble neural networks. In order to address small and multiple brain metastases, we further propose a volume-aware Dice loss which optimizes model performance using the information of lesion size. This wo…
TU Munich（慕尼黑工业大学）；Klinikum rechts der Isar（伊萨尔河右岸医院）；ETH Zurich（苏黎世联邦理工学院）；Johns Hopkins University（约翰斯·霍普金斯大学）
Brain pathologies can vary greatly in size and shape, ranging from few pixels (i.e. MS lesions) to large, space-occupying tumors. Recently proposed Autoencoder-based methods for unsupervised anomaly segmentation in brain MRI have shown promising performance, but face difficulties in modeling distributions with high fidelity, which is crucial for accurate delineation of particularly small lesions. Here, similar to these previous works, we model the distribution of healthy brain MRI to localize pathologies from erroneous reconstructions. However, to achieve improved reconstruction fidelity at hi…
University of Electronic Science and Technology of China（电子科技大学）；Shanghai AI Laboratory（上海人工智能实验室）；Sichuan Cancer Hospital and Institute（四川省肿瘤医院研究所）；Sichuan University West China Hospital（四川大学华西医院）；SenseTime Research（商汤科技研究院）
Accurate segmentation of Anatomical brain Barriers to Cancer spread (ABCs) plays an important role for automatic delineation of Clinical Target Volume (CTV) of brain tumors in radiotherapy. Despite that variants of U-Net are state-of-the-art segmentation models, they have limited performance when dealing with ABCs structures with various shapes and sizes, especially thin structures (e.g., the falx cerebri) that span only few slices. To deal with this problem, we propose a High and Multi-Resolution Network (HMRNet) that consists of a multi-scale feature learning branch and a high-resolution bra…
University of Leicester（莱斯特大学）；University of Lancaster（兰卡斯特大学）；Queen Mary, University of London（伦敦大学玛丽女王学院）；Xidian University（西安电子科技大学）；Bielefeld University（比勒费尔德大学）
Brain tumor segmentation is one of the most challenging problems in medical image analysis. The goal of brain tumor segmentation is to generate accurate delineation of brain tumor regions. In recent years, deep learning methods have shown promising performance in solving various computer vision problems, such as image classification, object detection and semantic segmentation. A number of deep learning based methods have been applied to brain tumor segmentation and achieved promising results. Considering the remarkable breakthroughs made by state-of-the-art technologies, we use this survey to …
Skolkovo Institute of Science and Technology（斯科尔科沃科学技术学院）；Kharkevich Institute for Information Transmission Problems（哈尔克维奇信息传输问题研究所）；Moscow Institute of Physics and Technology（莫斯科物理技术学院）；Moscow Gamma-Knife Center（莫斯科伽马刀中心）；Burdenko Neurosurgery Institute（布尔坚科神经外科研究所）
Stereotactic radiosurgery is a minimally-invasive treatment option for a large number of patients with intracranial tumors. As part of the therapy treatment, accurate delineation of brain tumors is of great importance. However, slice-by-slice manual segmentation on T1c MRI could be time-consuming (especially for multiple metastases) and subjective. In our work, we compared several deep convolutional networks architectures and training procedures and evaluated the best model in a radiation therapy department for three types of brain tumors: meningiomas, schwannomas and multiple brain metastases…
College of Physics and Information Engineering, Fuzhou University（福州大学物理与信息工程学院）；School of Data Science, Fudan University（复旦大学数据科学学院）；School of Biomedical Engineering, Shanghai Jiao Tong University（上海交通大学生物医学工程学院）；School of Biomedical Engineering and Imaging Sciences, King’s College London（伦敦国王学院生物医学工程与成像科学学院）
Delineating the brain tumor from magnetic resonance (MR) images is critical for the treatment of gliomas. However, automatic delineation is challenging due to the complex appearance and ambiguous outlines of tumors. Considering that multi-modal MR images can reflect different tumor biological properties, we develop a novel multi-modal tumor segmentation network (MMTSN) to robustly segment brain tumors based on multi-modal MR images. The MMTSN is composed of three sub-branches and a main branch. Specifically, the sub-branches are used to capture different tumor features from multi-modal images,…
LoCI-DiffCom: Longitudinal Consistency-Informed Diffusion Model for 3D Infant Brain Image Completion
School of Biomedical Engineering, ShanghaiTech University（上海科技大学生物医学工程学院）；Shanghai United Imaging Intelligence Co., Ltd（上海联影智能医疗科技有限公司）；Shanghai Clinical Research and Trail Center（上海临床研究中心）
University of Iceland（冰岛大学）；Landspitali - University Hospital（兰斯皮塔利大学医院）；The Icelandic Heart Association（冰岛心脏协会）；The Johns Hopkins University（约翰斯·霍普金斯大学）
Lesions that appear hyperintense in both Fluid Attenuated Inversion Recovery (FLAIR) and T2-weighted magnetic resonance images (MRIs) of the human brain are common in the brains of the elderly population and may be caused by ischemia or demyelination. Lesions are biomarkers for various neurodegenerative diseases, making accurate quantification of them important for both disease diagnosis and progression. Automatic lesion detection using supervised learning requires manually annotated images, which can often be impractical to acquire. Unsupervised lesion detection, on the other hand, does not r…
Spatio-spectral classification of hyperspectral images for brain cancer detection during surgical operations
University of Las Palmas de Gran Canaria（大加那利岛拉斯帕尔马斯大学）；Imperial College London（伦敦帝国理工学院）；University Hospital Doctor Negrin（内格林大学医院）；University Hospital Southampton（南安普顿大学医院）；University of Cambridge（剑桥大学）；Universidad Politecnica de Madrid（马德里理工大学）
In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection
University of Las Palmas de Gran Canaria（大加那利岛拉斯帕尔马斯大学）；University Hospital Doctor Negrin（内格林大学医院）；University Hospital Southampton（南安普顿大学医院）；Addenbrookes Hospital（阿登布鲁克医院）；University of Cambridge（剑桥大学）；AKKA Technologies（AKKA Technologies公司）；Imperial College London（伦敦帝国理工学院）；Universidad Politécnica de Madrid（马德里理工大学）；Ecole Nationale Supérieure des Mines de Paris（巴黎高等矿业学校）；MINES ParisTech（巴黎矿业学院）
AutoRG-Brain: Grounded Report Generation for Brain MRI
University of Science and Technology of China（中国科学技术大学）；Shanghai AI Laboratory（上海人工智能实验室）；Shanghai Jiao Tong University（上海交通大学）；Shanghai Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University（上海交通大学附属第六人民医院）
Instituto de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València（瓦伦西亚理工大学先进信息技术与通信应用研究所 (ITACA)）；CNRS（法国国家科学研究中心）；Univ. Bordeaux（波尔多大学）；Bordeaux INP（波尔多国立高等工程技术学校）；Universitat de Valencia（瓦伦西亚大学）；University Valencia（瓦伦西亚大学）；EPHE（巴黎高等研究实践学院）；CHU de Bordeaux（波尔多大学医院中心）；Institut des Maladies Neurodégénératives（神经退行性疾病研究所）；CEA Saclay（法国原子能和替代能源委员会萨克雷）；Instituto de Automática e Informática Industrial, Universitat Politècnica de València（瓦伦西亚大学工业自动化与计算机研究所）；Hospital Universitario y Politécnico La Fe（拉菲大学综合医院）；Fundación para el Fomento de la Investigación Sanitario y Biomédica de la Comunidad Valenciana（瓦伦西亚社区健康与生物医学研究促进基金会）
SYNAPSE-Net: A Unified Framework with Lesion-Aware Hierarchical Gating for Robust Segmentation of Heterogeneous Brain Lesions
Department of Biomedical Engineering, Bangladesh University of Engineering and Technology（生物医学工程系，孟加拉国工程与技术大学）；Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology（计算机科学与工程系，孟加拉国工程与技术大学）；Department of Electrical and Electronic Engineering, Bangladesh University of Engineering and Technology（电气与电子工程系，孟加拉国工程与技术大学）
Inria Sophia Antipolis（索菲亚·安提波利斯国家信息与自动化研究所）；Microsoft Research Cambridge（微软剑桥研究院）
Most of the current state-of-the-art methods for tumor segmentation are based on machine learning models trained on manually segmented images. This type of training data is particularly costly, as manual delineation of tumors is not only time-consuming but also requires medical expertise. On the other hand, images with a provided global label (indicating presence or absence of a tumor) are less informative but can be obtained at a substantially lower cost. In this paper, we propose to use both types of training data (fully-annotated and weakly-annotated) to train a deep learning model for segm…
LATUP-Net: A Lightweight 3D Attention U-Net with Parallel Convolutions for Brain Tumor Segmentation
School of Computer Science and Informatics, Cardiff University（卡迪夫大学计算机科学与信息学院）；College of Engineering and Computer Science, Jazan University（贾赞大学工程与计算机科学学院）
University Hospital Magdeburg（马格德堡大学医院）；Otto von Guericke University（奥托·冯·格里克大学）；Human Technopole（人类技术中心）；University of L’Aquila（拉奎拉大学）；Center for Behavioral Brain Sciences（行为脑科学中心）；German Center for Neurodegenerative Disease（德国神经退行性疾病中心）
Motion artefacts in magnetic resonance brain images can have a strong impact on diagnostic confidence. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. Motion artefacts can alter the delineation of structures such as the brain, lesions or tumours and may require a repeat scan. Otherwise, an inaccurate (e.g. correct pathology but wrong severity) or incorrect diagnosis (e.g. wrong pathology) may occur. "\textit{Image quality assessment}" as a fast, automated step right after scanning can assist in deciding if the acquired images are diagnostically …
Adversarial Neural Networks in Medical Imaging Advancements and Challenges in Semantic Segmentation
New York University（纽约大学）；Texas Tech University（得克萨斯理工大学）；University of Houston（休斯顿大学）；Johns Hopkins University（约翰斯·霍普金斯大学）；University of Michigan（密歇根大学）；University of Pennsylvania（宾夕法尼亚大学）
Lausanne University Hospital and University of Lausanne（洛桑大学医院和洛桑大学）；Center for Biomedical Imaging（生物医学成像中心）；Ecole Polytechnique Fédérale de Lausanne（洛桑联邦理工学院）
A commonly adopted approach to carry out detection tasks in medical imaging is to rely on an initial segmentation. However, this approach strongly depends on voxel-wise annotations which are repetitive and time-consuming to draw for medical experts. An interesting alternative to voxel-wise masks are so-called "weak" labels: these can either be coarse or oversized annotations that are less precise, but noticeably faster to create. In this work, we address the task of brain aneurysm detection as a patch-wise binary classification with weak labels, in contrast to related studies that rather use s…
University of California, Los Angeles（加利福尼亚大学洛杉矶分校）；NVIDIA（英伟达）
Textures and edges contribute different information to image recognition. Edges and boundaries encode shape information, while textures manifest the appearance of regions. Despite the success of Convolutional Neural Networks (CNNs) in computer vision and medical image analysis applications, predominantly only texture abstractions are learned, which often leads to imprecise boundary delineations. In medical imaging, expert manual segmentation often relies on organ boundaries; for example, to manually segment a liver, a medical practitioner usually identifies edges first and subsequently fills i…
A Segmentation Framework for Accurate Diagnosis of Amyloid Positivity without Structural Images
Northwest Agricultural and Forestry Science and Technology University（西北农业和林业科学与技术大学）；Liaoning Province Shiyan High School（辽宁省石yan高级中学）；Northeast Yucai School（东北育才学校）；Northeast Yucai Foreign Language School（东北育才外国语学校）
Detecting and segmenting brain metastases is a tedious and time-consuming task for many radiologists, particularly with the growing use of multi-sequence 3D imaging. This study demonstrates automated detection and segmentation of brain metastases on multi-sequence MRI using a deep learning approach based on a fully convolution neural network (CNN). In this retrospective study, a total of 156 patients with brain metastases from several primary cancers were included. Pre-therapy MR images (1.5T and 3T) included pre- and post-gadolinium T1-weighted 3D fast spin echo, post-gadolinium T1-weighted 3…
Skolkovo Institute of Science and Technology（斯科尔科沃科学技术学院）；Kharkevich Institute for Information Transmission Problems（哈尔克维奇信息传输问题研究所）；Moscow Institute of Physics and Technology（莫斯科物理技术学院）；Higher School of Economics（高等经济学院）；Moscow Gamma-Knife Center（莫斯科伽马刀中心）；Burdenko Neurosurgery Institute（布尔坚科神经外科研究所）
Target imbalance affects the performance of recent deep learning methods in many medical image segmentation tasks. It is a twofold problem: class imbalance - positive class (lesion) size compared to negative class (non-lesion) size; lesion size imbalance - large lesions overshadows small ones (in the case of multiple lesions per image). While the former was addressed in multiple works, the latter lacks investigation. We propose a loss reweighting approach to increase the ability of the network to detect small lesions. During the learning process, we assign a weight to every image voxel. The as…
Henry Ford Health System（亨利福特医疗系统）；Wayne State University（韦恩州立大学）
Every year thousands of patients are diagnosed with a glioma, a type of malignant brain tumor. Physicians use MR images as a key tool in the diagnosis and treatment of these patients. Neural networks show great potential to aid physicians in the medical image analysis. This study investigates the use of varying amounts of synthetic brain T1-weighted (T1), post-contrast T1-weighted (T1Gd), T2-weighted (T2), and T2 Fluid Attenuated Inversion Recovery (FLAIR) MR images created by a generative adversarial network to overcome the lack of annotated medical image data in training separate 2D U-Nets t…
