Brain age prediction based on children's brain MRI is an important biomarker for brain health and brain development analysis. In this paper, we consider the 3D brain MRI volume as a sequence of 2D images and propose a new framework using the recurrent neural network for brain age estimation. The proposed method is named as 2D-ResNet18+Long short-term memory (LSTM), which consists of four parts: 2D ResNet18 for feature extraction on 2D images, a pooling layer for feature reduction over the sequences, an LSTM layer, and a final regression layer. We apply the proposed method on a public multisite NIH-PD dataset and evaluate generalization on a second multisite dataset, which shows that the proposed 2D-ResNet18+LSTM method provides better results than traditional 3D based neural network for brain age estimation.
Autism Spectrum Disorder Classification with Interpretability in Children based on Structural MRI Features Extracted using Contrastive Variational Autoencoder
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；University of Chinese Academy of Sciences（中国科学院大学）；Shenzhen Key Laboratory of Intelligent Bioinformatics（深圳市智能生物信息学重点实验室）；Center for High Performance Computing, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院高性能计算中心）
CREATIS（CREATIS实验室）；Université Lyon 1（里昂第一大学）；INSA-Lyon（里昂国立应用科学学院）；Hospices Civils de Lyon（里昂民用医院）；CarMeN（CarMeN实验室）；LARIS（LARIS实验室）；Universite d’Angers（昂热大学）
Patient outcome prediction is critical in management of ischemic stroke. In this paper, a novel machine learning model is proposed for stroke outcome prediction using multimodal Magnetic Resonance Imaging (MRI). The proposed model consists of two serial levels of Autoencoders (AEs), where different AEs at level 1 are used for learning unimodal features from different MRI modalities and a AE at level 2 is used to combine the unimodal features into compressed multimodal features. The sequences of multimodal features of a given patient are then used by an LSTM network for predicting outcome score…
A multi-institutional pediatric dataset of clinical radiology MRIs by the Children's Brain Tumor Network
Children’s Hospital of Philadelphia（费城儿童医院）；Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院）；National Cancer Institute（美国国家癌症研究所）；Children's National Hospital（儿童国家医院）；Sheikh Zayed Institute for Pediatric Surgical Innovation（谢赫扎耶德儿科外科创新研究院）
Pediatric Pancreas Segmentation from MRI Scans with Deep Learning
Northwestern University（西北大学）；Gazi University Faculty of Medicine（加齐大学医学院）；University of Illinois at Chicago（伊利诺伊大学芝加哥分校）；Washington University School of Medicine in St. Louis（圣路易斯华盛顿大学医学院）；University of Iowa, Carver College of Medicine（爱荷华大学卡弗医学院）
University of Ottawa（渥太华大学）；Children’s Hospital of Eastern Ontario（东安大略儿童医院）
Polymicrogyria (PMG) is a disorder of cortical organization mainly seen in children, which can be associated with seizures, developmental delay and motor weakness. PMG is typically diagnosed on magnetic resonance imaging (MRI) but some cases can be challenging to detect even for experienced radiologists. In this study, we create an open pediatric MRI dataset (PPMR) with PMG and controls from the Children's Hospital of Eastern Ontario (CHEO), Ottawa, Canada. The differences between PMG MRIs and control MRIs are subtle and the true distribution of the features of the disease is unknown. This mak…
MRI-to-CT Synthesis With Cranial Suture Segmentations Using A Variational Autoencoder Framework
Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital, Washington, DC, USA（Sheikh Zayed儿童外科创新研究所，Children’s National医院，华盛顿特区，美国）；CIBORG Lab, Department of Radiology, Children’s Hospital Los Angeles, Los Angeles, CA, USA（CIBORG实验室，放射科，Children’s Hospital Los Angeles，洛杉矶，加利福尼亚州，美国）；Departments of Radiology and Biomedical Engineering, University of Southern California, Los Angeles, CA, USA（放射科和生物医学工程系，美国南加州大学，洛杉矶，加利福尼亚州，美国）；School of Medicine and Health Sciences, George Washington University, Washington, DC, USA（医学与健康科学学院，乔治华盛顿大学，华盛顿特区，美国）
CREATIS（CREATIS实验室）；Université Lyon1（里昂第一大学）；CNRS（法国国家科学研究中心）；INSERM（法国国家健康与医学研究院）；INSA-Lyon（里昂国立应用科学学院）；Hospices Civils de Lyon（里昂民用医院）；CarMeN（CarMeN实验室）；INRA（法国国家农业研究院）；LARIS（LARIS实验室）；Universite d’Angers（昂热大学）
Clinical outcome prediction plays an important role in stroke patient management. From a machine learning point-of-view, one of the main challenges is dealing with heterogeneous data at patient admission, i.e. the image data which are multidimensional and the clinical data which are scalars. In this paper, a multimodal convolutional neural network - long short-term memory (CNN-LSTM) based ensemble model is proposed. For each MR image module, a dedicated network provides preliminary prediction of the clinical outcome using the modified Rankin scale (mRS). The final mRS score is obtained by merg…
Center for Biomedical Image Computing and Analytics（生物医学图像计算与分析中心）；Perelman School of Medicine（佩雷尔曼医学院）；University of Pennsylvania（宾夕法尼亚大学）
Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain functional connectivity or brain activation signatures for a variety of brain decoding tasks. However, most of existing studies have built decoding models upon features extracted from imaging data at individual time points or temporal windows with a fixed interval, which might not be optimal across different cognitive processes due to varying temporal durations…
Northeastern University（东北大学）；Boston Children’s Hospital（波士顿儿童医院）；Harvard Medical School（哈佛医学院）
Kidney function evaluation using dynamic contrast-enhanced MRI (DCE-MRI) images could help in diagnosis and treatment of kidney diseases of children. Automatic segmentation of renal parenchyma is an important step in this process. In this paper, we propose a time and memory efficient fully automated segmentation method which achieves high segmentation accuracy with running time in the order of seconds in both normal kidneys and kidneys with hydronephrosis. The proposed method is based on a cascaded application of two 3D convolutional neural networks that employs spatial and temporal informatio…
Shanghai Jiao Tong University（上海交通大学）；University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Ruijin Hospital affiliated to Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属瑞金医院）；KTH Royal Institute of Technology（瑞典皇家理工学院）；Mayo Clinic in Arizona（亚利桑那州妙佑医疗国际）；ShanghaiTech University（上海科技大学）
Interventional magnetic resonance imaging (i-MRI) for surgical guidance could help visualize the interventional process such as deep brain stimulation (DBS), improving the surgery performance and patient outcome. Different from retrospective reconstruction in conventional dynamic imaging, i-MRI for DBS has to acquire and reconstruct the interventional images sequentially online. Here we proposed a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling. By using an initializer and C…
University of Florida（佛罗里达大学）；National Institutes of Health Clinical Center（国立卫生研究院临床中心）
Deep neural networks have demonstrated very promising performance on accurate segmentation of challenging organs (e.g., pancreas) in abdominal CT and MRI scans. The current deep learning approaches conduct pancreas segmentation by processing sequences of 2D image slices independently through deep, dense per-pixel masking for each image, without explicitly enforcing spatial consistency constraint on segmentation of successive slices. We propose a new convolutional/recurrent neural network architecture to address the contextual learning and segmentation consistency problem. A deep convolutional …
TractGraphFormer: Anatomically Informed Hybrid Graph CNN-Transformer Network for Interpretable Sex and Age Prediction from Diffusion MRI Tractography
Brigham and Women's Hospital, Harvard Medical School（哈佛医学院布莱根妇女医院）；University of Electronic Science and Technology of China（电子科技大学）；Beth Israel Deaconess Medical Center, Harvard Medical School（哈佛医学院贝斯以色列女执事医疗中心）；The University of Sydney（悉尼大学）；University of New South Wales（新南威尔士大学）；Boston University School of Medicine（波士顿大学医学院）；Massachusetts General Hospital, Harvard Medical School（哈佛医学院麻省总医院）
Vanderbilt University（范德堡大学）；Henry Jackson Foundation（亨利·杰克逊基金会）；University of Calgary（卡尔加里大学）；Vanderbilt University Medical Center（范德堡大学医学中心）
Generalizability is an important problem in deep neural networks, especially in the context of the variability of data acquisition in clinical magnetic resonance imaging (MRI). Recently, the Spatially Localized Atlas Network Tiles (SLANT) approach has been shown to effectively segment whole brain non-contrast T1w MRI with 132 volumetric labels. Enhancing generalizability of SLANT would enable broader application of volumetric assessment in multi-site studies. Transfer learning (TL) is commonly used to update the neural network weights for local factors; yet, it is commonly recognized to risk d…
Biomediq A/S（Biomediq公司）；University of Copenhagen（哥本哈根大学）；University College London（伦敦大学学院）
Disease progression modeling (DPM) using longitudinal data is a challenging task in machine learning for healthcare that can provide clinicians with better tools for diagnosis and monitoring of disease. Existing DPM algorithms neglect temporal dependencies among measurements and make parametric assumptions about biomarker trajectories. In addition, they do not model multiple biomarkers jointly and need to align subjects' trajectories. In this paper, recurrent neural networks (RNNs) are utilized to address these issues. However, in many cases, longitudinal cohorts contain incomplete data, which…
Tumor Location-weighted MRI-Report Contrastive Learning: A Framework for Improving the Explainability of Pediatric Brain Tumor Diagnosis
The Hospital for Sick Children（病童医院）；University of Toronto（多伦多大学）；Vector Institute for Artificial Intelligence（矢量人工智能研究所）；University Hospital Augsburg（奥格斯堡大学医院）
HyKid: An Open MRI Dataset with Expert-Annotated Multi-Structure and Choroid Plexus in Pediatric Hydrocephalus
College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou, China（浙江大学生物医学工程与仪器科学学院）；Department of Radiology, Children’s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Child Health, Hangzhou, China（浙江大学医学院儿童医院放射科）；Neurosurgery of Zhejiang Hospital, Hangzhou, China（浙江医院神经外科）
Despite its tremendous value for the diagnosis, treatment monitoring and surveillance of children with cancer, whole body staging with positron emission tomography (PET) is time consuming and associated with considerable radiation exposure. 100x (1% of the standard clinical dosage) ultra-low-dose/ultra-fast whole-body PET reconstruction has the potential for cancer imaging with unprecedented speed and improved safety, but it cannot be achieved by the naive use of machine learning techniques. In this study, we utilize the global similarity between baseline and follow-up PET and magnetic resonan…
Concordia Institute for Information Systems Engineering, Concordia University（康考迪亚大学康考迪亚信息系统工程研究所）；University of Toronto（多伦多大学）
Brain tumor is considered as one of the deadliest and most common form of cancer both in children and in adults. Consequently, determining the correct type of brain tumor in early stages is of significant importance to devise a precise treatment plan and predict patient's response to the adopted treatment. In this regard, there has been a recent surge of interest in designing Convolutional Neural Networks (CNNs) for the problem of brain tumor type classification. However, CNNs typically require large amount of training data and can not properly handle input transformations. Capsule networks (r…
xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpart
College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）；KOKONI, Moxin (Huzhou) Tech. Co., LTD.（墨芯（湖州）科技有限公司KOKONI）；School of Information Engineering, Huzhou University（湖州师范学院信息工程学院）；Information Systems Technology and Design Pillar, Singapore University of Technology and Design（新加坡科技设计大学信息系统技术与设计 pillar）；School of Information Science and Technology, University of Science and Technology of China（中国科学技术大学信息科学技术学院）；School of Software Technology, Zhejiang University（浙江大学软件学院）
TissUnet: Improved Extracranial Tissue and Cranium Segmentation for Children through Adulthood
Mass General Brigham（麻省总医院布列根医疗系统）；Harvard Medical School（哈佛医学院）；Dana-Farber Cancer Institute（丹娜-法伯癌症研究所）；Brigham and Women’s Hospital（布列根和妇女医院）；Maastricht University（马斯特里赫特大学）；Boston Children's Hospital（波士顿儿童医院）；George Washington School of Medicine and Health Sciences（乔治华盛顿大学医学与健康科学学院）；University of California, San Francisco（加州大学旧金山分校）；Ludwig Maximilian University of Munich（慕尼黑大学）；Ukrainian Catholic University（乌克兰天主教大学）；The Children’s Hospital of Philadelphia（费城儿童医院）；Penn Medicine（宾夕法尼亚大学医学中心）；University of Pennsylvania（宾夕法尼亚大学）；UT Southwestern Medical Center（德克萨斯大学西南医学中心）
National University of Defense Technology（国防科技大学）；Budapest University of Technology and Economics（布达佩斯技术与经济大学）；Tongji University（同济大学）
Ultrasound tongue imaging is widely used for speech production research, and it has attracted increasing attention as its potential applications seem to be evident in many different fields, such as the visual biofeedback tool for second language acquisition and silent speech interface. Unlike previous studies, here we explore the feasibility of age estimation using the ultrasound tongue image of the speakers. Motivated by the success of deep learning, this paper leverages deep learning on this task. We train a deep convolutional neural network model on the UltraSuite dataset. The deep model ac…
This paper presents a deep learning framework for image classification aimed at increasing predictive performance for Cytotoxic Edema (CE) diagnosis in infants and children. The proposed framework includes two 3D network architectures optimized to learn from two types of clinical MRI data , a trace Diffusion Weighted Image (DWI) and the calculated Apparent Diffusion Coefficient map (ADC). This work proposes a robust and novel solution based on volumetric analysis of 3D images (using pixels from time slices) and 3D convolutional neural network (CNN) models. While simple in architecture, the pro…
The Hospital for Sick Children（病童医院）；University of Toronto（多伦多大学）；Vector Institute（矢量研究所）
Brain tumor segmentation is a critical task for tumor volumetric analyses and AI algorithms. However, it is a time-consuming process and requires neuroradiology expertise. While there has been extensive research focused on optimizing brain tumor segmentation in the adult population, studies on AI guided pediatric tumor segmentation are scarce. Furthermore, MRI signal characteristics of pediatric and adult brain tumors differ, necessitating the development of segmentation algorithms specifically designed for pediatric brain tumors. We developed a segmentation model trained on magnetic resonance…
School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China（电子科技大学光电科学与工程学院）；Institute of Medical Science, University of Toronto（多伦多大学医学科学研究所）；The Hospital for Sick Children (SickKids)（SickKids 儿童医院（病童医院））
Brain tumor is one of the leading causes of cancer-related death globally among children and adults. Precise classification of brain tumor grade (low-grade and high-grade glioma) at early stage plays a key role in successful prognosis and treatment planning. With recent advances in deep learning, Artificial Intelligence-enabled brain tumor grading systems can assist radiologists in the interpretation of medical images within seconds. The performance of deep learning techniques is, however, highly depended on the size of the annotated dataset. It is extremely challenging to label a large quanti…
Unsupervised Adversarial Domain Adaptation for Uterine layer Segmentation: From Labeled Cine to Unlabeled Dynamic EPI MRI
Institute of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡大学弗里德里希-亚历山大分校埃尔朗根大学医院放射学研究所）；CAIMED（CAIMED机构）；L3S（L3S机构）；Institut für Informationsverarbeitung, Leibniz University Hannover（汉诺威莱布尼茨大学信息处理研究所）
NeuroTS-Net: Multi-Class Semantic Segmentation of Pediatric Brain Tumors in Multi-Modal MRI
Lucian Blaga University of Sibiu（锡比乌卢奇安·布拉加大学）；University of Arizona（亚利桑那大学）；Pediatric Clinical Hospital of Sibiu（锡比乌儿科临床医院）；Johns Hopkins University（约翰斯·霍普金斯大学）；MedLife Polisano Hospital（MedLife Polisano医院）
In this paper, we propose a predictive regression model for longitudinal images with missing data based on large deformation diffeomorphic metric mapping (LDDMM) and deep neural networks. Instead of directly predicting image scans, our model predicts a vector momentum sequence associated with a baseline image. This momentum sequence parameterizes the original image sequence in the LDDMM framework and lies in the tangent space of the baseline image, which is Euclidean. A recurrent network with long term-short memory (LSTM) units encodes the time-varying changes in the vector-momentum sequence, …
Indian Institute of Technology (IIT) Bombay（印度理工学院孟买分校）；IITB-Monash Research Academy（印度理工学院孟买分校-莫纳什研究学院）；Monash University（莫纳什大学）
Radiation exposure in positron emission tomography (PET) imaging limits its usage in the studies of radiation-sensitive populations, e.g., pregnant women, children, and adults that require longitudinal imaging. Reducing the PET radiotracer dose or acquisition time reduces photon counts, which can deteriorate image quality. Recent deep-neural-network (DNN) based methods for image-to-image translation enable the mapping of low-quality PET images (acquired using substantially reduced dose), coupled with the associated magnetic resonance imaging (MRI) images, to high-quality PET images. However, s…
Chulalongkorn University（朱拉隆功大学）；European University of Bangladesh（孟加拉国欧洲大学）；University of Liberal Arts Bangladesh（孟加拉国文科大学）
The growth of abnormal cells in the brain's tissue causes brain tumors. Brain tumors are considered one of the most dangerous disorders in children and adults. It develops quickly, and the patient's survival prospects are slim if not appropriately treated. Proper treatment planning and precise diagnoses are essential to improving a patient's life expectancy. Brain tumors are mainly diagnosed using magnetic resonance imaging (MRI). As part of a convolution neural network (CNN)-based illustration, an architecture containing five convolution layers, five max-pooling layers, a Flatten layer, and t…
Enhancing efficiency in paediatric brain tumour segmentation using a pathologically diverse single-center clinical dataset
University Children's Hospital Zurich（苏黎世大学儿童医院）；Technical University of Munich（慕尼黑工业大学）；Helmholtz Zentrum（亥姆霍兹中心）；German Consortium for Translational Cancer Research (DKTK)（德国转化癌症研究联盟）；Georgia Institute of Technology（佐治亚理工学院）；Geisel School of Medicine at Dartmouth（达特茅斯盖泽尔医学院）；Helmholtz AI（亥姆霍兹人工智能）；Helmholtz Zentrum Munich（慕尼黑亥姆霍兹中心）；University of Zurich（苏黎世大学）
Impact of Initialization on Intra-subject Pediatric Brain MR Image Registration: A Comparative Analysis between SyN ANTs and Deep Learning-Based Approaches
Polytechnique Montréal（蒙特利尔理工学院）；Ste-Justine Hospital University Centre（圣贾斯汀医院大学中心）；Université de Strasbourg（斯特拉斯堡大学）；CNRS（法国国家科学研究中心）
