Automatic Landmark-Based Segmentation of Human Subcortical Structures in MRI
École de technologie supérieure (ÉTS)（埃克塞尔技术高等学院）；Boston University School of Medicine（波士顿大学医学学院）；Signal and Smart Systems Lab (L3S)（信号与智能系统实验室）；National School of Engineering of Tunis, University of Tunis El Manar（突尼斯国家工程学院，突尼斯El Manar大学）
Ahmed Rekik, R. Jarrett Rushmore, Sylvain Bouix, Linda Marrakchi-Kacem
备注：
7 pages, 5 figures. Accepted for presentation at the 48th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2026)
Precise segmentation of brain structures in magnetic resonance imaging (MRI) is essential for reliable neuroimaging analysis, yet voxel-wise deep models often yield anatomically inconsistent results that diverge from expert-defined boundaries. In this research, we propose a landmark-guided 3D brain segmentation approach that explicitly mimics the manual segmentation protocol of the Harvard--Oxford Atlas. A Global-to-Local network automatically detects 16 landmarks representing key subcortical reference points. Then, a semantic segmentation model produces a coarse segmentation of 12 anatomical labels, each grouping multiple subcortical regions. Finally, a landmark-driven post-processing step separates these 12 labels into 26 distinct structures by enforcing local anatomical constraints. Experimental results demonstrate consistent improvements in boundary accuracy. Overall, integrating learned landmarks aligns segmentations more closely with manual protocols.
This study investigates a 3D and fully convolutional neural network (CNN) for subcortical brain structure segmentation in MRI. 3D CNN architectures have been generally avoided due to their computational and memory requirements during inference. We address the problem via small kernels, allowing deeper architectures. We further model both local and global context by embedding intermediate-layer outputs in the final prediction, which encourages consistency between features extracted at different scales and embeds fine-grained information directly in the segmentation process. Our model is efficie…
Measurements Automatically Extracted from Zero Echo Time MRI Using Deep Learning Image Segmentation and Geometric Modeling Agree with Expert Manual Readings
Columbia University（哥伦比亚大学）；The Mortimer B. Zuckerman Mind Brain Behavior Institute（莫蒂默·B·扎克曼心智大脑行为研究所）；The Taub Institute for Research on Alzheimer's Disease and the Aging Brain（陶布阿尔茨海默病与衰老大脑研究中心）；Jericho High School（杰里科高中）
Schizophrenia is a chronic neuropsychiatric disorder that causes distinct structural alterations within the brain. We hypothesize that deep learning applied to a structural neuroimaging dataset could detect disease-related alteration and improve classification and diagnostic accuracy. We tested this hypothesis using a single, widely available, and conventional T1-weighted MRI scan, from which we extracted the 3D whole-brain structure using standard post-processing methods. A deep learning model was then developed, optimized, and evaluated on three open datasets with T1-weighted MRI scans of pa…
Automated Landmark Detection for assessing hip conditions: A Cross-Modality Validation of MRI versus X-ray
MaLGa Center, DIBRIS University of Genoa（MaLGa中心，热那亚大学DIBRIS学院）；Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences University of Oxford（牛津大学风湿病学与肌肉骨骼科学系）；Department of Computer Science University of Oxford（牛津大学计算机科学系）
TABSurfer: a Hybrid Deep Learning Architecture for Subcortical Segmentation
Valley Christian High School（山谷基督教高中）；Department of Biomedical Engineering, Columbia University（生物医学工程系，哥伦比亚大学）；The Village School（村庄学校）；Department of Psychiatry, Columbia University（精神病学系，哥伦比亚大学）；Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University（莫蒂默·B·茨克尔曼 mind brain behavior 机构，哥伦比亚大学）
We propose a method to predict the subject-specific longitudinal progression of brain structures extracted from baseline MRI, and evaluate its performance on Alzheimer's disease data. The disease progression is modeled as a trajectory on a group of diffeomorphisms in the context of large deformation diffeomorphic metric mapping (LDDMM). We first exhibit the limited predictive abilities of geodesic regression extrapolation on this group. Building on the recent concept of parallel curves in shape manifolds, we then introduce a second predictive protocol which personalizes previously learned traj…
Technische Universität München（慕尼黑工业大学）；Konica Minolta Laboratory Europe（柯尼卡美能达欧洲实验室）；Johns Hopkins University（约翰斯·霍普金斯大学）；Trinity College Dublin（都柏林圣三一学院）
Registration of partial-view 3D US volumes with MRI data is influenced by initialization. The standard of practice is using extrinsic or intrinsic landmarks, which can be very tedious to obtain. To overcome the limitations of registration initialization, we present a novel approach that is based on Euclidean distance maps derived from easily obtainable coarse segmentations. We evaluate our approach quantitatively on the publicly available RESECT dataset and show that it is robust regarding overlap of target area and initial position. Furthermore, our method provides initializations that are su…
IIT Kharagpur（印度理工学院克勒格布尔分校）；IIT Bombay（印度理工学院孟买分校）；IIT Madras（印度理工学院马德拉斯分校）；Philips Research Philips Healthcare（飞利浦研究 飞利浦医疗保健）
In the medical field, landmark detection in MRI plays an important role in reducing medical technician efforts in tasks like scan planning, image registration, etc. First, 88 landmarks spread across the brain anatomy in the three respective views -- sagittal, coronal, and axial are manually annotated, later guidelines from the expert clinical technicians are taken sub-anatomy-wise, for better localization of the existing landmarks, in order to identify and locate the important atlas landmarks even in oblique scans. To overcome limited data availability, we implement realistic data augmentation…
MIT（麻省理工学院）；Boston Children’s Hospital（波士顿儿童医院）；Harvard Medical School（哈佛医学院）
Fetal MRI is heavily constrained by unpredictable and substantial fetal motion that causes image artifacts and limits the set of viable diagnostic image contrasts. Current mitigation of motion artifacts is predominantly performed by fast, single-shot MRI and retrospective motion correction. Estimation of fetal pose in real time during MRI stands to benefit prospective methods to detect and mitigate fetal motion artifacts where inferred fetal motion is combined with online slice prescription with low-latency decision making. Current developments of deep reinforcement learning (DRL), offer a nov…
Accurate detection of anatomical landmarks is an essential step in several medical imaging tasks. We propose a novel communicative multi-agent reinforcement learning (C-MARL) system to automatically detect landmarks in 3D brain images. C-MARL enables the agents to learn explicit communication channels, as well as implicit communication signals by sharing certain weights of the architecture among all the agents. The proposed approach is evaluated on two brain imaging datasets from adult magnetic resonance imaging (MRI) and fetal ultrasound scans. Our experiments show that involving multiple coo…
University College London（伦敦大学学院）；Harvard Medical School（哈佛医学院）；Massachusetts General Hospital（麻省总医院）；Allen Institute for Brain Science（艾伦脑科学研究所）；Massachusetts Institute of Technology（麻省理工学院）
Nonlinear registration of 2D histological sections with corresponding slices of MRI data is a critical step of 3D histology reconstruction. This task is difficult due to the large differences in image contrast and resolution, as well as the complex nonrigid distortions produced when sectioning the sample and mounting it on the glass slide. It has been shown in brain MRI registration that better spatial alignment across modalities can be obtained by synthesizing one modality from the other and then using intra-modality registration metrics, rather than by using mutual information (MI) as metric…
Univ Lyon（里昂大学）；INSA‐Lyon（里昂国立应用科学学院）；Université Claude Bernard Lyon 1（里昂第一大学）；UJM-Saint Etienne（圣艾蒂安大学）；CNRS（法国国家科学研究中心）；Inserm（法国国家健康与医学研究院）；CREATIS UMR 5220（CREATIS联合研究单位5220）；U1206（U1206研究单位）
Semantic segmentation is an established while rapidly evolving field in medical imaging. In this paper we focus on the segmentation of brain Magnetic Resonance Images (MRI) into cerebral structures using convolutional neural networks (CNN). CNNs achieve good performance by finding effective high dimensional image features describing the patch content only. In this work, we propose different ways to introduce spatial constraints into the network to further reduce prediction inconsistencies. A patch based CNN architecture was trained, making use of multiple scales to gather contextual informatio…
Automated Fetal Brain MRI Biometry in Healthy and Pathological Cases
Faculty of Medicine, University of Ljubljana（卢布尔雅那大学医学院）；University Medical Centre Ljubljana（卢布尔雅那大学医学中心）；Faculty of Electrical Engineering, University of Ljubljana（卢布尔雅那大学电气工程学院）
CABLD: Contrast-Agnostic Brain Landmark Detection with Consistency-Based Regularization
Department of Computer Science and Software Engineering, Concordia University（计算机科学与软件工程系，康科迪亚大学）；Department of Electrical and Computer Engineering, Concordia University（电气与计算机工程系，康科迪亚大学）
The various speech sounds of a language are obtained by varying the shape and position of the articulators surrounding the vocal tract. Analyzing their variations is crucial for understanding speech production, diagnosing speech disorders and planning therapy. Identifying key anatomical landmarks of these structures on medical images is a pre-requisite for any quantitative analysis and the rising amount of data generated in the field calls for an automatic solution. The challenge lies in the high inter- and intra-speaker variability, the mutual interaction between the articulators and the mode…
From Pre- to Intra-operative MRI: Predicting Brain Shift in Temporal Lobe Resection for Epilepsy Surgery
Surgical and Interventional Engineering（外科与介入工程）；King’s College London（伦敦国王学院）；National Hospital for Neurology and Neurosurgery（神经外科医院）；NHS（国家健康服务）；Neurosurgery, King’s College Hospital（神经外科，伦敦国王学院医院）；Fondazione IRCCS Ca’ Granda（IRCCS Ca’ Granda基金会）；Ospedale Maggiore di Milano（米兰大医院）
MIT Computer Science and Artificial Intelligence Laboratory（MIT计算机科学与人工智能实验室）；Massachusetts General Hospital, Harvard Medical School（麻省总医院，哈佛医学院）；Université Paris Cité, INRIA（巴黎Cité大学，INRIA）；LIX, CNRS, École Polytechnique（LIX，CNRS，巴黎高等理工学院）
Centrum Wiskunde & Informatica（荷兰国家数学与计算机科学研究所）；Amsterdam University Medical Centers（阿姆斯特丹大学医学中心）；University of Amsterdam（阿姆斯特丹大学）；Delft University of Technology（代尔夫特理工大学）；Leiden University Medical Center（莱顿大学医学中心）
Purpose: Deformable Image Registration (DIR) can benefit from additional guidance using corresponding landmarks in the images. However, the benefits thereof are largely understudied, especially due to the lack of automatic landmark detection methods for three-dimensional (3D) medical images. Approach: We present a Deep Convolutional Neural Network (DCNN), called DCNN-Match, that learns to predict landmark correspondences in 3D images in a self-supervised manner. We trained DCNN-Match on pairs of Computed Tomography (CT) scans containing simulated deformations. We explored five variants of DCNN…
BioFace3D: A fully automatic pipeline for facial biomarkers extraction of 3D face reconstructions segmented from MRI
La Salle - Universitat Ramon Llull（拉蒙·柳利大学拉萨尔学院）；Universitat de Barcelona（巴塞罗那大学）；FIDMAG, Sisters Hospitallers Research Foundation（仁爱修女会研究基金会FIDMAG研究所）；CIBERSAM（精神健康生物医学研究网络）；Hospital de Sant Pau i la Santa Creu（圣保禄圣十字医院）
Female-RHINO: A Real-Time Scanner-Integrated Framework for Automated Quantitative Uterine MRI Analysis and Structured Reporting
Radiologisches Institut, Universitätsklinikum Erlangen（埃朗根大学医院放射学研究所）；School of Biomedical Engineering and Imaging, KCL（KCL生物医学工程与成像学院）；Institute for Information Processing, Leibniz University Hannover（汉诺威莱布尼茨大学信息处理研究所）；CAIMed, L3S research institute（CAIMed，L3S研究机构）
The Brain Resection Multimodal Image Registration (ReMIND2Reg) 2025 Challenge
Inria Saclay Île-de-France（法国里昂萨克利研究所）；CEA（法国原子能委员会）；Université Paris-Saclay（巴黎-萨克利大学）；Sorbonne Université（索邦大学）；Institut du Cerveau - Paris Brain Institute - ICM（巴黎脑研究所）；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化技术研究所）；Inserm（法国国家医学研究院）；AP-HP（法国国家医院集团）；Hôpital de la Pitié Salpêtrière（皮蒂埃-萨尔普里埃尔医院）；Harvard Medical School（哈佛医学院）；Brigham and Women's Hospital（布里根医院）；Department of Radiology and Radiological Science（放射学与放射科学系）；Johns Hopkins Medical School（约翰霍普金斯医学院）；Institute of Medical Informatics（医学信息学研究所）；University of Lübeck（吕贝克大学）；Image Analysis and Communications Laboratory（图像分析与通信实验室）；Department of Electrical and Computer Engineering（电气与计算机工程系）；Johns Hopkins University（约翰霍普金斯大学）；CSAIL（媒体实验室）
Escola Politécnica, Universidade de São Paulo（圣保罗大学理工学院）；Brain Institute, IIEP Albert Einstein（阿尔伯特·爱因斯坦教育与研究学院脑研究所）；Faculdade de Medicina, Universidade de São Paulo（圣保罗大学医学院）；University of California San Francisco（加州大学旧金山分校）；University of Würzburg（维尔茨堡大学）；Athinoula A. Martinos Center for Biomedical Imaging, MGH/HST（麻省总医院/哈佛-麻省理工健康科学与技术部阿西诺拉·A·马丁诺斯生物医学成像中心）
Although the latest advances in MRI technology have allowed the acquisition of higher resolution images, reliable delineation of cytoarchitectural or subcortical nuclei boundaries is not possible. As a result, histological images are still required to identify the exact limits of neuroanatomical structures. However, histological processing is associated with tissue distortion and fixation artifacts, which prevent a direct comparison between the two modalities. Our group has previously proposed a histological procedure based on celloidin embedding that reduces the amount of artifacts and yields…
MedSegMamba: 3D CNN-Mamba Hybrid Architecture for Brain Segmentation
University of California, Santa Barbara（加利福尼亚大学圣巴巴拉分校）；Columbia University（哥伦比亚大学）；Mortimer B. Zuckerman Mind Brain Behavior Institute（莫蒂默·B·祖克曼脑科学与行为研究所）
Britton Chance Center for Biomedical Photonics（布里顿·钱斯生物医学光子学研究中心）；Wuhan National Laboratory for Optoelectronics（武汉光电国家研究中心）；MoE Key Laboratory for Biomedical Photonics（教育部生物医学光子学重点实验室）；Collaborative Innovation Center for Biomedical Engineering（生物医学工程协同创新中心）；School of Engineering Sciences, Huazhong University of Science and Technology（华中科技大学工程科学学院）
Registration of brain MRI images requires to solve a deformation field, which is extremely difficult in aligning intricate brain tissues, e.g., subcortical nuclei, etc. Existing efforts resort to decomposing the target deformation field into intermediate sub-fields with either tiny motions, i.e., progressive registration stage by stage, or lower resolutions, i.e., coarse-to-fine estimation of the full-size deformation field. In this paper, we argue that those efforts are not mutually exclusive, and propose a unified framework for robust brain MRI registration in both progressive and coarse-to-…
Automated Claustrum Segmentation in Human Brain MRI Using Deep Learning
Technical University of Munich（慕尼黑工业大学）；University of Zurich（苏黎世大学）；TUM-NIC Neuroimaging Center（慕尼黑工业大学神经影像中心）；Max Planck Institute of Biochemistry（马克斯·普朗克生物化学研究所）
Mask-HybridGNet: Graph-based segmentation with emergent anatomical correspondence from pixel-level supervision
Biomedical Image Technologies, ETSI Telecomunicación, Universidad Politécnica de Madrid, Madrid, Spain（生物医学影像技术，电信工程学院，马德里理工大学，马德里，西班牙）；IHU PRISM National Precision Medicine Center in Oncology, Cancer Data Science Unit, CentraleSupélec, Gustave Roussy, INSERM, Université Paris-Saclay, Gif-sur-Yvette, France（IHU PRISM国家精准医学中心（肿瘤学），癌症数据科学单元，中央圣艾尔布兰，格斯塔夫·罗西，国家医学研究所，巴黎-萨克雷大学，法国）
Automated deep learning segmentation of high-resolution 7 T postmortem MRI for quantitative analysis of structure-pathology correlations in neurodegenerative diseases
Department of Computer Science, University of Rochester（罗切斯特大学计算机科学系）；Department of Electrical Engineering, University of Rochester（罗切斯特大学电气工程系）；Department of Biomedical Engineering, University of Rochester（罗切斯特大学生物医学工程系）；Department of Imaging Sciences, University of Rochester（罗切斯特大学影像科学系）；Faculty of Medicine and Institute of Clinical Radiology, Ludwig Maximilian University（路德维希-马克西米利安大学医学院及临床放射学研究所）
Glioma is one of the most common and aggressive types of primary brain tumors. The accurate segmentation of subcortical brain structures is crucial to the study of gliomas in that it helps the monitoring of the progression of gliomas and aids the evaluation of treatment outcomes. However, the large amount of required human labor makes it difficult to obtain the manually segmented Magnetic Resonance Imaging (MRI) data, limiting the use of precise quantitative measurements in the clinical practice. In this work, we try to address this problem by developing a 3D Convolutional Neural Network~(3D C…
Brain segmentation based on multi-atlas guided 3D fully convolutional network ensembles
School of Electronics and Information Technology, Sun Yat-sen University（中山大学电子与信息工程学院）；Department of Electrical and Electronic Engineering, Southern University of Science and Technology（南方科技大学电子与电气工程学院）
NeuroMorphix: A Novel Brain MRI Asymmetry-specific Feature Construction Approach For Seizure Recurrence Prediction
Centre for Advanced Imaging, The University of Queensland（昆士兰大学高级成像中心）；ARC-funded Training Centre for Innovation in Biomedical Imaging Technology, The University of Queensland（昆士兰大学ARC资助的生物医学成像技术创新培训中心）；Royal Brisbane and Women’s Hospital（皇家布里斯班妇女医院）
NeuroCBIR: A Fast and Accurate Image Retrieval System for Whole-Brain and Region-Specific MRI
KTH Royal Institute of Technology（瑞典皇家理工学院）；Massachusetts General Hospital and Harvard Medical School（麻省总医院和哈佛医学院）；Karolinska Institute（卡罗林斯卡学院）；Universidad Fernando Pessoa Canarias（费尔南多·佩索阿大学加那利分校）
Technical University of Munich（慕尼黑工业大学）；Klinikum rechts der Isar（右伊萨尔医院）；University of Zurich（苏黎世大学）；Institut für KI und Informatik in der Medizin（医学人工智能与信息学研究所）；Imperial College London（伦敦帝国学院）
Detailed delineation of the fetal brain in diffusion MRI via multi-task learning
Harvard Medical School（哈佛医学院）；Elmhurst Hospital Center（埃尔姆赫斯特医院中心）；Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院）；Massachusetts General Hospital（麻省总医院）；University of California Irvine（加州大学欧文分校）
What neurosurgeons need to see: synthetic intra-operative MRI from ultrasound for brain-shift compensation in brain tumour surgery
Department of Neurosurgery, Neurovascular Unit, Río Hortega University Hospital, Valladolid, Spain（西班牙巴利亚多利德里奥·奥尔特加大学医院神经外科神经血管科）；Specialized Group in Biomedical Imaging and Computational Analysis (GEIBAC), Instituto de Investigación Biosanitaria de Valladolid (IBioVALL), Valladolid, Spain（西班牙巴利亚多利德生物医学研究与计算分析专业组(GEIBAC)，巴利亚多利德生物健康研究所(IBioVALL)）
Reconstruction of 3D lumbar spine models from incomplete segmentations using landmark detection
University of Koblenz（科布伦茨大学）；Institute for Computational Visualistics（计算视觉研究所）；Institute for Medical Technology and Information Processing（医学技术与信息处理研究所）
Deformable image registration is a key task in medical image analysis. The Brain Tumor Sequence Registration challenge (BraTS-Reg) aims at establishing correspondences between pre-operative and follow-up scans of the same patient diagnosed with an adult brain diffuse high-grade glioma and intends to address the challenging task of registering longitudinal data with major tissue appearance changes. In this work, we proposed a two-stage cascaded network based on the Inception and TransMorph models. The dataset for each patient was comprised of a native pre-contrast (T1), a contrast-enhanced T1-w…
The Brain Tumor Sequence Registration (BraTS-Reg) Challenge: Establishing Correspondence Between Pre-Operative and Follow-up MRI Scans of Diffuse Glioma Patients
Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine（印第安纳大学医学院计算病理学系）；Department of Electrical and Systems Engineering, Washington University in St. Louis（圣路易斯华盛顿大学电气与系统工程系）；GE HealthCare（GE医疗）；Center for Artificial Intelligence and Data Science for Integrated Diagnostics (AI2D) and Center for Biomedical Image Computing and Analytics (CBICA), University of Penn（宾夕法尼亚大学综合诊断人工智能与数据科学中心及生物医学图像计算与分析中心）
École de Technologie Supérieure（高等技术学院）；CHU Sainte-Justine Research Center（圣茹斯特医院研究中心）；Polytechnique Montréal（蒙特利尔理工学院）
Vertebral bone segmentation from magnetic resonance (MR) images is a challenging task. Due to the inherent nature of the modality to emphasize soft tissues of the body, common thresholding algorithms are ineffective in detecting bones in MR images. On the other hand, it is relatively easier to segment bones from CT images because of the high contrast between bones and the surrounding regions. For this reason, we perform a cross-modality synthesis between MR and CT domains for simple thresholding-based segmentation of the vertebral bones. However, this implicitly assumes the availability of pai…
A Segmentation Framework for Accurate Diagnosis of Amyloid Positivity without Structural Images
Northwest Agricultural and Forestry Science and Technology University（西北农业和林业科学与技术大学）；Liaoning Province Shiyan High School（辽宁省石yan高级中学）；Northeast Yucai School（东北育才学校）；Northeast Yucai Foreign Language School（东北育才外国语学校）
The Brain Tumor Segmentation (BraTS) Challenge 2023: Focus on Pediatrics (CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs)
Center for Data-Driven Discovery in Biomedicine (D3b), Children’s Hospital of Philadelphia（费城儿童医院生物医学数据驱动发现中心）；University of Pennsylvania（宾夕法尼亚大学）；Center for AI & Data Science for Integrated Diagnostics (AI2D)（综合诊断人工智能与数据科学中心）；Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania（宾夕法尼亚大学生物医学图像计算与分析中心）；Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital（儿童医院谢赫·扎耶德儿科外科创新研究所）；Thomas Jefferson University Hospital（托马斯杰斐逊大学医院）；Sage Bionetworks；Montreal Neurological Institute (MNI), McGill University（麦吉尔大学蒙特利尔神经学研究所）；Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院）；University of Southern California（南加州大学）；Duke University Medical Center（杜克大学医学中心）；Mayo Clinic（梅奥诊所）；Center for Global Health, Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院全球健康中心）；Technical University of Munich（慕尼黑工业大学）；TranslaTUM - Central Institute for Translational Cancer Research, Technical University of Munich（慕尼黑工业大学转化肿瘤学研究中心（TranslaTUM））；National Cancer Institute（美国国家癌症 Institute）
