PathMoE: Interpretable Multimodal Interaction Experts for Pediatric Brain Tumor Classification
University of Texas(德克萨斯大学);Dell Children’s Medical Center(德尔儿童医学中心);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);University of Nevada, Reno(内华达大学里诺分校)
Accurate classification of pediatric central nervous system tumors remains challenging due to histological complexity and limited training data. While pathology foundation models have advanced whole-slide image (WSI) analysis, they often fail to leverage the rich, complementary information found in clinical text and tissue microarchitecture. To this end, we propose PathMoE, an interpretable multimodal framework that integrates H\&E slides, pathology reports, and nuclei-level cell graphs via an interaction-aware mixture-of-experts architecture built on state-of-the-art foundation models for each modality. By training specialized experts to capture modality uniqueness, redundancy, and synergy, PathMoE employs an input-dependent gating mechanism that dynamically weights these interactions, providing sample-level interpretability. We evaluate our framework on two dataset-specific classification tasks on an internal pediatric brain tumor dataset (PBT) and external TCGA datasets. PathMoE improves macro-F1 from 0.762 to 0.799 (+0.037) on PBT when integrating WSI, text, and graph modalities; on TCGA, augmenting WSI with graph knowledge improves macro-F1 from 0.668 to 0.709 (+0.041). These results demonstrate significant performance gains over state-of-the-art image-only baselines while revealing the specific modality interactions driving individual predictions. This interpretability is particularly critical for rare tumor subtypes, where transparent model reasoning is essential for clinical trust and diagnostic validation.
Clinically-Informed Modeling for Pediatric Brain Tumor Classification from Whole-Slide Histopathology Images
Dept. of Computer Science(计算机科学系);University of Texas at Austin(德克萨斯大学奥斯汀分校);School of Information(信息学院);Dell Children's Medical Center(德尔儿童医学中心);Dept. of OREI(OREI部门);University of Nevada, Reno(内华达大学里诺分校)
In the past few years, deep learning (DL) models have drawn great attention and shown superior performance on brain tumor and subregion segmentation tasks. However, the success is limited to segmentation of adult gliomas, where sufficient data have been collected, manually labeled, and published for training DL models. It is still challenging to segment pediatric tumors, because the appearances are different from adult gliomas. Hence, directly applying a pretained DL model on pediatric data usually generates unacceptable results. Because pediatric data is very limited, both labeled and unlabel…
The Hospital for Sick Children(病童医院);University of Toronto(多伦多大学);Vector Institute(矢量研究所)
Brain tumor segmentation is a critical task for tumor volumetric analyses and AI algorithms. However, it is a time-consuming process and requires neuroradiology expertise. While there has been extensive research focused on optimizing brain tumor segmentation in the adult population, studies on AI guided pediatric tumor segmentation are scarce. Furthermore, MRI signal characteristics of pediatric and adult brain tumors differ, necessitating the development of segmentation algorithms specifically designed for pediatric brain tumors. We developed a segmentation model trained on magnetic resonance…
A New Logic For Pediatric Brain Tumor Segmentation
1 Northwestern University, Feinberg School of Medicine, Chicago IL, USA 2 Children’s National Hospital, Sheikh Zayed Institute for Pediatric Surgical Innovation, Washington, DC, USA 3 Ann \& Robert H Lurie Children's Hospital of Chicago, Chicago, IL, USA
A Multi-Stage Deep Learning Framework with PKCP-MixUp Augmentation for Pediatric Liver Tumor Diagnosis Using Multi-Phase Contrast-Enhanced CT
Wuhan Children's Hospital (Wuhan Maternal and Child Healthcare Hospital), Tongji Medical College, Huazhong University of Science and Technology(华中科技大学同济医学院武汉儿童医院(武汉市妇幼保健院));Wuhan University(武汉大学);Wuhan Cloud Computing Technology Co., Ltd.(武汉云计算技术有限公司)
Improving Deep Learning Models for Pediatric Low-Grade Glioma Tumors Molecular Subtype Identification Using 3D Probability Distributions of Tumor Location
The Hospital for Sick Children (SickKids)(SickKids 病童医院);SickKids Research Institute(SickKids 研究所);University of Toronto(多伦多大学);Institute of Medical Science, University of Toronto(多伦多大学医学科学研究所);Vector Institute(矢量研究院);NVIDIA Deep Learning Institute(英伟达深度学习研究院)
NeuroTS-Net: Multi-Class Semantic Segmentation of Pediatric Brain Tumors in Multi-Modal MRI
Lucian Blaga University of Sibiu(锡比乌卢奇安·布拉加大学);University of Arizona(亚利桑那大学);Pediatric Clinical Hospital of Sibiu(锡比乌儿科临床医院);Johns Hopkins University(约翰斯·霍普金斯大学);MedLife Polisano Hospital(MedLife Polisano医院)
Frequency-Aware Ensemble Learning for BraTS 2025 Pediatric Brain Tumor Segmentation
Institute of Natural Sciences, School of Mathematical Sciences, MOE-LSC, Shanghai Jiao Tong University(自然科学院、数学科学学院、MOE-LSC、上海交通大学);Department of Radiology, Huashan Hospital, Fudan University(放射科、华山医院、复旦大学);Department of Neurosurgery, Huashan Hospital, Fudan University(神经外科、华山医院、复旦大学)
Tumor Location-weighted MRI-Report Contrastive Learning: A Framework for Improving the Explainability of Pediatric Brain Tumor Diagnosis
The Hospital for Sick Children(病童医院);University of Toronto(多伦多大学);Vector Institute for Artificial Intelligence(矢量人工智能研究所);University Hospital Augsburg(奥格斯堡大学医院)
Automated ensemble method for pediatric brain tumor segmentation
Manning College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校曼宁信息与计算机科学学院);Institute for Applied Life Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校应用生命科学研究所);UMass Chan Medical School - Baystate Campus(马萨诸塞大学陈医学院贝塞特校区);Baystate Medical Center(贝塞特医疗中心)
The Brain Tumor Segmentation in Pediatrics (BraTS-PEDs) Challenge: Focus on Pediatrics (CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs)
Center for Data-Driven Discovery in Biomedicine (D3b)(生物医学数据驱动发现中心);Children’s Hospital of Philadelphia(费城儿童医院);Department of Neurosurgery, University of Pennsylvania(宾夕法尼亚大学神经外科);Center for AI & Data Science for Integrated Diagnostics (AI2D)(综合诊断人工智能与数据科学中心);Center for Biomedical Image Computing and Analytics (CBICA)(生物医学图像计算与分析中心);Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital(儿童医院谢赫·扎耶德儿科外科创新研究所);Sage Bionetworks(赛基生物网络公司);Medical Artificial Intelligence (MAI) Lab, Crestview Radiology(Crestview放射科医学人工智能实验室);Montreal Neurological Institute (MNI), McGill University(麦吉尔大学蒙特利尔神经学研究所);Department of Radiology, Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院放射科);Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine(印第安纳大学医学院病理学与实验医学系计算病理学分部);Department of Neurosurgery at the University of Southern California(南加州大学神经外科);Department of Radiology, Duke University Medical Center(杜克大学医学中心放射科);Mayo Clinic(梅奥诊所);Center for Global Health, Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院全球健康中心);Department of Informatics, Technical University Munich(慕尼黑工业大学信息学系);TranslaTUM - Central Institute for Translational Cancer Research, Technical University of Munich(慕尼黑工业大学TranslaTUM转化癌症研究中心)
Improving Pediatric Low-Grade Neuroepithelial Tumors Molecular Subtype Identification Using a Novel AUROC Loss Function for Convolutional Neural Networks
The Hospital for Sick Children (SickKids)(病童医院 (SickKids));SickKids Research Institute(SickKids研究所);University of Toronto(多伦多大学);University Hospital Augsburg(奥格斯堡大学医院);Vector Institute(Vector研究所)
Pediatric brain tumor classification using digital histopathology and deep learning: evaluation of SOTA methods on a multi-center Swedish cohort
Department of Biomedical Engineering, Linköping University, Sweden(生物医学工程系,利厄普大学);Center for Medical Image Science and Visualization, Linköping University, Sweden(医学影像科学与可视化中心,利厄普大学);Crown Princess Victoria Children’s Hospital and Department of Health, Medicine and Caring Sciences, Linköping University, Sweden(维多利亚公主儿童医院和健康、医学与关怀科学系,利厄普大学);Department of Radiology and Department of Health, Medicine and Caring Sciences, Linköping University, Sweden(放射科和健康、医学与关怀科学系,利厄普大学);Department of Oncology-Pathology, Karolinska Institutet, Solna, Sweden(肿瘤病理学系,卡罗林斯卡研究所,索纳);Department of Clinical Pathology and Cancer Diagnostics, Karolinska University Hospital, Sweden(临床病理学和癌症诊断系,卡罗林斯卡大学医院);Department of Radiation Physics and Department of Medical and Health Sciences, Linköping University, Sweden(放射物理系和医学与健康科学系,利厄普大学)
Towards Reliable Pediatric Brain Tumor Segmentation: Task-Specific nnU-Net Enhancements
Institute of Natural Sciences, School of Mathematical Sciences, MOE-LSC, Shanghai Jiao Tong University(自然科学院,数学科学学院,MOE-LSC,上海交通大学);Department of Radiology, Huashan Hospital, Fudan University(放射科,华山医院,复旦大学);Department of Neurosurgery, Huashan Hospital, Fudan University(神经外科,华山医院,复旦大学)
BraTS-PEDs: Results of the Multi-Consortium International Pediatric Brain Tumor Segmentation Challenge 2023
Center for Data-Driven Discovery in Biomedicine (D3b)(数据驱动生物医学发现中心);The Children’s Hospital of Philadelphia(费城儿童医院);Sheikh Zayed Institute for Pediatric Surgical Innovation(谢赫扎伊德儿童外科创新研究所);Children’s National Hospital(儿童国家医院);Department of Neurosurgery(神经外科部门);Dana-Farber Brigham Cancer Center & Boston Children’s Hospital(达纳-法伯布里弗癌症中心及波士顿儿童医院);Department of Paediatric Radiology(儿科放射科部门);University of Utah(犹他大学);Cincinnati Children’s Hospital Medical Center(辛辛那提儿童医学中心);Department of Radiology(放射科部门);Division of Neuroradiology, Department of Radiology, Boston Children’s Hospital, Harvard Medical School(神经放射科,放射科,波士顿儿童医院,哈佛医学院);College of Arts and Sciences, University of Pennsylvania(艺术与科学学院,宾夕法尼亚大学);Department of Diagnostic and Interventional Radiology, All India Institute of Medical Sciences(诊断与介入放射科,全印度医学科学院);Department of Diagnostic & Interventional Imaging, Neuroradiology section, The University of Texas Health at Houston, Texas, USA(诊断与介入成像部门,神经放射科,德克萨斯大学健康科学中心,德克萨斯,美国);Beth Israel Deaconess Medical Center, Harvard Medical School(贝斯以色列医疗中心,哈佛医学院);UNIDAD DE PATOLOGIA CLINICA(临床病理部门)
A multi-institutional pediatric dataset of clinical radiology MRIs by the Children's Brain Tumor Network
Children’s Hospital of Philadelphia(费城儿童医院);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院);National Cancer Institute(美国国家癌症研究所);Children's National Hospital(儿童国家医院);Sheikh Zayed Institute for Pediatric Surgical Innovation(谢赫扎耶德儿科外科创新研究院)
The Brain Tumor Segmentation (BraTS) Challenge 2023: Focus on Pediatrics (CBTN-CONNECT-DIPGR-ASNR-MICCAI BraTS-PEDs)
Center for Data-Driven Discovery in Biomedicine (D3b), Children’s Hospital of Philadelphia(费城儿童医院生物医学数据驱动发现中心);University of Pennsylvania(宾夕法尼亚大学);Center for AI & Data Science for Integrated Diagnostics (AI2D)(综合诊断人工智能与数据科学中心);Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania(宾夕法尼亚大学生物医学图像计算与分析中心);Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital(儿童医院谢赫·扎耶德儿科外科创新研究所);Thomas Jefferson University Hospital(托马斯杰斐逊大学医院);Sage Bionetworks;Montreal Neurological Institute (MNI), McGill University(麦吉尔大学蒙特利尔神经学研究所);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院);University of Southern California(南加州大学);Duke University Medical Center(杜克大学医学中心);Mayo Clinic(梅奥诊所);Center for Global Health, Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院全球健康中心);Technical University of Munich(慕尼黑工业大学);TranslaTUM - Central Institute for Translational Cancer Research, Technical University of Munich(慕尼黑工业大学转化肿瘤学研究中心(TranslaTUM));National Cancer Institute(美国国家癌症 Institute)
Mechanistic Learning with Guided Diffusion Models to Predict Spatio-Temporal Brain Tumor Growth
ETH Zurich, 8092 Zurich, Switzerland - SIB Swiss Institue of Bioinformatics, 1015 Lausanne, Switzerland Department of Radiation Oncology, Inselspital, Bern University Hospital;University of Bern, Switzerland Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Medical Center, Washington, DC 20010, United States University of California San Francisco, San Francisco, CA 94143, United States University Children's Hospital Zurich, 8008 Zurich, Switzerland
University of São Paulo(圣保罗大学);Instituto da Criança – HC-FM(儿童研究所——医学院附属医院)
The importance of imaging exams, such as Magnetic Resonance Imaging (MRI), for the diagnostic and follow-up of pediatric pathologies and the assessment of anatomical structures' development has been increasingly highlighted in recent times. Manual analysis of MRIs is time-consuming, subjective, and requires significant expertise. To mitigate this, automatic techniques are necessary. Most techniques focus on adult subjects, while pediatric MRI has specific challenges such as the ongoing anatomical and histological changes related to normal development of the organs, reduced signal-to-noise rati…
Adaptable Segmentation Pipeline for Diverse Brain Tumors with Radiomic-Guided Subtyping and Lesion-Wise Model Ensemble
Sheikh Zayed Institute for Pediatric Surgical Innovation(Sheikh Zayed儿童外科创新研究所);Children’s National Hospital(儿童医院);University of Washington(华盛顿大学);Universidad Politécnica de Madrid(马德里理工大学);CIBER-BBN;ISCIII;School of Medicine and Health Sciences(医学与健康科学学院)
HD-TTA: Hypothesis-Driven Test-Time Adaptation for Safer Brain Tumor Segmentation
Institute for Digital Molecular Analytics and Science(数字分子分析与科学研究所);Nanyang Technological University(南洋理工大学);School of Electrical and Electronic Engineering(电气与电子工程学院)
Towards Label-Free Brain Tumor Segmentation: Unsupervised Learning with Multimodal MRI
Universitat Politècnica de Catalunya (UPC)(西班牙巴塞罗那理工大学);University College Dublin (UCD)(都柏林大学);Dublin City University (DCU)(都柏林城市大学);Insight Research Ireland Center For Data Analytics(爱尔兰数据分析研究中心)
Model Ensemble for Brain Tumor Segmentation in Magnetic Resonance Imaging
Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital(谢赫·扎耶德儿科外科创新研究所,儿童国家医院);CIBER-BBN, ISCIII(西班牙生物医学研究中心-生物工程、生物材料与纳米医学分部,卡洛斯三世卫生研究所);Princeton University(普林斯顿大学);School of Medicine and Health Sciences, George Washington University(乔治·华盛顿大学医学与健康科学学院)
In the U.S, 5-10\% of new pediatric cases of cancer are primary bone tumors. The most common type of primary malignant bone tumor is osteosarcoma. The intention of the present work is to improve the detection and diagnosis of osteosarcoma using computer-aided detection (CAD) and diagnosis (CADx). Such tools as convolutional neural networks (CNNs) can significantly decrease the surgeon's workload and make a better prognosis of patient conditions. CNNs need to be trained on a large amount of data in order to achieve a more trustworthy performance. In this study, transfer learning techniques, pre…
Rapid Bone Scintigraphy Enhancement via Semantic Prior Distillation from Segment Anything Model
Department of Nuclear Medicine, Shanghai Children’s Hospital, School of Medicine, Shanghai Jiao Tong University(核医学科,上海儿童医学中心,上海交通大学医学院);School of Microelectronics, Shanghai University(微电子学院,上海大学);Department of Ophthalmology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(眼科,瑞金医院,上海交通大学医学院);Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology(电子与计算机工程系,香港科学与技术大学);School of Software Engineering, Sun Yat-sen University(软件工程学院,中山大学);College of Computer Science and Electronic Engineering, Hunan University(计算机科学与电子工程学院,湖南大学);School of Computer Science and Technology, Henan Polytechnic University(计算机科学与技术学院,河南理工大学)
本文首次将 SAM 语义先验引入医学图像恢复,通过级联网络和三个语义模块增强儿科快速骨闪烁显像,并构建首个专用数据集 RBS,在多项指标上优于现有方法。
TissUnet: Improved Extracranial Tissue and Cranium Segmentation for Children through Adulthood
Mass General Brigham(麻省总医院布列根医疗系统);Harvard Medical School(哈佛医学院);Dana-Farber Cancer Institute(丹娜-法伯癌症研究所);Brigham and Women’s Hospital(布列根和妇女医院);Maastricht University(马斯特里赫特大学);Boston Children's Hospital(波士顿儿童医院);George Washington School of Medicine and Health Sciences(乔治华盛顿大学医学与健康科学学院);University of California, San Francisco(加州大学旧金山分校);Ludwig Maximilian University of Munich(慕尼黑大学);Ukrainian Catholic University(乌克兰天主教大学);The Children’s Hospital of Philadelphia(费城儿童医院);Penn Medicine(宾夕法尼亚大学医学中心);University of Pennsylvania(宾夕法尼亚大学);UT Southwestern Medical Center(德克萨斯大学西南医学中心)