Accurately modeling the spatiotemporal evolution of tumor morphology from baseline imaging is a pre-requisite for developing digital twin frameworks that can simulate disease progression and treatment response. Most existing approaches primarily characterize tumor growth while neglecting the concomitant alterations in adjacent anatomical structures. In reality, tumor evolution is highly non-linear and heterogeneous, shaped not only by therapeutic interventions but also by its spatial context and interaction with neighboring tissues. Therefore, it is critical to model tumor progression in conjunction with surrounding anatomy to obtain a comprehensive and clinically relevant understanding of disease dynamics. We introduce a mathematically grounded framework that unites mechanistic partial differential equations with differentiable deep learning. Anatomy is represented as a multi-class probability field on the simplex and evolved by a cross-diffusion reaction-diffusion system that enforces inter-class competition and exclusivity. A differentiable implicit-explicit scheme treats stiff diffusion implicitly while handling nonlinear reaction and event terms explicitly, followed by projection back to the simplex. To further enhance global plausibility, we introduce a topology regularizer that simultaneously enforces centerline preservation and penalizes region overlaps. The approach is validated on synthetic datasets and a clinical dataset. On synthetic benchmarks, our method achieves state-of-the-art accuracy while preserving topology, and also demonstrates superior performance on the clinical dataset. By integrating PDE dynamics, topology-aware regularization, and differentiable solvers, this work establishes a principled path toward anatomy-to-anatomy generation for digital twins that are visually realistic, anatomically exclusive, and topologically consistent.
Towards Unifying Anatomy Segmentation: Automated Generation of a Full-body CT Dataset via Knowledge Aggregation and Anatomical Guidelines
Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院人机交互与机器人学研究所);Institute for AI in Medicine, University Hospital Essen(埃森大学医院医学人工智能研究所);Steinbuch Center for Computing, Karlsruhe Institute of Technology (KIT)(卡尔斯鲁厄理工学院(KIT)施泰因布赫计算中心);Department of Medical Physics in Radiation Oncology, German Cancer Research Center (DKFZ)(德国癌症研究中心(DKFZ)放射肿瘤学医学物理科);Heidelberg Institute of Radiation Oncology (HIRO)(海德堡放射肿瘤学研究所(HIRO));National Center for Radiation Research in Oncology (NCRO)(国家肿瘤放射研究中心(NCRO));Helmholtz Information and Data Science School for Health (HIDSS4Health)(亥姆霍兹健康信息与数据科学学院(HIDSS4Health));Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen(埃森大学医院诊断与介入放射学及神经放射学系)
Scientific Computing and Imaging Institute, University of Utah(犹他大学科学计算与成像研究所);School of Computing, University of Utah(犹他大学计算学院)
Statistical shape modeling is an essential tool for the quantitative analysis of anatomical populations. Point distribution models (PDMs) represent the anatomical surface via a dense set of correspondences, an intuitive and easy-to-use shape representation for subsequent applications. These correspondences are exhibited in two coordinate spaces: the local coordinates describing the geometrical features of each individual anatomical surface and the world coordinates representing the population-level statistical shape information after removing global alignment differences across samples in the …
ASCON: Anatomy-aware Supervised Contrastive Learning Framework for Low-dose CT Denoising
Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University(复旦大学类脑智能科学与技术研究院);School of Cyber Science and Engineering, Sichuan University(四川大学网络空间安全学院)
AG-CRC: Anatomy-Guided Colorectal Cancer Segmentation in CT with Imperfect Anatomical Knowledge
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Digital Medicine Innovation Center(上海数字医学创新中心);Ruijin Hospital(瑞金医院);Shanghai Jiao Tong University School of Medicine(上海交通大学医学院)
BrainNormalizer: Anatomy-Informed Pseudo-Healthy Brain Reconstruction from Tumor MRI via Edge-Guided ControlNet
University of Pittsburgh(匹兹堡大学);Georgia Institute of Technology(佐治亚理工学院);University of Texas at Austin(德克萨斯大学奥斯汀分校);Cedars-Sinai Medical Center(西德萨斯医疗中心);Mayo Clinic Arizona(梅奥诊所亚利桑那分部)
We present GAAF, a Generalised Automatic Anatomy Finder, for the identification of generic anatomical locations in 3D CT scans. GAAF is an end-to-end pipeline, with dedicated modules for data pre-processing, model training, and inference. At it's core, GAAF uses a custom a localisation convolutional neural network (CNN). The CNN model is small, lightweight and can be adjusted to suit the particular application. The GAAF framework has so far been tested in the head and neck, and is able to find anatomical locations such as the centre-of-mass of the brainstem. GAAF was evaluated in an open-acces…
Bangladesh University of Engineering and Technology(孟加拉国工程技术大学);Georgia Institute of Technology(佐治亚理工学院)
Thoracic disease detection from chest radiographs using deep learning methods has been an active area of research in the last decade. Most previous methods attempt to focus on the diseased organs of the image by identifying spatial regions responsible for significant contributions to the model's prediction. In contrast, expert radiologists first locate the prominent anatomical structures before determining if those regions are anomalous. Therefore, integrating anatomical knowledge within deep learning models could bring substantial improvement in automatic disease classification. Motivated by …
seg2med: a bridge from artificial anatomy to multimodal medical images
Computer Assisted Clinical Medicine, Medical Faculty Mannheim, Heidelberg University(计算机辅助临床医学,曼海姆医学院,海德堡大学);Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg(模式识别实验室,埃尔兰根-纽伦堡弗里德里希-亚历山大大学);Department of Radiology and Nuclear Medicine, University Medical Center Mannheim(放射学与核医学系,曼海姆大学医学中心);Mannheim Institute for Intelligent Systems in Medicine, Medical Faculty Mannheim, Heidelberg University(曼海姆智能医学研究所,曼海姆医学院,海德堡大学);Optical Bioimaging Laboratory, Department of Biomedical Engineering, College of Design and Engineering, National University of Singapore(光学生物成像实验室,生物医学工程系,设计与工程学院,新加坡国立大学)
Two-View Topogram-Based Anatomy-Guided CT Reconstruction for Prospective Risk Minimization
Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU)(埃尔朗根-纽伦堡大学模式识别实验室);Division of X-Ray Imaging and Computed Tomography, German Cancer Research Center (DKFZ)(德国癌症研究中心X射线成像与计算机断层扫描部门);Department of Physics and Astronomy, Ruprecht-Karls-University Heidelberg(海德堡大学物理与天文学系);Department of Radiation Oncology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU)(埃尔朗根-纽伦堡大学埃尔朗根大学医院放射肿瘤科);Department of Radiology and Nuclear Medicine, Klinikum Nürnberg, Paracelsus Medical University(帕拉塞尔苏斯医科大学纽伦堡医院放射与核医学科)
MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Images
Boston University(波士顿大学);Stanford University(斯坦福大学);Carnegie Mellon University(卡内基梅隆大学);University of Pittsburgh Medical Center(匹兹堡大学医学中心);University of Pittsburgh(匹兹堡大学)
We hypothesize that probabilistic voxel-level classification of anatomy and malignancy in prostate MRI, although typically posed as near-identical segmentation tasks via U-Nets, require different loss functions for optimal performance due to inherent differences in their clinical objectives. We investigate distribution, region and boundary-based loss functions for both tasks across 200 patient exams from the publicly-available ProstateX dataset. For evaluation, we conduct a thorough comparative analysis of model predictions and calibration, measured with respect to multi-class volume segmentat…
UltraTwin: Towards Cardiac Anatomical Twin Generation from Multi-view 2D Ultrasound
National-Regional Key Technology Engineering Laboratory for Medical Ultrasound(医学超声关键技术研发实验室);School of Biomedical Engineering, Medical School, Shenzhen University(生物医学工程学院);Faculty of Applied Sciences, Macao Polytechnic University(应用科学学院);Centre for CIMIM, Manchester University(CIMIM研究中心);Center for Cardiovascular Disease(心血管疾病中心);The Affiliated Suzhou Hospital of Nanjing Medical University(南京医科大学附属苏州医院);Suzhou Municipal Hospital, Gusu School, Suzhou, China(苏州 municipal 医院);The First Affiliated Hospital of Kunming Medical University(昆明医科大学第一附属医院);The First Affiliated Hospital of Anhui Medical University North(安徽医科大学北院);The Second People’s Hospital(第二人民医院);The First Affiliated Hospital of Anhui Medical University(安徽医科大学第一附属医院);The People's Hospital of Tongren City(铜仁市人民医院);The First People's Hospital of Taicang City(太仓市第一人民医院);Guangdong Provincial People’s Hospital(广东省人民医院)
Magnetic Resonance Imaging (MRI) plays an important role in diagnosing the parotid tumor, where accurate segmentation of tumors is highly desired for determining appropriate treatment plans and avoiding unnecessary surgery. However, the task remains nontrivial and challenging due to ambiguous boundaries and various sizes of the tumor, as well as the presence of a large number of anatomical structures around the parotid gland that are similar to the tumor. To overcome these problems, we propose a novel anatomy-aware framework for automatic segmentation of parotid tumors from multimodal MRI. Fir…
F2PASeg: Feature Fusion for Pituitary Anatomy Segmentation in Endoscopic Surgery
1Centre for Artificial Intelligence;Robotics, Hong Kong Institute of Science \& Innovation, Chinese Academy of Sciences 2The University of Hong Kong 3Peking Union Medical College Hospital, Chinese Academy of Medical Science
Deep Learning-Based Cross-Anatomy CT Synthesis Using Adapted nnResU-Net with Anatomical Feature Prioritized Loss
Univ. Bordeaux, CNRS, LaBRI, UMR 5800, F-33400 Talence, France(波尔多大学,法国国家科学研究中心,LaBRI研究院,UMR 5800);Universidad Autónoma de Madrid, Madrid, 28049, Spain(马德里自治大学,西班牙);Pazmany Peter Catholic University, Budapest, 1083, Hungary(佩斯大学,匈牙利);RIKEN Center for Integrative Medical Sciences, Medical Data Deep Learning Team, Tokyo, Japan(日本再生医学科学中心,医学数据深度学习团队)
CADS: A Comprehensive Anatomical Dataset and Segmentation for Whole-Body Anatomy in Computed Tomography
Department of Quantitative Biomedicine, University of Zurich(定量生物医学系,苏黎世大学);ETH AI Center, ETH Zurich(ETH人工智能中心,苏黎世联邦理工学院);Department of Radiation Oncology, University Hospital and University of Zurich(放射肿瘤科,苏黎世大学医院和苏黎世大学);Faculty of Medicine, University of Zurich(医学系,苏黎世大学);Department of Neurology and Clinical Neuroscience Center, University Hospital Zurich and University of Zurich(神经科和临床神经科学中心,苏黎世大学医院和苏黎世大学);International School of Medicine, Istanbul Medipol University(国际医学院,伊斯坦布尔Medipol大学);School of Computation, Information and Technology, Technical University of Munich(计算、信息与技术学院,慕尼黑技术大学);Department of Diagnostic and Interventional Neuroradiology, School of Medicine and Health, Technical University of Munich(诊断与介入神经放射科,医学与健康学院,慕尼黑技术大学);Department of Radiation Oncology, TUM University Hospital Rechts der Isar, TUM School of Medicine and Health, Technical University of Munich(放射肿瘤科,慕尼黑技术大学医院Rechts der Isar,慕尼黑技术大学医学与健康学院);Institute of Radiation Medicine (IRM), Helmholtz Zentrum München (HMGU)(放射医学研究所(IRM),亥姆霍兹慕尼黑研究中心(HMGU));German Consortium for Translational Cancer Research (DKTK), Partner Site Munich, Munich, Germany(德国转化癌症研究联盟(DKTK),慕尼黑分部,德国);University Hospital Essen, Institute of Interventional and Diagnostic Radiology and Neuroradiology(埃森大学医院,介入与诊断放射学及神经放射学研究所);University Hospital Essen, Institute for Artificial Intelligence in Medicine(埃森大学医院,医学人工智能研究所);Institute of Diagnostic and Interventional Radiology, Pediatric Radiology and Neuroradiology, University Medical Center Rostock(诊断与介入放射学、儿童放射学及神经放射学研究所,罗斯托克大学医学中心);Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna(生物医学成像与图像引导治疗系,维也纳医科大学);Department of Radiology, University Hospital Basel(放射科,巴塞尔大学医院);Department of Radiology, Cambridge University Hospitals NHS Foundation Trust(放射科,剑桥大学医院 NHS 基础信托);Labelata GmbH(Labelata 公司);Visual and Data-Centric Computing, Zuse Institute Berlin (ZIB)(视觉与数据导向计算,柏林 Zuse 研究所(ZIB));Brigham and Women’s Hospital(布里格姆和女性医院)
Shanghai Jiao Tong University(上海交通大学);Peking Union Medical College Hospital(北京协和医院)
The segmentation of coronary arteries by convolutional neural network is promising yet requires a large amount of labor-intensive manual annotations. Transferring knowledge from retinal vessels in widely-available public labeled fundus images (FIs) has a potential to reduce the annotation requirement for coronary artery segmentation in X-ray angiograms (XAs) due to their common tubular structures. However, it is challenged by the cross-anatomy domain shift due to the intrinsically different vesselness characteristics in different anatomical regions under even different imaging protocols. To so…
Anatomy-constrained modelling of image-derived input functions in dynamic PET using multi-organ segmentation
Department of diagnostic and interventional Radiology and Neuroradiology, University Hospital Augsburg(诊断与介入放射学及神经放射学系,奥格斯堡大学医院);Computer-Aided Medical Procedures and Augmented Reality, Technical University of Munich(计算机辅助医疗程序与增强现实,慕尼黑技术大学);Digital Medicine, University Hospital Augsburg(数字医学,奥格斯堡大学医院);Center of Advanced Analytics and Predictive Sciences, University of Augsburg(高级分析与预测科学中心,奥格斯堡大学)
Department of Biomedical Engineering, Yale University(耶鲁大学生物医学工程系);Department of Radiology & Biomedical Imaging, Yale School of Medicine(耶鲁大学医学院放射科与生物医学成像系);Department of Electrical Engineering, Yale University(耶鲁大学电气工程系);Department of Statistics & Data Science, Yale University(耶鲁大学统计与数据科学系);Yale School of Medicine(耶鲁大学医学院)
Domain Adaptation (DA) has the potential to greatly help the generalization of deep learning models. However, the current literature usually assumes to transfer the knowledge from the source domain to a specific known target domain. Domain Agnostic Learning (DAL) proposes a new task of transferring knowledge from the source domain to data from multiple heterogeneous target domains. In this work, we propose the Domain-Agnostic Learning framework with Anatomy-Consistent Embedding (DALACE) that works on both domain-transfer and task-transfer to learn a disentangled representation, aiming to not o…
Anatomy-Informed Deep Learning and Radiomics for Automated Neurofibroma Segmentation in Whole-Body MRI
Institute for Applied Medical Informatics(应用医学信息学研究所);Institute of Computational Neuroscience(计算神经科学研究所);Center for Biomedical Artificial Intelligence (bAIome)(生物医学人工智能中心);University Medical Center Hamburg-Eppendorf(汉堡埃彭多夫大学医学中心);Department of Diagnostic and Interventional Radiology and Nuclear Medicine(诊断与介入放射学及核医学部门);Department of Neurology(神经内科部门)