Radiotherapy continues to become more precise and data dense, with current treatment regimens generating high frequency imaging and dosimetry streams ideally suited for AI driven temporal modeling to characterize how normal tissues evolve with time. Each fraction in biologically guided radiotherapy(BGRT) treated non small cell lung cancer (NSCLC) patients records new metabolic, anatomical, and dose information. However, clinical decision making is largely informed by static, population based NTCP models which overlook the dynamic, unique biological trajectories encoded in sequential data. We developed COMPASS (Comprehensive Personalized Assessment System) for safe radiotherapy, functioning as a temporal digital twin architecture utilizing per fraction PET, CT, dosiomics, radiomics, and cumulative biologically equivalent dose (BED) kinetics to model normal tissue biology as a dynamic time series process. A GRU autoencoder was employed to learn organ specific latent trajectories, which were classified via logistic regression to predict eventual CTCAE grade 1 or higher toxicity. Eight NSCLC patients undergoing BGRT contributed to the 99 organ fraction observations covering 24 organ trajectories (spinal cord, heart, and esophagus). Despite the small cohort, intensive temporal phenotyping allowed for comprehensive analysis of individual dose response dynamics. Our findings revealed a viable AI driven early warning window, as increasing risk ratings occurred from several fractions before clinical toxicity. The dense BED driven representation revealed biologically relevant spatial dose texture characteristics that occur before toxicity and are averaged out with traditional volume based dosimetry. COMPASS establishes a proof of concept for AI enabled adaptive radiotherapy, where treatment is guided by a continually updated digital twin that tracks each patients evolving biological response.
Magnetic resonance delta radiomics to track radiation response in lung tumors receiving stereotactic MRI-guided radiotherapy
Mass General Brigham(麻省总医院布里格姆医疗系统);Harvard Medical School(哈佛医学院);Dana-Farber Cancer Institute(丹娜-法伯癌症研究所);Harvard T.H. Chan School of Public Health(哈佛大学陈曾熙公共卫生学院);Maastricht University(马斯特里赫特大学)
Prediction of the motion of chest internal points using a recurrent neural network trained with real-time recurrent learning for latency compensation in lung cancer radiotherapy
The University of Tokyo(东京大学);National Institute for Quantum and Radiological Science and Technology(国立量子与放射科学技术研究所)
在肺癌患者的放射治疗期间,需要最小化递送到肿瘤周围的健康组织的辐射,由于呼吸运动和线性加速器系统的延迟,这是困难的。在这项研究中,我们首先使用Lucas-Kanade金字塔光流算法进行变形图像配准的胸部计算机断层扫描图像的四个肺癌患者。然后,我们根据先前计算的变形场跟踪靠近肺肿瘤的三个内部点,并使用使用实时递归学习(RTRL)和梯度裁剪训练的递归神经网络(RNN)预测它们的位置。呼吸数据是相当规则的,以大约2.5Hz采样,并且包括脊柱方向上的人工漂移。追踪点的运动幅度范围为12.0 mm ~ 22.7 mm。最后,我们提出了一种简单的方法,用于恢复和预测三维肿瘤图像的跟踪点和初始肿瘤图像的基础上的线性对应模型和Nadaraya-Watson非线性回归。测试集上RNN预测对应的均方根误差,最大误差和抖动小于线性预测和最小均方(LMS)获得的相同性能指标。特别地,与RNN相关联的最大预测误差等于1.51mm,分别比与线性预测和LMS相关联的最大误差低16.1%和5.0%。RTRL的每个时间步长的平均预测时间等于119 ms,这小于400 ms标记位置采样时间。预测图像中的肿瘤位置在视觉上看起来是正确的,这通过原始图像和预测图像之间的高平均互相关(等于0.955)来确认。
Prediction of the Position of External Markers Using a Recurrent Neural Network Trained With Unbiased Online Recurrent Optimization for Safe Lung Cancer Radiotherapy
The University of Tokyo(东京大学);Japan Atomic Energy Commission(日本原子能委员会);National Institutes for Quantum and Radiological Science and Technology(日本量子科学技术研究开发机构)
Oriented histogram-based vector field embedding for characterizing 4D CT data sets in radiotherapy
Institute for Applied Medical Informatics, University Medical Center Hamburg-Eppendorf(汉堡埃彭多夫大学医学中心应用医学信息学研究所);Institute of Computational Neuroscience, University Medical Center Hamburg-Eppendorf(汉堡埃彭多夫大学医学中心计算神经科学研究所);Department of Radiotherapy and Radiation Oncology, University Medical Center Hamburg-Eppendorf(汉堡埃彭多夫大学医学中心放射治疗与放射肿瘤学系)
Continuous sPatial-Temporal Deformable Image Registration (CPT-DIR) for motion modelling in radiotherapy: beyond classic voxel-based methods
Center for Proton Therapy, Paul Scherrer Institut(保罗·施特格研究所质子治疗中心);Department of Computer Science, ETH Zürich(苏黎世联邦理工学院计算机科学系);Department of Physics, ETH Zürich(苏黎世联邦理工学院物理系);Department of Automation, Tsinghua Univeristy(清华大学自动化系);S-Lab, Nanyang Technological University(南洋理工大学S实验室)
Longitudinal NSCLC Treatment Progression via Multimodal Generative Models
Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma, Italy(人工智能与计算机系统单位,工程系,罗马大学生物医学学院);Multi-Specialist Clinical Institute for Orthopaedic Trauma Care (COT), Messina, Italy(骨科创伤护理多学科临床研究所(COT),意大利Messina);Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering, Umeå University, Sweden(诊断与介入系,放射物理,生物医学工程,乌梅大学,瑞典);Operative Research Unit of Radiation Oncology, Fondazione Policlinico Universitario Campus Bio-Medico, Rome, Italy(放射肿瘤手术研究单位,大学生物医学学院基金会,罗马,意大利);Research Unit of Radiation Oncology, Department of Medicine and Surgery, Università Campus Bio-Medico di Roma, Italy(放射肿瘤研究单位,医学与外科系,罗马大学生物医学学院,意大利);Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland(生物医学工程系,巴塞尔大学,瑞士Allschwil);Department of Naval, Electrical, Electronics and Telecommunications Engineering, University of Genoa, Italy(海军、电气、电子与电信工程系,热那亚大学,意大利)
Transformer-based cardiac substructure segmentation from contrast and non-contrast computed tomography for radiotherapy planning
Memorial Sloan Kettering Cancer Center(纪念斯隆·凯特琳癌症中心);Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg(弗莱堡大学医学院大学医学中心);German Cancer Consortium (DKTK)(德国癌症联盟(DKTK))
A Patient-Specific Pulmonary Arterial Tree Digital Twin to Extract Pulmonary Embolism Biomarkers
Univ Lyon, INSA‐Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1294(里昂大学、里昂国立应用科学学院、 Claude Bernard 里昂大学、 UJM-圣艾蒂安、 CNRS、 Inserm、 CREATIS UMR 5220、 U1294);Department of Radiology, CHU Saint-Etienne, UJM Saint-Etienne, Saint-Etienne, France(放射科、圣艾蒂安大学医院、 UJM-圣艾蒂安、圣艾蒂安、法国);IUF, Institut Universitaire de France, Paris(IUF、法国国家科学院、巴黎)
Biophysics-Enhanced Neural Representations for Patient-Specific Respiratory Motion Modeling
German Research Center for Artificial Intelligence (DFKI), Lübeck, DE(德国人工智能研究中心(DFKI),吕贝克,德国);Institute of Medical Informatics, University of Lübeck(吕贝克大学医学信息学研究所);Clinic for Orthopedics and Orthopedic Surgery, University Medicine Greifswald(格里夫斯瓦尔德大学医学中心骨科与骨科手术诊所)