arXivDaily arXiv每日学术速递 周一至周五更新

科学与医疗

医学 AI

医学智能、临床 AI、医学影像、病理、诊断和医疗健康大模型。

至 收录 42861 信号源:cs.CV, cs.LG, q-bio, eess.IV, eess.SP
2608.00508 2026-08-04 cs.CV cs.AI cs.LG 新提交 95%

RadYOLO: Computationally Efficient 3D Object Detection and Segmentation in CT and MRI

RadYOLO:面向CT和MRI的计算高效型3D目标检测与分割方法

Kai Geissler, Laurens Müller-Groh, Hans Meine

机构 * Fraunhofer Institute for Digital Medicine MEVIS(弗劳恩霍夫数字医学MEVIS研究所)

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn);medical image(abstract);分类 cs.CV、cs.LG

AI总结 本文提出针对医学图像的YOLO11 3D扩展模型RadYOLO,通过与nnU-Net、nnDetection在5个CT/MRI数据集上对比,证实其检测性能与推理速度均具优势,适配临床及边缘设备部署需求。

详情
AI中文摘要

三维医学图像的目标检测与分割是当前研究的热点领域。然而,多数已提出的深度学习模型计算成本高昂,且很少有模型能同时具备广泛适用性、高检测性能,以及在资源受限硬件上快速运行的能力。为解决这一缺口,本文提出RadYOLO,它是针对医学图像定制的YOLO11的3D扩展版本。我们在包含CT和MRI数据的5个数据集上,将其与nnU-Net和nnDetection进行对比,这些数据集涵盖不同目标尺寸和患病率。RadYOLO在5个数据集中的4个上,检测性能优于nnDetection,在剩余1个上表现相当;与nnU-Net相比,RadYOLO在病灶检测任务上表现更好,而当需要精确定位大器官时,nnU-Net更具优势;当仅需粗略目标定位时,RadYOLO在全部5个数据集上的表现与nnU-Net相当或更优。在GPU上,RadYOLO的推理速度比nnU-Net快8至46倍,相比nnDetection的速度提升更为显著;在CPU上运行时,RadYOLO的推理仅需数秒,仍比GPU上的nnU-Net更快,为临床应用和边缘设备部署提供了显著优势。RadYOLO的代码仓库可通过该URL访问。

英文摘要

Object detection and segmentation in three-dimensional medical images is a very active area of research. However, most proposed deep learning models carry a high computational cost, and only few aim to be broadly applicable, achieve high detection performance, and remain fast to execute on resource-constrained hardware. To address this gap, we present RadYOLO, a 3D extension of YOLO11 tailored to medical images. We compare it with nnU-Net and nnDetection on five datasets comprising CT and MRI data with varying object sizes and prevalence. RadYOLO's detection performance surpasses that of nnDetection on four of five datasets and is comparable on one. Compared to nnU-Net, RadYOLO performs better on lesion detection tasks, while nnU-Net excels at detecting large organs when precise localization is required. When rough object localization is sufficient, RadYOLO matches or outperforms nnU-Net on all five datasets. Regarding inference time, RadYOLO is 8-46x faster than nnU-Net on a GPU. Compared to nnDetection the speedup is even higher. When executed on a CPU, RadYOLO's inference runs within seconds (still faster than nnU-Net on a GPU) offering a significant advantage for clinical and edge-device deployment. RadYOLO repository: https://github.com/FraunhoferMEVIS/RadYOLO

URL PDF HTML 收藏
2602.05387 2026-07-28 cs.CV cs.LG 版本更新 95%

Parallel Swin Transformer-Enhanced 3D MRI-to-CT Synthesis for MRI-Only Radiotherapy Planning

并行Swin Transformer增强的3D MRI到CT合成用于仅MRI放疗规划

Zolnamar Dorjsembe, Hung-Yi Chen, Furen Xiao, Hsing-Kuo Pao

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn);biomedical(comments,journal_ref);分类 cs.CV、cs.LG

AI总结 本文提出并行Swin Transformer增强的Med2Transformer架构,通过结合卷积编码与双Swin Transformer分支,提高MRI到CT合成的图像质量和几何精度,实现仅MRI的放疗规划。

Comments This preprint has been accepted for publication in the proceedings of the IEEE 23rd International Symposium on Biomedical Imaging (ISBI 2026). The final published version is available at https://doi.org/10.1109/ISBI61048.2026.11515734. The copyright for this work has been transferred to IEEE

Journal ref Proceedings of the 23rd IEEE International Symposium on Biomedical Imaging (ISBI), 2026

详情
AI中文摘要

MRI提供了没有电离辐射的优异软组织对比度;然而,电子密度信息的缺失限制了其直接用于剂量计算。因此,当前的放疗工作流程依赖于结合MRI和CT的采集,增加了配准的不确定性和操作的复杂性。合成CT生成允许仅使用MRI进行规划,但仍然具有挑战性,因为MRI-CT关系是非线性的且解剖结构存在变异性。我们提出了一种并行Swin Transformer增强的Med2Transformer架构,该架构结合了卷积编码与双Swin Transformer分支,以建模局部解剖细节和长距离上下文依赖性。多尺度移位窗口注意力与分层特征聚合提高了解剖的保真度。在公共和临床数据集上的实验表明,与基线方法相比,图像相似性和几何精度得到了提高。剂量评估显示了临床可接受的性能,平均靶区剂量误差为1.69%。代码可在:https://github.com/mobaidoctor/med2transformer。

英文摘要

MRI provides superior soft tissue contrast without ionizing radiation; however, the absence of electron density information limits its direct use for dose calculation. As a result, current radiotherapy workflows rely on combined MRI and CT acquisitions, increasing registration uncertainty and procedural complexity. Synthetic CT generation enables MRI only planning but remains challenging due to nonlinear MRI-CT relationships and anatomical variability. We propose Parallel Swin Transformer-Enhanced Med2Transformer, a 3D architecture that integrates convolutional encoding with dual Swin Transformer branches to model both local anatomical detail and long-range contextual dependencies. Multi-scale shifted window attention with hierarchical feature aggregation improves anatomical fidelity. Experiments on public and clinical datasets demonstrate higher image similarity and improved geometric accuracy compared with baseline methods. Dosimetric evaluation shows clinically acceptable performance, with a mean target dose error of 1.69%. Code is available at: https://github.com/mobaidoctor/med2transformer.

URL PDF HTML 收藏
2512.03054 2026-07-20 cs.LG cs.AI cs.CV cs.DC physics.med-ph 版本更新 95%

Energy-Efficient Federated Learning via Adaptive Encoder Freezing for MRI-to-CT Conversion: A Green AI-Guided Research

通过用于MRI到CT转换的自适应编码器冻结实现节能联邦学习:一项绿色人工智能引导的研究

Ciro Benito Raggio, Lucia Migliorelli, Nils Skupien, Mathias Krohmer Zabaleta, Oliver Blanck, Francesco Cicone, Giuseppe Lucio Cascini, Paolo Zaffino, Maria Francesca Spadea

机构 * Institute of Biomedical Engineering(生物医学工程研究所) Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院) Department of Political Science(政治学系) Università Degli Studi Di Teramo(特拉莫大学) Department of Radiation Oncology(放射肿瘤学系) University Medical Center Schleswig-Holstein(什未林施瓦茨-霍斯特大学医院) Department of Experimental and Clinical Medicine(实验与临床医学系) Magna Graecia University(马格拉西亚大学)

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn);分类 cs.CV、cs.LG

AI总结 研究针对联邦学习资源需求大加剧医疗差距问题,提出面向绿色人工智能的自适应层冻结策略用于MRI到CT转换,通过监测编码器权重差异选择性冻结优化训练,降低能耗等,保持转换性能,为新型评估框架奠基。

Comments 22 pages, 13 figures

详情
AI中文摘要

联邦学习(FL)有潜力通过使不同机构协作训练深度学习(DL)模型来促进健康平等,即便数据有限。然而,FL对资源需求巨大,常将计算基础设施有限中心排除在外,加剧医疗差距。为解决此问题,我们提出一种面向绿色人工智能的自适应层冻结策略,旨在降低能耗和计算负载同时保持模型性能。我们用不同联邦架构对磁共振成像(MRI)到计算机断层扫描(CT)转换测试该方法。所提自适应策略基于监测到的编码器权重逐轮相对差异选择性冻结编码器权重来优化联邦训练。基于耐心的机制确保仅在更新持续极小时才冻结。用CodeCarbon库追踪联邦的能耗和二氧化碳当量排放。与等效非冻结对应物相比,我们的方法将训练时间、总能耗和二氧化碳当量排放最多降低23%。同时保持MRI到CT转换性能,平均绝对误差(MAE)仅有小变化。值得注意的是,在五个评估架构中的三个中未观察到统计学显著差异,而两个架构有统计学显著改进。我们的工作符合一种研究范式,即促进基于DL的框架满足临床要求同时确保气候、社会和经济可持续性。它为新型FL评估框架奠定基础,推进人工智能驱动医疗中的隐私、公平以及更广泛的正义。

英文摘要

Federated Learning (FL) holds the potential to advance equality in health by enabling diverse institutions to collaboratively train deep learning (DL) models, even with limited data. However, the significant resource requirements of FL often exclude centres with limited computational infrastructure, further widening existing healthcare disparities. To address this issue, we propose a Green AI-oriented adaptive layer-freezing strategy designed to reduce energy consumption and computational load while maintaining model performance. We tested our approach using different federated architectures for Magnetic Resonance Imaging (MRI)-to-Computed Tomography (CT) conversion. The proposed adaptive strategy optimises the federated training by selectively freezing the encoder weights based on the monitored relative difference of the encoder weights from round to round. A patience-based mechanism ensures that freezing only occurs when updates remain consistently minimal. The energy consumption and CO2eq emissions of the federation were tracked using the CodeCarbon library. Compared to equivalent non-frozen counterparts, our approach reduced training time, total energy consumption and CO2eq emissions by up to 23%. At the same time, the MRI-to-CT conversion performance was maintained, with only small variations in the Mean Absolute Error (MAE). Notably, for three out of the five evaluated architectures, no statistically significant differences were observed, while two architectures exhibited statistically significant improvements. Our work aligns with a research paradigm that promotes DL-based frameworks meeting clinical requirements while ensuring climatic, social, and economic sustainability. It lays the groundwork for novel FL evaluation frameworks, advancing privacy, equity and, more broadly, justice in AI-driven healthcare.

URL PDF HTML 收藏
2605.00923 2026-05-05 eess.IV cs.CV 95%

A Proof-of-Concept Study of Multitask Learning for Cranial Synthetic CT Generation Across Heterogeneous MRI Field Strengths

多任务学习在跨异质MRI场强的颅骨合成CT生成中的概念验证研究

Zhuoyao Xin, Yiren Zhang, Christopher Wu, Dong Liu, Chunming Gu, Elena Greco, Erik H. Middlebrooks, Jun Hua, Jia Guo

机构 * F.M. Kirby Research Center for Brain Imaging, Kennedy Krieger Institute(F.M. Kirby脑成像研究中心,Kennedy Krieger研究所) Neurosection, Division of MR Research, Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine(神经科,磁共振研究部,约翰·霍普金斯大学医学院放射学与放射科学系) Department of Biomedical Engineering, Johns Hopkins University(生物医学工程系,约翰·霍普金斯大学) Department of Biomedical Engineering, Case Western Reserve University(生物医学工程系,凯斯西储大学) Department of Biomedical Engineering, Columbia University(生物医学工程系,哥伦比亚大学) Department of Neuroscience, Columbia University(神经科学系,哥伦比亚大学) Department of Radiology, Mayo Clinic(放射科,梅奥诊所) Neuroradiology and Neurosurgery, Mayo Clinic College of Medicine and Science(神经放射学与神经外科,梅奥诊所医学院与科学学院)

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn);分类 cs.CV、eess.IV

AI总结 本文提出一种深度学习框架,用于在不同MRI场强和协议下实现稳定的颅骨合成CT生成,通过模块化结构提升鲁棒性,并在多中心数据集上验证了其优于传统方法的性能。

Comments Published in Medical Physics (2026). DOI: 10.1002/mp.70429

Journal ref Medical Physics, 53(5): e70429, 2026

详情
AI中文摘要

准确地从磁共振成像(MRI)生成计算层析成像(CT)图像在颅骨应用中具有临床价值,例如衰减校正、放疗计划和图像引导干预。然而,MRI场强和采集协议的异质性限制了现有方法的通用性。在本研究中,我们将颅骨CT合成视为一个模块化且结构耦合的问题,并提出了一种深度学习框架,以提高在异质MRI条件下的鲁棒性。该模型设计用于适应场强和成像协议的变化,同时保持解剖一致性。在多中心数据集上的实验表明,与传统方法相比,性能和泛化能力有所提高。所提出的方法在异质MRI设置中实现了可靠的CT合成,支持更广泛的临床应用。

英文摘要

Accurate synthesis of computed tomography (CT) images from magnetic resonance imaging (MRI) is clinically valuable for cranial applications such as attenuation correction, radiotherapy planning, and image-guided interventions. However, heterogeneity across MRI field strengths and acquisition protocols limits the generalizability of existing methods. In this study, we formulate cranial CT synthesis as a modular, structurally coupled problem and propose a deep learning framework to improve robustness across heterogeneous MRI conditions. The model is designed to adapt to variations in field strength and imaging protocols while preserving anatomical consistency. Experiments on multi-site datasets demonstrate improved performance and generalization compared with conventional approaches. The proposed method enables reliable CT synthesis across heterogeneous MRI settings, supporting broader clinical translation.

URL PDF HTML 收藏
2604.27654 2026-05-01 cs.CV 95%

MSR:Hybrid Field Modeling for CT-MRI Rigid-Deformable Registration of the Cervical Spine with an Annotated Dataset

MSR:用于带有标注数据集的颈椎脊柱CT-MRI刚-变形配准的混合场建模

Bohai Zhang, Wenjie Chen, Mu Li, Kaixing Long, Xing Shen, Xinqiang Yao, Jincheng Yang, Jianting Chen, Wei Yang, Qianjin Feng, Lei Cao

机构 * School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China.(南方医科大学生物医学工程学院) Guangdong Provincial Key Laboratory of Medical Image Processing, Guangzhou, 510515, China.(广东省医学图像处理重点实验室) Guangdong Province Engineering Laboratory for Medical Imaging(广东省医学影像与诊断技术工程实验室) Information Center, Nanfang Hospital, Southern Medical University, Guangzhou, 510515, China.(南方医科大学南华医院信息中心) Division of Spine Surgery, Department of Orthopaedics, Nanfang hospital, Southern Medical University, Guangzhou, Guangdong, 510515, China.(南方医科大学南华医院骨科脊柱外科)

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn);分类 cs.CV

AI总结 本文提出MSR框架,通过混合刚-变形配准方法提升颈椎脊柱CT-MRI配准精度,解决复杂结构配准难题。

详情
AI中文摘要

准确的CT-MRI颈椎脊柱配准对术前规划至关重要,因其解剖复杂、变异大且易伤椎动脉和脊髓。然而,颈椎CT-MRI配准研究有限,尤其在刚-变形混合建模方面,缺乏高质量多模态标注数据进一步限制了进展。为应对这些挑战,我们构建并发布了全面标注的CT-MRI数据集R-D-Reg,并提出MSR,一种用于复杂关节结构的刚-变形混合配准框架。具体而言,MSR包括用于独立局部刚性对齐单个椎体的刚性配准模块,以及结合基于Mamba的全局建模和基于Swin Transformer的局部建模的变形配准模块,通过自适应门控结合MSL块。然后将刚性和变形性形变场融合,生成更好的局部解剖一致性保持的混合场。代码和数据集可在https://github.com/ssc1230609-spec/MSR-registration公开获取。

英文摘要

Accurate CT-MRI registration of the cervical spine is essential for preoperative planning because this region is anatomically complex,highly variable,and vulnerable to injury of the vertebral arteries and spinal cord. However,cervical CT-MRI registration remains underexplored,particularly for rigid-deformable hybrid modeling,and the lack of high-quality annotated multimodal data further limits progress. To address these challenges, we construct and release a comprehensively annotated CT-MRI dataset, R-D-Reg, and propose MSR, a rigid-deformable hybrid registration framework for complex joint structures. Specifically, MSR includes a rigid registration module for independent local rigid alignment of individual vertebrae and a deformable registration module with an MSL block that combines Mamba-based global modeling and Swin Transformer-based local modeling through adaptive gating. The rigid and deformable deformation fields are then fused to generate a hybrid field that better preserves local anatomical consistency. The code and dataset are publicly available at https://github.com/ssc1230609-spec/MSR-registration.

URL PDF HTML 收藏
2510.04823 2026-04-24 cs.CV 95%

Flow Matching for Conditional MRI-CT and CBCT-CT Image Synthesis

基于流匹配的条件MRI-CT和CBCT-CT图像合成

Arnela Hadzic, Simon Johannes Joham, Martin Urschler

机构 * Institute for Medical Informatics, Statistics and Documentation(医学信息学、统计学与文档研究所)

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn);分类 cs.CV

AI总结 本文提出一种全3D流匹配框架,用于生成MRI或CBCT到CT的合成图像,通过轻量3D编码器提取输入特征,并在有限训练分辨率下实现全局结构重建,但细节能效有限。

Comments Published in the Proceedings of the Third Austrian Symposium on AI, Robotics, and Vision (AIRoV 2026)

详情
AI中文摘要

生成合成CT(sCT)从MRI或CBCT在MRI-only和CBCT适应性放疗中起关键作用。我们采用全3D流匹配(FM)框架,通过学习的FM速度场将高斯噪声体积转换为sCT图像,条件于输入MRI或CBCT提取的特征。在SynthRAD2025挑战基准上评估,分别训练MRI到sCT和CBCT到sCT模型,覆盖三个解剖区域:腹部、头颈和胸腔。验证和测试通过挑战提交系统进行。结果表明,该方法能准确重建全局解剖结构,但细节能效受限,主要由于内存和运行时间约束导致的较低训练分辨率。未来工作将探索基于块的训练和潜在空间流模型以提高分辨率和局部结构保真度。

英文摘要

Generating synthetic CT (sCT) from MRI or CBCT plays a crucial role in enabling MRI-only and CBCT-based adaptive radiotherapy, improving treatment precision while reducing patient radiation exposure. To address this task, we adopt a fully 3D Flow Matching (FM) framework, motivated by recent work demonstrating FM's efficiency in producing high-quality images. In our approach, a Gaussian noise volume is transformed into an sCT image by integrating a learned FM velocity field, conditioned on features extracted from the input MRI or CBCT using a lightweight 3D encoder. We evaluated the method on the SynthRAD2025 Challenge benchmark, training separate models for MRI to sCT and CBCT to sCT across three anatomical regions: abdomen, head and neck, and thorax. Validation and testing were performed through the challenge submission system. The results indicate that the method accurately reconstructs global anatomical structures; however, preservation of fine details was limited, primarily due to the relatively low training resolution imposed by memory and runtime constraints. Future work will explore patch-based training and latent-space flow models to improve resolution and local structural fidelity.

URL PDF HTML 收藏
2606.08065 2026-06-09 physics.med-ph 新提交 94%

The Role of Free-breathing GRASP MRI in Accurate Phase Matching with 4D-CT for Motion Representation in Liver Cancer Radiotherapy

自由呼吸GRASP MRI在肝癌放疗中与4D-CT精确相位匹配以表征运动中的作用

Junchao Li, Shengqi Chen, Guohua Wu, Jianrong Dai, Jiayun Chen, Fei Liu

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn)

AI总结 研究自由呼吸GRASP MRI能否代表肝癌立体定向放疗中的呼吸运动,发现其仅在30%-60%呼吸相位(最佳50%)准确表征运动,需结合4D-CT或动态成像。

Comments 25 pages, 4 figures

详情
AI中文摘要

目的:确定自由呼吸黄金角径向稀疏并行(GRASP)磁共振成像(MRI)能否代表接受立体定向体部放疗(SBRT)的肝脏恶性肿瘤患者的呼吸诱导器官运动。方法:对54例接受肝脏SBRT的患者进行回顾性分析。使用四维计算机断层扫描(4D-CT)——运动评估的金标准——来表征肝脏肿瘤运动。使用内部配准程序对自由呼吸GRASP MRI与4D-CT的每个呼吸相位进行图像融合,融合质量通过最大互相关系数(MCC)量化。验证涉及两名盲法放射肿瘤学家:一名使用Eclipse内置模块重复图像融合,另一名按五点量表评估临床相关性。结果:4D-CT的50%呼吸相位与GRASP MRI的融合质量最高,与30%(P=0.106)、40%(P=0.632)和60%(P=0.792)相位相比无显著差异。相反,超出中呼吸窗(30%-60%)后融合质量显著下降,在0%、10%、20%、80%和90%相位融合较差(P<0.001)。放射肿瘤学家的验证证实了这些发现,50%相位获得最高评分。30%-70%相位的主观评分保持在4以上,而其余相位的评分低于4。结论:自由呼吸GRASP MRI不能独立代表所有呼吸相位的器官运动;它仅在中呼吸相位(30%-60%)准确表征运动,在50%相位表现最佳。当作为肝脏SBRT的勾画标准时,GRASP MRI应与4D-CT或动态成像模式结合,以确保全面的运动评估和准确的靶区定义。

英文摘要

Objective: To determine whether free-breathing golden-angle radial sparse parallel (GRASP) magnetic resonance imaging (MRI) can represent respiratory-induced organ motion in patients with liver malignancies undergoing stereotactic body radiation therapy (SBRT). Methods: A retrospective analysis of 54 patients undergoing liver SBRT was conducted. Four-dimensional computed tomography (4D-CT), the gold standard for motion assessment, was used to characterize liver tumor motion. Image fusion was performed between free-breathing GRASP MRI and each respiratory phase of 4D-CT using an in-house registration program, with fusion quality quantified by maximum cross-correlation coefficient (MCC). Validation involved two blinded radiation oncologists: one repeated image fusion using the Eclipse-built-in module, while the other evaluated clinical relevance on a five-point scale. Results: The 50% respiratory phase of 4D-CT achieved the highest fusion quality with GRASP MRI, showing no significant differences compared to the 30% (P = 0.106), 40% (P = 0.632), and 60% (P = 0.792) phases. In contrast, fusion quality declined significantly beyond the mid-respiratory window (30%-60%), with poor fusion at the 0%, 10%, 20%, 80%, and 90% phases (P < 0.001). Validation by radiation oncologists corroborated these findings, with the 50% phase achieving the highest score. Subjective scores remained above 4 for phases 30%-70%, while scores for the remaining phases fell below 4. Conclusion: Free-breathing GRASP MRI cannot independently represent organ motion across all respiratory phases; it accurately characterizes motion only within the mid-respiratory phases (30%-60%), with optimal performance at the 50% phase. When used as a delineation standard in liver SBRT, GRASP MRI should be combined with 4D-CT or dynamic imaging modalities to ensure comprehensive motion assessment and accurate target volume definition.

URL PDF HTML 收藏
2606.23494 2026-06-23 cs.CV 新提交 93%

Brain-Adapter: A Dual-Stream Vision-Language MIL Framework for Comprehensive 3D CT Diagnosis of Acute Intracranial Pathologies

Brain-Adapter: 一种用于急性颅内病理综合3D CT诊断的双流视觉-语言MIL框架

Zhenyu Yi, Zhiyun Song, Yusong Sun, Zelin Liu, Manman Fei, Zhenhao Li, Jiaxuan Zhao, Xu Han, Lichi Zhang

机构 * School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院) Department of Computing, Imperial College London(伦敦帝国理工学院计算系)

专题命中 医学影像 :CT(title,title_cn);diagnosis(title,abstract);pathology(abstract);biomedical(abstract)

AI总结 提出Brain-Adapter双流多实例学习框架,利用预训练2D生物医学视觉-语言模型和原始诊断报告,通过文本条件注意力和不确定性感知融合实现3D CT扫描的多标签分类,无需密集标注。

Comments Accepted to MICCAI 2026

详情
AI中文摘要

3D脑CT扫描的自动诊断对重症监护至关重要,但由于严重依赖手动标注和传统模型语义理解有限,仍然具有挑战性。虽然2D基础视觉-语言模型(VLM)表现出显著的泛化能力,但如何有效地将其表征能力迁移到3D体积仍然是一个开放问题。本文提出Brain-Adapter,一种新颖的双流多实例学习(MIL)框架,利用预训练的2D生物医学VLM和原始诊断报告,实现稳健的扫描级多标签分类。具体地,我们引入文本条件注意力(TCA)机制,利用原始诊断句子作为语义查询,动态地将视觉线索与特定疾病概念对齐。同时,一个并行的视觉MIL流捕获全局扫描特征,并由通过大语言模型(LLM)提取的结构化标签进行监督。为确保表征一致性,一个一致性约束强制两个流之间的协同。在推理时,不确定性感知精化(UAR)模块动态校准并融合这些双流预测,以解决模糊病例。大量实验表明,我们的方法显著优于最先进的3D模型和标准MIL方法。通过消除对密集标注的依赖,Brain-Adapter为3D急性颅内病理分析提供了一种高度可扩展且临床可行的解决方案。

英文摘要

Automated diagnosis of 3D brain CT scans is essential for critical care, yet it remains challenging due to the heavy reliance on manual annotations and the limited semantic understanding of conventional models. While 2D foundation vision-language models (VLMs) have shown remarkable generalization, effectively transferring their representational power to 3D volumes remains an open problem. In this paper, we propose Brain-Adapter, a novel dual-stream multiple instance learning (MIL) framework that leverages pre-trained 2D biomedical VLMs and raw diagnostic reports for robust scan-level multi-label classification. Specifically, we introduce a Text-Conditioned Attention (TCA) mechanism, utilizing raw diagnostic sentences as semantic queries to dynamically align visual cues with specific disease concepts. Concurrently, a parallel visual MIL stream captures global scan characteristics, supervised by structured labels extracted via a Large Language Model (LLM). To ensure representation coherence, a consistency constraint enforces synergy between the two streams. During inference, an Uncertainty-Aware Refinement (UAR) module dynamically calibrates and fuses these dual-stream predictions to resolve ambiguous cases. Extensive experiments demonstrate that our method significantly outperforms state-of-the-art 3D models and standard MIL approaches. By eliminating the reliance on dense annotations, Brain-Adapter provides a highly scalable and clinically viable solution for 3D acute intracranial pathology analysis.

URL PDF HTML 收藏
2509.11924 2026-08-04 cs.CV cs.LG 交叉投稿 93%

Enriched text-guided variational multimodal knowledge distillation network (VMD) for automated diagnosis of plaque vulnerability in 3D carotid artery MRI

用于3D颈动脉MRI斑块易损性自动诊断的增强文本引导变分多模态知识蒸馏网络(VMD)

Bo Cao, Fan Yu, Mengmeng Feng, SenHao Zhang, Xin Meng, Yue Zhang, Zhen Qian, Jie Lu

机构 * department of Radiology and Nuclear Medicine, Xuanwu Hospital, Capital Medical University(放射医学与核医学科,宣武医院,首都医科大学) Beijing Key Laboratory of Magnetic Resonance Imaging and Brain Informatics(北京磁共振成像与脑信息学重点实验室) Beijing United Imaging Research Institute of Intelligent Imaging(北京智能成像联合研究院)

专题命中 医学影像 :MRI(title,title_cn);diagnosis(title,abstract);radiology(abstract);分类 cs.CV、cs.LG

AI总结 该研究针对3D颈动脉MRI斑块易损性自动诊断难题,提出VMD网络,利用跨模态先验知识提升未标注图像诊断准确率,经内部数据集实验验证其有效性。

详情
AI中文摘要

近年来,多模态学习因能有效利用不同模态的数据特征而备受关注。放射科医生和传统3D视觉网络直接从颈动脉3D MRI图像诊断动脉粥样硬化斑块易损性都颇具挑战。临床中,放射科医生采用整合多种成像模态和领域专业知识的多模态方法评估患者状况,为多模态诊断网络的构建奠定了基础。本文提出一种利用放射科医生领域知识的有效策略,通过变分推理与多模态知识蒸馏(Variation inference and Multimodal knowledge Distillation,VMD)实现颈动脉斑块易损性的自动诊断。该方法擅长从训练数据中有限的图像标注和放射报告中利用跨模态先验知识,从而提升未标注3D MRI图像诊断网络的准确率。我们在内部收集的数据集上开展了深入实验,验证了所提VMD策略的有效性。

英文摘要

Multimodal learning has attracted much attention in recent years due to its ability to effectively utilize data features from a variety of different modalities. Diagnosing the vulnerability of atherosclerotic plaques directly from carotid 3D MRI images is relatively challenging for both radiologists and conventional 3D vision networks. In clinical practice, radiologists assess patient conditions using a multimodal approach that incorporates various imaging modalities and domain-specific expertise, paving the way for the creation of multimodal diagnostic networks. In this paper, we have developed an effective strategy to leverage radiologists' domain knowledge to automate the diagnosis of carotid plaque vulnerability through Variation inference and Multimodal knowledge Distillation (VMD). This method excels in harnessing cross-modality prior knowledge from limited image annotations and radiology reports within training data, thereby enhancing the diagnostic network's accuracy for unannotated 3D MRI images. We conducted in-depth experiments on the dataset collected in-house and verified the effectiveness of the VMD strategy we proposed.

URL PDF HTML 收藏
2606.16991 2026-06-16 cs.CV cs.LG 新提交 93%

A Multi-Center Benchmark for Abdominal Disease Diagnosis and Report Generation from Non-Contrast CT

基于非增强CT的腹部疾病诊断与报告生成的多中心基准

Mariam Elbakry, Aliaa Sayed Sheha, Salma Hassan Tantawy, Aya Yassin, Concetto Spampinato, Karim Lekadir, Xiaomeng Li, Marawan Elbatel

机构 * Ain Shams University(艾因夏姆斯大学) The Hong Kong University of Science and Technology(香港科技大学) University of Catania(卡塔尼亚大学) Universitat de Barcelona(巴塞罗那大学)

专题命中 医学影像 :CT(title,title_cn);diagnosis(title,abstract);radiology(abstract);分类 cs.CV、cs.LG

AI总结 提出一个多中心基准,利用非增强CT合成增强CT发现,用于多器官腹部疾病诊断和自动报告生成,实验表明非增强CT保留诊断信号,平均AUC达69.1%(内部)和63.1%(外部)。

Comments Early Accept (top ~9%), MICCAI 2026

详情
AI中文摘要

多期增强CT(CECT)广泛用于腹部病变表征,但存在造影剂肾病风险、增加采集负担并加重放射科医生工作量。为解决这些问题,我们引入了一个新的多中心基准,用于多器官腹部疾病诊断和自动放射报告生成,该基准学习从单期非增强CT(NCCT)合成增强CT发现。为此,我们从两个中心收集了配对NCCT-CECT研究及其对应的增强放射报告的大规模数据集,分为内部集和外部验证队列。在统一评估协议下,我们对五种当代深度学习架构进行了基准测试,涵盖胸部专用、腹部专用和通用多模态领域。大量实验表明,NCCT保留了诊断信号,在内部队列和外部队列上分别实现了平均多器官AUC 69.1%和63.1%。通过公开发布该数据集和标准化基准,本研究旨在促进未来对更安全、资源高效且全球可及的免造影腹部成像工作流程的研究。代码地址:https://github.com/xmed-lab/TriALS-Report。

英文摘要

Multiphasic contrast-enhanced CT (CECT) is widely used for abdominal lesion characterization, yet it carries inherent risks of contrast-induced nephropathy, escalates acquisition burden, and heavily contributes to radiologist workload. To address these challenges, we introduce a novel multi-center benchmark for multi-organ abdominal disease diagnosis and automated radiology report generation, which learns to synthesize contrast-enhanced findings from single-phase non-contrast CT (NCCT). To support this, we curated a large-scale dataset of paired NCCT-CECT studies and their corresponding contrast-enhanced radiology reports from two centers, partitioned into internal sets and an external validation cohort. Under a unified evaluation protocol, we benchmarked five contemporary deep learning architectures encompassing chest-specific, abdomen-specific, and general-purpose multimodal domains. Extensive experiments demonstrate that NCCT retains diagnostic signals, achieving an average multi-organ AUC of 69.1% on the internal cohort and 63.1% on the external cohort, respectively. By releasing this dataset and standardized benchmark publicly, this study aims to catalyze future research into safer, resource-efficient, and globally accessible contrast-free abdominal imaging workflows. Code is available at: https://github.com/xmed-lab/TriALS-Report.

URL PDF HTML 收藏
2406.12632 2026-04-16 eess.IV cs.CV 93%

Cyclic 2.5D Perceptual Loss for Cross-Modal 3D Medical Image Synthesis: T1w MRI to Tau PET

循环2.5D感知损失用于跨模态3D医学图像合成:T1加权MRI到tau PET

Junho Moon, Symac Kim, Haejun Chung, Ikbeom Jang

机构 * Department of Artificial Intelligence, Hanyang University, Seoul, South Korea(人工智能系,翰阳大学,首尔,韩国) Department of Electronic Engineering, Hanyang University, Seoul, South Korea(电子工程系,翰阳大学,首尔,韩国) Division of Computer Engineering, Hankuk University of Foreign Studies, Yongin, South Korea(计算机工程系,韩国外语大学, Yongin,韩国) Division of AI Data Convergence, Hankuk University of Foreign Studies, Yongin, South Korea(AI数据融合系,韩国外语大学, Yongin,韩国) Division of Language & AI, Hankuk University of Foreign Studies, Seoul, South Korea(语言与AI系,韩国外语大学,首尔,韩国)

专题命中 医学影像 :MRI(title,title_cn);medical image(title);pathology(abstract);diagnosis(abstract)

AI总结 本文提出循环2.5D感知损失用于从T1加权MRI生成tau PET,通过交替优化不同切面提升体积一致性,并标准化SUVR以提高准确性。

Comments Published in Human Brain Mapping, available at https://doi.org/10.1002/hbm.70508

详情
AI中文摘要

正电子发射断层扫描(PET)为阿尔茨海默病及相关痴呆症(ADRD)提供分子生物标志物,但其应用受限于成本、监管限制和放射性示踪剂注射的侵入性。尽管现有框架强调多模态生物标志物评估,包括淀粉样蛋白/tau/神经退行性变(A/T/N)方案,但这些障碍限制了PET成像的可及性。跨模态图像合成可能通过从常规扫描中重建不可用的模态来弥合这一差距。由于PET在区域摄取模式而非精确体素强度上具有临床价值,感知损失能够捕捉更高层次的语义特征,因此适合PET合成。现有2D、3D和2.5D感知损失在3D合成中各有局限,包括体积上下文受限、预训练3D模型稀缺以及在解剖平面间平衡优化的困难。在本研究中,我们通过从3D T1加权MRI生成3D伪[18F]flortaucipir标准摄取值比率(SUVR)图来合成tau PET。我们提出了一种循环2.5D感知损失,通过在训练过程中交替优化轴向、冠状和矢状平面以提高体积一致性。我们还通过扫描仪制造商标准化PET SUVR,减少制造商间变异性并更好地保留高摄取区域。使用覆盖ADRD光谱的ADNI和SCAN队列,我们证明该方法在U-Net、UNETR、SwinUNETR、CycleGAN和Pix2Pix中具有良好的泛化能力,性能表现强劲。值得注意的是,它在与阿尔茨海默病型tau病理相关的脑区中提高了合成SUVR与测量PET的一致性。代码可在https://github.com/labhai/Cyclic-2.5D-Perceptual-Loss公开获取。

英文摘要

Positron emission tomography (PET) provides molecular biomarkers for Alzheimer's disease and related dementias (ADRD) and is increasingly used for diagnosis, staging, and clinical trial enrichment. However, its use is limited by cost, regulatory restrictions, and the invasiveness of radiotracer injection. Although current frameworks emphasize multimodal biomarker assessment, including the amyloid/tau/neurodegeneration (A/T/N) scheme, these barriers constrain access to PET imaging. Cross-modal image synthesis may help address this gap by reconstructing unavailable modalities from routine scans. Because PET is clinically valuable for regional uptake patterns rather than exact voxel-wise intensities, perceptual losses that capture higher-level semantic features are well suited to PET synthesis. Existing 2D, 3D, and 2.5D perceptual losses for 3D synthesis each have limitations, including restricted volumetric context, scarcity of pretrained 3D models, and difficulty balancing optimization across anatomical planes. In this study, we synthesize tau PET from structural MRI by generating 3D pseudo-[18F]flortaucipir standardized uptake value ratio (SUVR) maps from 3D T1-weighted MR images. We propose a cyclic 2.5D perceptual loss that alternates optimization across axial, coronal, and sagittal planes during training to improve volumetric consistency. We also standardize PET SUVRs by scanner manufacturer, reducing inter-manufacturer variability and better preserving high-uptake regions. Using cohorts spanning the ADRD spectrum from the ADNI and the SCAN cohort, we show that the method generalizes across U-Net, UNETR, SwinUNETR, CycleGAN, and Pix2Pix, with strong performance. Notably, it improves agreement between synthesized SUVRs and measured PET in brain regions relevant to Alzheimer-type tau pathology. Code is publicly available at https://github.com/labhai/Cyclic-2.5D-Perceptual-Loss.

URL PDF HTML 收藏
2607.12399 2026-07-15 cs.CV 新提交 93%

Physically Aware Radiomics Without Interpolation: Disentangling Voxel Geometry and Signal Modification in CT and MRI

无插值的物理感知放射组学:解析CT和MRI中的体素几何与信号修正

David Corral Fontecha, Juan Miranda Bautista, Pablo Menendez Fernández-Miranda, Sergio Rubio-Martín, Lara Lloret Iglesias, Jose A. Vega

机构 * Complejo Asistencial Universitario de León(莱昂大学附属医院综合体) Hospital Universitario Rey Juan Carlos(雷·胡安·卡洛斯大学医院) Health Research Institute of the Jiménez Díaz Foundation(希门尼斯·迪亚斯基金会健康研究所) Rey Juan Carlos University(雷·胡安·卡洛斯大学) Universidad de Oviedo(奥维耶多大学) Universidad de León(莱昂大学) IFCA-CSIC(西班牙国家研究委员会高级计算与电子科学研究所) Universidad Autónoma de Chile(智利大学)

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn);分类 cs.CV

AI总结 该研究针对放射组学纹理特征计算中因各向异性图像导致的问题,开发体素间距感知放射组学框架,通过修改PyRadiomics并比较四种配置进行实验,结果表明VS能有效分离几何建模与信号修正,为放射组学分析提供新方法。

Comments Manuscript under peer review

详情
AI中文摘要

目的:放射组学纹理特征通常在体素索引邻域中计算,隐含地假设各向同性空间关系。在各向异性图像中,这可能会将体素几何与插值引起的信号变化混淆。我们开发了一个体素间距感知放射组学框架,在不重采样的情况下将物理几何纳入纹理计算。方法:我们修改了PyRadiomics以考虑体素间距,同时保留原始图像信号。比较了四种配置:原始非重采样提取(NR)、各向同性重采样(RS)、体素间距感知提取(VS)和伪各向同性预处理(FK),其中在不改变图像阵列的情况下覆盖间距元数据。实验包括685个LIDC-IDRI肺结节和209个I-SPY2乳腺MRI病例,有196个放射组学描述符。使用ICC、受试者内变异性、Friedman检验、特征选择、机器学习、多层感知器和外部验证来评估稳健性。主要结果:VS与NR显示出接近原始的一致性:CT中的中位数ICC(A,1)为0.9976,MRI中为0.9984。RS产生的一致性较低且偏差较大,而FK表现出中间行为,证实仅间距元数据就能影响放射组学特征。梯度衍生和邻域敏感描述符受预处理影响最大。在外部CT验证中,VS保留了与NR相当的预测性能,而MRI在预处理策略和分类器之间表现出更大的变异性。意义:体素间距感知提取将几何建模与插值引起的信号修正分开,同时保留原始图像信号,为各向异性CT和MRI的放射组学分析提供了一种连贯的各向同性重采样替代方法。

英文摘要

Objective: Radiomic texture features are usually computed in voxel-index neighborhoods, implicitly assuming isotropic spatial relationships. In anisotropic images, this can confound voxel geometry with interpolation-induced signal changes. We developed a voxel-spacing-aware radiomic framework that incorporates physical geometry into texture computation without resampling. Approach: We modified PyRadiomics to account for voxel spacing while preserving the native image signal. Four configurations were compared: native non-resampled extraction (NR), isotropic resampling (RS), voxel-spacing-aware extraction (VS), and fake-isotropic preprocessing (FK), in which spacing metadata were overwritten without altering the image array. Experiments included 685 LIDC-IDRI pulmonary nodules and 209 I-SPY2 breast MRI cases, with 196 radiomic descriptors. Robustness was assessed using ICC, within-subject variability, Friedman testing, feature selection, machine learning, a multilayer perceptron, and external validation. Main results: VS showed near-native agreement with NR: median ICC(A,1) was 0.9976 in CT and 0.9984 in MRI. RS produced lower agreement and larger deviations, while FK showed intermediate behavior, confirming that spacing metadata alone can affect radiomic features. Gradient-derived and neighborhood-sensitive descriptors were most affected by preprocessing. VS preserved predictive performance comparable to NR in external CT validation, whereas MRI showed greater variability across preprocessing strategies and classifiers. Significance: Voxel-spacing-aware extraction separates geometric modeling from interpolation-induced signal modification while preserving the native image signal, offering a coherent alternative to isotropic resampling for radiomic analysis of anisotropic CT and MRI.

URL PDF HTML 收藏
2607.02585 2026-07-14 cs.CV 版本更新 93%

Reliability-Aware CT-MRI Registration: A Quality Engineering Framework with Stability Analysis and Risk Classification

可靠性感知的CT-MRI配准:一个具有稳定性分析和风险分类的质量工程框架

Nisreen Albzour

机构 * School of Systems Science and Industrial Engineering, Binghamton University(宾夕法尼亚大学系统科学与工业工程学院)

专题命中 医学影像 :MRI(title,title_cn);CT(title,title_cn);分类 cs.CV

AI总结 提出可靠性感知框架,通过数据学习阈值将配准质量转化为风险类别,用多种指标评估可靠性,经训练阈值用于测试患者,表明仿射配准更优,可靠性过滤配准可改善对齐,还做了多方面分析。

详情
AI中文摘要

多模态CT-MRI配准对图像引导放疗等至关重要,但多数流程仅报告总体质量指标。我们提出一个可靠性感知框架,利用数据学习的阈值将配准质量转换为绿色/黄色/红色风险类别。在来自脑、腹部和颈部解剖结构的18名患者的90对切片上,使用刚性和仿射变换将CT图像配准到T1加权MRI。使用Delta NMI、Delta SSIM、Dice重叠、配准稳定性和反向一致性误差评估可靠性,并组合成单个分数R。从训练患者中学习的阈值原封不动地应用于保留的测试患者。在NMI和SSIM上,仿射配准优于刚性配准,绿色分类分别为44%和33%。与未过滤的方法相比,可靠性过滤的配准改善了平均对齐轮廓。按解剖结构分析显示出很大差异,腹部配准的可靠性比脑部配准更强。权重敏感性分析确定Dice重叠是主要的可靠性组成部分。所提出的框架为多模态配准提供了一个可解释的质量控制层,而风险阈值反映的是统计而非临床验证。

英文摘要

Multimodal CT-MRI registration is central to image-guided radiotherapy, surgical navigation, and diagnostic workflows, but most pipelines report only aggregate quality metrics without per-case reliability signals. We propose a reliability-aware framework that converts registration quality into Green/Yellow/Red risk categories using data-learned thresholds. CT images were registered to T1-weighted MRI using rigid and affine transformations on 90 paired slices from 18 patients across brain, abdominal, and neck anatomies. Reliability was assessed using Delta NMI, Delta SSIM, Dice overlap, registration stability, and inverse consistency error, combined into a single score R. Thresholds learned from training patients were applied unchanged to held-out test patients. Affine registration outperformed rigid registration on NMI and SSIM, yielding 44% Green classifications versus 33% for rigid. Reliability-filtered registrations improved the average alignment profile compared with unfiltered methods. Per-anatomy analysis showed substantial variation, with stronger reliability for abdominal registrations than brain registrations. Weight sensitivity analysis identified Dice overlap as the dominant reliability component. The proposed framework provides an interpretable quality-control layer for multimodal registration, while risk thresholds reflect statistical rather than clinical validation.

URL PDF HTML 收藏
2505.24421 2026-07-14 eess.IV cs.CV 版本更新 93%

pyMEAL: A Multi-Encoder Augmentation-Aware-Learning Toolbox for Robust Medical Image Translation

pyMEAL:用于稳健医学图像翻译的多编码器增强感知学习工具箱

Abdul-mojeed Olabisi Ilyas, Adeleke Maradesa, Jamal Banzi, Jianpan Huang, Henry K. F. Mak, Kannie W. Y. Chan

机构 * Hong Kong Centre for Cerebro-Cardiovascular Health Engineering (COCHE)(香港脑心血管健康工程中心) Department of Informatics, Sokoine University of Agriculture(农业科学学院信息系) Department of Diagnostic Radiology, The University of Hong Kong(香港大学诊断放射科) State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong(香港大学脑科学与认知科学国家重点实验室) Alzheimer’s Disease Research Network, The University of Hong Kong(香港大学阿尔茨海默病研究网络) Department of Biomedical Engineering, City University of Hong Kong(城市大学生物医学工程系) Department of Radiology and Radiological Science, The Johns Hopkins University School of Medicine(约翰霍普金斯大学医学院放射学与放射科学系) City University of Hong Kong Shenzhen Research Institute(城市大学深圳研究 institute)

专题命中 医学影像 :MRI(summary_cn,abstract);CT(summary_cn,abstract);medical image(title,abstract);diagnosis(abstract)

AI总结 针对医学图像翻译受患者差异等挑战及3D图像翻译受阻问题,提出多编码器增强感知学习(MEAL),研究三种特征整合策略,经实验验证其在CT到T1加权MRI翻译任务中表现出色,提升了医学图像翻译的稳健性和临床适用性。

Comments 46 pages, 11 figures, 3 tables

详情
AI中文摘要

医学成像在临床诊断中起着至关重要的作用,但人工智能驱动的成像方法仍受到患者差异、图像伪影以及采集条件下有限稳健性的挑战。3D图像翻译因训练数据有限和扫描仪差异、成像协议及患者运动产生的变异性而受阻。传统数据增强通常依赖单一变换管道。为此提出多编码器增强感知学习(MEAL),研究了三种特征整合策略。通过在解码前动态加权特定增强特征,MEAL - BD保留互补表示并提高稳健性。在CT到T1加权MRI翻译任务中评估MEAL,MEAL - BD在几何扰动和标准成像条件下均优于竞争方法,证明增强感知表示学习可提高医学图像翻译的稳健性和临床适用性。

英文摘要

Medical imaging plays a vital role in clinical diagnosis, yet AI-driven imaging methods remain challenged by patient variability, image artifacts, and limited robustness across acquisition conditions. Although deep learning has advanced medical image analysis, 3D image translation remains hindered by limited training data and variability arising from scanner differences, imaging protocols, and patient motion. Conventional data augmentation typically relies on a single transformation pipeline, overlooking augmentation-specific characteristics and limiting representation learning. To address these challenges, we propose Multi-Encoder Augmentation-Aware Learning (MEAL), which processes multiple augmentation variants through dedicated encoder pathways. Three feature integration strategies are investigated: encoder concatenation (MEAL-CC), fusion layer (MEAL-FL), and an adaptive controller block (MEAL-BD). By dynamically weighting augmentation-specific features before decoding, MEAL-BD preserves complementary representations and improves robustness to clinically relevant variability. We evaluate MEAL using CT-to-T1-weighted MRI translation, a clinically relevant task when MRI is unavailable, contraindicated, or delayed. Across predefined and unseen test datasets, MEAL-BD consistently outperformed competing approaches under both geometric perturbations and standard imaging conditions, achieving higher peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM). By prioritizing structural fidelity over perceptual realism, MEAL supports clinical interpretation and downstream image analysis rather than replacing diagnostic MRI, demonstrating that augmentation-aware representation learning improves the robustness and clinical applicability of medical image translation.

URL PDF HTML 收藏
2607.06234 2026-07-08 cs.CV 新提交 93%

WING: A Window-Prior-Based Generative Network with Gated Inception for Cross-Modality CT Synthesis

WING:一种基于窗口先验的带门控inception的生成网络用于跨模态CT合成

Siyuan Mei, Yan Xia, Yipeng Sun, Siming Bayer, Zirong Li, Chengze Ye, Daiqi Liu, Fuxin Fan, Yixing Huang, Andreas Maier

机构 * Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg(模式识别实验室,埃尔朗根-纽伦堡弗里德里希-亚历山大大学) Department of Orthodontics and Orofacial Orthopaedics, Friedrich-Alexander-Universität Erlangen-Nürnberg(正畸与口腔颌面正畸科,埃尔朗根-纽伦堡弗里德里希-亚历山大大学) Siemens Healthineers(西门子医疗) Institute of Medical Technology, Peking University(北京大学医学技术研究所)

专题命中 医学影像 :CT(title,title_cn);MRI(summary_cn,abstract);分类 cs.CV

AI总结 研究旨在从MRI和CBCT生成CT体积改善放疗计划。核心方法是将回归目标重构成窗口表示,引入WING网络,含门控inception生成器、融合与细化变压器及联合对抗训练目标。主要贡献是在相关基准上达最优性能且支持单模型多解剖合成。

详情
AI中文摘要

从MRI和CBCT生成CT体积可以改善自适应放疗中的治疗计划,同时避免额外的辐射暴露。然而,CT强度的直接回归受到其固有的高动态范围和长尾分布的挑战,从而使稀疏但临床上重要的结构平均化。为缓解此问题,我们将回归目标重新表述为多个窗口表示,利用CT强度是结构确定性和窗口可分离的归纳先验。这些窗口视图呈现出更平滑的分布,并允许结构化融合回全范围CT。在此基础上,我们引入WING,一个基于窗口先验的生成网络,包括:1)一个新的门控inception生成器以产生多窗口预测,实现多形状核交互以捕获跨模态对应;2)一个融合与细化变压器以聚合窗口输出并学习残差以进行细节细化;3)一个联合对抗训练目标以增强窗口条件下的真实感。大量实验表明,我们紧凑的WING在MRI到CT和CBCT到CT基准上实现了最先进的性能,同时支持用单个模型进行多解剖合成。

英文摘要

Generating CT volumes from MRI and CBCT can improve treatment planning in adaptive radiotherapy while avoiding additional radiation exposure. However, direct regression of CT intensities is challenged by the inherently high dynamic range and long-tailed distributions, thereby averaging out sparse yet clinically important structures. To alleviate this issue, we reformulate the regression target into multiple windowed representations, leveraging the inductive prior that CT intensities are structure-deterministic and window-separable. These windowed views exhibit smoother distributions and admit structured fusion back to the full-range CT. Building on this reformulation, we introduce WING, a WINdow-prior-based Generative network comprising: 1) a new Gated Inception Generator to produce multi-window predictions, enabling multi-shape kernel interactions to capture cross-modality correspondence; 2) a Fuse-and-Refine Transformer to aggregate the windowed outputs and learn residuals for detail refinement; and 3) a joint adversarial training objective to enhance window-conditioned realism. Extensive experiments demonstrate that our compact WING achieves state-of-the-art performance on the MRI-to-CT and CBCT-to-CT benchmarks, while supporting multi-anatomy synthesis with a single model.

URL PDF HTML 收藏
2605.05154 2026-05-29 eess.IV 93%

CTseg: A Tool for Brain CT Segmentation, Spatial Normalisation, and Volumetrics

CTseg:用于脑CT分割、空间归一化和体积测量的工具

Mikael Brudfors

专题命中 医学影像 :CT(title,title_cn);MRI(summary_cn,abstract);分类 eess.IV

AI总结 本文介绍并验证了CTseg,一个基于Multi-Brain生成建模框架的免费软件,用于脑CT图像的分割、空间归一化和体积测量,并通过与MRI参考标准的对比验证了其在分割精度、空间归一化一致性、脑体积一致性和下游性别分类性能上的优越性。

详情
AI中文摘要

本文介绍并验证了CTseg,一个免费可用的软件,用于脑CT分割、空间归一化和体积测量。CTseg基于Multi-Brain生成建模框架,提供了一个CT专用流程,生成组织图、变形场和脑体积估计,格式与SPM的统一分割相同,从而将SPM的既定分析链从MRI扩展到CT。CTseg设计用于常规医院CT扫描,无需在部署中进行预处理或重采样。尽管CTseg已被应用于涵盖中风、痴呆和脑形态测量等临床研究,但一直缺乏针对独立参考标准的系统验证。利用配对的MR/CT头部扫描,我们从四个维度评估CTseg:与MRI衍生的银标准相比的分割精度;通过组平均锐度和体素变异系数评估的空间归一化一致性;通过组内相关系数和Bland-Altman分析评估的脑体积一致性;以及来自归一化组织图的下游性别分类性能。作为基线,我们直接将SPM基于MRI的统一分割应用于CT图像。CTseg在分割和归一化方面显著优于该基线,显示出更强的TBV一致性,并实现了相当的TIV一致性。CTseg可在https://github.com/WCHN/CTseg免费获取,所有实验代码均包含在仓库中以实现完全可重复性。

英文摘要

This paper presents and validates CTseg, a freely available software for brain CT segmentation, spatial normalisation, and volumetrics. CTseg builds on the Multi-Brain generative modelling framework, providing a CT-specific pipeline that produces tissue maps, deformation fields, and brain volume estimates in the same format as SPM's unified segmentation, thereby extending SPM's established analysis chain from MRI to CT. CTseg is designed for routine hospital CT scans without requiring preprocessing or resampling in deployment. Although CTseg has been adopted in clinical research spanning, among other things, stroke, dementia, and brain morphometry, a systematic validation against an independent reference standard has been lacking. Using paired MR/CT head scans, we evaluate CTseg across four dimensions: segmentation accuracy against an MRI-derived silver standard; spatial normalisation consistency through group-average sharpness and voxelwise coefficient of variation; brain volume agreement via intraclass correlation and Bland-Altman analysis; and downstream sex classification performance from normalised tissue maps. As a baseline, we apply SPM's MRI-based unified segmentation directly to the CT images. CTseg significantly outperformed this baseline for segmentation and normalisation, showed stronger TBV agreement, and achieved comparable TIV agreement. CTseg is freely available at https://github.com/WCHN/CTseg, and all experiment code is included in the repository for full reproducibility.

URL PDF HTML 收藏
2605.16458 2026-05-19 cs.CV cs.AI 93%

Conservative AI for Safety-Sensitive Medical Image Restoration: Residual-Bounded CT-CTA Enhancement for Intracranial Aneurysm-Relevant Signal Recovery

安全敏感医学图像修复中的保守AI:用于颅内动脉瘤相关信号恢复的残差受限CT-CTA增强

Weijun Ma

机构 * Independent Researcher(独立研究者) King George, Vancouver School Board(金乔治,温哥华学区) Vancouver, BC, Canada(温哥华,BC省,加拿大)

专题命中 医学影像 :CT(title,title_cn);medical image(title,abstract);分类 cs.CV

AI总结 本文提出了一种残差受限的2.5D修复框架,用于安全敏感的医学图像修复,通过编辑控制图限制修改范围,提升CT和CTA图像质量,减少误诊风险。

Comments Preprint manuscript, 16 pages, 4 figures, 3 tables. This manuscript presents a residual-bounded 2.5D CT/CTA restoration framework for conservative medical image enhancement and evaluates it using image-recovery, baseline comparison, Monte Carlo stability, anatomical localization, and external low-dose CT testing

详情
AI中文摘要

图像修复模型越来越多地应用于退化的医学扫描,但在安全敏感的环境中,必须在不不受控制地修改临床重要区域的情况下提高图像质量。这在颅内CT和CT血管造影(CTA)中尤为重要,因为小血管和动脉瘤相关线索靠近高对比度的解剖边界。我们将医学图像修复视为保守AI问题,并提出了一种基于合成退化CT/CTA输入训练的残差受限2.5D修复框架。模型通过编辑控制图将学习到的残差添加到原始中心切片中,限制修改的幅度和空间范围。我们使用动脉瘤相关图像恢复矩阵、与高斯基线的配对比较、蒙特卡洛稳定性测试、有意义编辑的解剖定位以及低剂量CT的外部评估来评估该框架。在50个分布外的CT-CTA案例中,受限模型实现了平均目标增益0.0635,平均PSNR 37.51 dB,以及iatrogenic编辑率4.0%。在1000次蒙特卡洛运行中,模型在85.4%的运行中保持净正收益,没有稳定负收益。在外部低剂量CT中,模型在方向上有益,并且产生的修改足迹比基线小得多。有意义的编辑集中在大脑和颅骨区域,而无关解剖结构几乎没有变化。这些发现提供了初步的计算证据,表明在敏感血管成像中残差受限的修复是可行的,但它们不证明临床诊断性能,需要专家审查和前瞻性验证后才能用于临床应用。

英文摘要

Image restoration models are increasingly applied to degraded medical scans, but in safety-sensitive settings they must improve image quality without uncontrolled modification of clinically important regions. This is especially relevant for intracranial CT and CT angiography (CTA), where small vessels and aneurysm-relevant cues lie near high-contrast anatomical boundaries. We frame medical image restoration as a conservative AI problem and present a residual-bounded 2.5D restoration framework trained on synthetically degraded CT/CTA inputs. The model adds a learned residual to the original center slice through an edit-control map that limits the magnitude and spatial extent of modification. We evaluate the framework using an aneurysm-relevant image-recovery matrix, paired comparison against a Gaussian baseline, Monte Carlo stability testing, anatomical localization of meaningful edits, and external evaluation on low-dose CT. On 50 out-of-distribution CT-CTA cases, the bounded model achieved a mean target gain of 0.0635, a mean PSNR of 37.51 dB, and an iatrogenic-edit rate of 4.0%. Across 1,000 Monte Carlo runs, it remained net positive in 85.4% of runs with no stably negative cases. On external low-dose CT, the model was directionally beneficial and produced a substantially smaller modification footprint than the baseline. Meaningful edits concentrated in brain and skull regions while unrelated anatomy showed negligible change. These findings provide preliminary computational evidence that residual-bounded restoration is feasible in boundary-sensitive vascular imaging, but they do not establish clinical diagnostic performance and require expert review and prospective validation before clinical use.

URL PDF HTML 收藏
2604.17846 2026-04-21 cs.CV cs.AI 93%

AI Approach for MRI-only Full-Spine Vertebral Segmentation and 3D Reconstruction in Paediatric Scoliosis

基于AI的MRI-only全脊柱椎体分割及3D重建在儿童脊柱侧弯中的应用

Nathasha Naranpanawa, Maree T. Izatt, Robert D. Labrom, Geoffrey N. Askin, J. Paige Little

机构 * Biomechanics and Spine Research Group, School of Mechanical, Medical, and Process Engineering, Faculty of Engineering, Queensland University of Technology(生物力学与脊柱研究组,机械、医学与过程工程学院,工程学院,昆士兰理工大学) Centre for Biomedical Technologies, School of Mechanical, Medical and Process Engineering, Faculty of Engineering, Queensland University of Technology(生物医学技术中心,机械、医学与过程工程学院,工程学院,昆士兰理工大学) Orthopaedics Department, Queensland Children’s Hospital(骨科部门,昆士兰儿童医院)

专题命中 医学影像 :MRI(title,title_cn);CT(summary_cn,abstract);分类 cs.CV

AI总结 本文提出一种AI框架,通过GAN将低剂量CT转换为MRI图像,结合已有MRI数据训练U-Net模型,实现全脊柱3D重建,提升分割精度并缩短处理时间,支持无辐射的脊柱侧弯评估。

Comments Presented at 2026 Spine Society of Australia 37th Annual Scientific Meeting

详情
AI中文摘要

MRI在儿科成像中优于CT,因其避免电离辐射,但其在脊柱畸形评估中的应用受限于缺乏自动化的高分辨率3D骨重建技术,这仍依赖CT。MRI基于的3D重建由于手动流程和标注全脊柱数据集稀缺而难以实现。本研究引入了一个AI框架,使能够从MRI中完全自动化地进行胸腰椎(T1-L5)分割和3D重建。通过将历史低剂量CT扫描转换为MRI样图像,并结合现有标注的胸椎MRI数据来训练U-Net模型。所得到的算法能够准确生成连续的胸腰椎3D重建,提高了分割精度(88% Dice分数),并将处理时间从约1小时减少到不到一分钟,同时保留了AIS特定的畸形特征。这种方法使能够从MRI中进行无辐射的3D畸形评估,支持临床评估、手术规划和导航在儿童脊柱护理中。

英文摘要

MRI is preferred over CT in paediatric imaging because it avoids ionising radiation, but its use in spine deformity assessment is largely limited by the lack of automated, high-resolution 3D bony reconstruction, which continues to rely on CT. MRI-based 3D reconstruction remains impractical due to manual workflows and the scarcity of labelled full-spine datasets. This study introduces an AI framework that enables fully automated thoracolumbar spine (T1-L5) segmentation and 3D reconstruction from MRI alone. Historical low-dose CT scans from adolescent idiopathic scoliosis (AIS) patients were converted into MRI-like images using a GAN and combined with existing labelled thoracic MRI data to train a U-Net-based model. The resulting algorithm accurately generated continuous thoracolumbar 3D reconstructions, improved segmentation accuracy (88% Dice score), and reduced processing time from approximately 1 hour to under one minute, while preserving AIS-specific deformity features. This approach enables radiation-free 3D deformity assessment from MRI, supporting clinical evaluation, surgical planning, and navigation in paediatric spine care.

URL PDF HTML 收藏
2605.00448 2026-07-31 cs.CV eess.IV 版本更新 93%

Learning from Compressed CT: Feature Attention Style Transfer and Structured Factorized Projections for Resource-Efficient Medical Image Analysis

从压缩CT学习:用于资源高效医学图像分析的特征注意力风格迁移和结构化因子化投影

Shadid Yousuf, S. M. Mahbubur Rahman, Mohammed Imamul Hassan Bhuiyan

机构 * Department of Electrical and Electronic Engineering, Bangladesh University of Engineering and Technology(电气电子工程系,孟加拉工程与技术大学)

专题命中 医学影像 :CT(title,title_cn);medical image(title);diagnosis(abstract);分类 cs.CV、eess.IV

AI总结 本文提出FAST和SFP方法,通过压缩CT体积进行胸腔异常检测,实现低资源部署和高效数据传输,实验表明CT-Lite在压缩输入下达到接近未压缩基线的AUROC性能。

详情
AI中文摘要

人工智能在医学影像中的应用受到高计算复杂性和处理体积数据资源密集型的限制。尽管胸部CT体积比投影放射学提供更丰富的诊断信息,但其在AI诊断中的使用受限于处理未压缩体积图像的计算负担(通常以NIfTI或DICOM格式存储)。为应对低资源部署和高效电子数据传输的日益增长的需求,我们研究了JPEG压缩的胸部CT体积在胸腔异常检测中的应用。我们提出了特征注意力风格迁移(FAST),一种新颖的蒸馏框架,将高保真CT表示的激活模式和结构关系转移到在压缩输入上运行的时空视觉编码器。通过结合基于Gram矩阵的注意力风格保留与双注意力特征对齐,FAST能够从退化的体积中实现稳健的特征提取。此外,我们引入了结构化因子化投影(SFP),利用块张量列车分解作为密集投影层的参数高效替代方案,将投影头参数减少近一半。我们的对比学习流水线CT-Lite集成了这些组件与基于SigLIP的多模态对齐目标。在CT-RATE、NIDCH和Rad-ChestCT上的实验表明,CT-Lite在所有三个数据集上,尽管在压缩输入上运行且参数显著更少,仍能实现AUROC接近未压缩输入基线的性能,为在资源受限条件下进行AI临床评估铺平了道路。

英文摘要

The deployment of artificial intelligence in medical imaging is hindered by high computational complexity and resource-intensive processing of volumetric data. Although chest computed tomography (CT) volumes offer richer diagnostic information than projection radiography, their use in AI-based diagnosis remains limited due to the computational burden of processing uncompressed volumetric images (typically stored in NIfTI or DICOM format). Addressing the growing need for low-resource deployment and efficient electronic data transfer, we investigate the utilization of JPEG-compressed chest CT volumes for thoracic abnormality detection. We propose Feature Attention Style Transfer (FAST), a novel distillation framework that transfers both activation patterns and structural relationships from high-fidelity CT representations to a spatiotemporal visual encoder operating on compressed inputs. By combining Gram-matrix-based attention style preservation with dual-attention feature alignment, FAST enables robust feature extraction from degraded volumes. Furthermore, we introduce Structured Factorized Projection (SFP), leveraging Block Tensor Train decomposition as a parameter-efficient alternative to dense projection layers, reducing projection-head parameters by almost half. Our contrastive learning pipeline, CT-Lite, integrates these components with a SigLIP-based multimodal alignment objective. Experiments on CT-RATE, NIDCH, and Rad-ChestCT demonstrate that CT-Lite achieves AUROC within 5-7\% of the uncompressed-input baseline across all three datasets, despite operating on compressed inputs with significantly fewer parameters, paving the way for AI-based clinical evaluation under resource constraints.

URL PDF HTML 收藏
2607.01401 2026-07-03 cs.LG cs.AI cs.CV 新提交 93%

NeuroBridge: Bridging Multi-Task MRI Knowledge for Neurodegenerative Disease Diagnosis

NeuroBridge:桥接多任务MRI知识用于神经退行性疾病诊断

Mengyu Li, Guoyao Shen, Chad W. Farris, Xin Zhang

机构 * Department of Mechanical Engineering, Boston University(波士顿大学机械工程系) The Photonics Center, Boston University(波士顿大学光子中心) Rafik B. Hariri Institute for Computing and Computational Science & Engineering, Boston University(波士顿大学拉菲克·B·哈里里计算与计算科学与工程研究所) Department of Radiology, Boston University Chobanian & Avedisian School of Medicine(波士顿大学切博尼亚与阿维迪亚安医学学院放射科) Department of Radiology, Boston Medical Center(波士顿医学中心放射科) Department of Electrical and Computer Engineering, Boston University(波士顿大学电气与计算机工程系) Department of Biomedical Engineering, Boston University(波士顿大学生物医学工程系) Division of Materials Science and Engineering, Boston University(波士顿大学材料科学与工程系)

专题命中 医学影像 :MRI(title,title_cn);diagnosis(title,abstract);分类 cs.CV、cs.LG

AI总结 提出NeuroBridge框架,通过大规模自监督MRI预训练与多任务学习(海马分割、萎缩分类、重建)及门控融合微调,在AD和MCI诊断中达到88.17%准确率,优于单任务方法。

Comments 5 figures. 3 tables

详情
AI中文摘要

引言:基于MRI准确识别阿尔茨海默病(AD)、轻度认知障碍(MCI)及相关痴呆仍具挑战,因为疾病相关的结构变化通常微妙且异质。我们开发了NeuroBridge,一个临床引导的多任务MRI框架用于神经退行性疾病诊断。方法:NeuroBridge将大规模自监督MRI预训练与海马分割、海马萎缩分类和重建目标相结合,随后进行门控融合微调。在ADNI和OASIS队列中评估性能,包括跨队列迁移、基于概率的分析和机会性筛查。结果:NeuroBridge在评估的分类任务中达到最高性能,在ADNI中AD与认知正常对照的准确率为88.17%,在OASIS中为82.78%。最大的提升出现在MCI相关和混合诊断设置中。该框架展示了强大的跨队列泛化能力、预测类别概率与准确性之间的系统关联,以及基于概率的机会性筛查的可行性。讨论:临床引导的多任务表示学习超越了传统的单任务方法,改善了神经退行性MRI诊断。NeuroBridge为痴呆评估和基于MRI的机会性筛查提供了一个稳健且可扩展的框架。

英文摘要

INTRODUCTION: Accurate MRI-based identification of Alzheimer's disease (AD), mild cognitive impairment (MCI), and related dementias remains challenging because disease-related structural changes are often subtle and heterogeneous. We developed NeuroBridge, a clinically guided multi-task MRI framework for neurodegenerative disease diagnosis. METHODS: NeuroBridge integrates large-scale self-supervised MRI pretraining with hippocampal segmentation, hippocampal atrophy classification, and reconstruction objectives, followed by gated fusion fine-tuning. Performance was evaluated across ADNI and OASIS cohorts, including cross-cohort transfer, probability-based analysis, and opportunistic screening. RESULTS: NeuroBridge achieved the highest performance across evaluated classification tasks, reaching 88.17% accuracy for AD versus cognitively normal controls in ADNI and 82.78% in OASIS. The largest gains occurred in MCI-related and mixed-diagnosis settings. The framework demonstrated strong cross-cohort generalization, systematic associations between predicted-class probability and accuracy, and the feasibility of probability-based opportunistic screening. DISCUSSION: Clinically guided multi-task representation learning improves neurodegenerative MRI diagnosis beyond conventional single-task approaches. NeuroBridge provides a robust and scalable framework for dementia assessment and MRI-based opportunistic screening.

URL PDF HTML 收藏
2607.02428 2026-07-03 eess.IV cs.CV physics.med-ph 新提交 93%

Self-Auditing Residual Drifting for Pathology-Preserving Accelerated Knee MRI

自审计残差漂移模型用于保留病理特征的加速膝关节MRI

Qing Lyu, Jianxu Wang, Mohammad Kawas, Ge Wang, Christopher T. Whitlow

机构 * Department of Radiology & Biomedical Imaging, Yale School of Medicine(放射学与生物医学成像系,耶鲁医学院) Department of Biomedical Engineering, Rensselaer Polytechnic Institute(生物医学工程系,伦塞拉尔理工学院)

专题命中 医学影像 :MRI(title,title_cn);pathology(title,abstract);分类 cs.CV、eess.IV

AI总结 提出SA-RDM-DC模型,通过物理条件残差漂移生成和自审计机制,在加速膝关节MRI中实现高保真重建并保留病理特征,优于多种基线方法。

详情
AI中文摘要

加速磁共振成像减少了采集时间,但从欠采样k空间重建可能会模糊诊断相关结构或引入全局图像指标无法捕捉的失败。我们提出了SA-RDM-DC,一种具有数据一致性的自审计残差生成漂移模型,用于加速膝关节MRI。该方法通过训练一个物理条件的漂移场,从零填充重建向全采样残差校正方向适应新提出的生成漂移范式到加速MRI。它预测图像和缺失k空间残差校正,强制与采集的k空间保持数据一致性,使用频率感知和残差漂移监督来恢复细节,并在同一推理过程中生成密集误差图和切片级风险评分。我们在加速因子为4、8和12的多线圈fastMRI膝关节数据上评估SA-RDM-DC,使用fastMRI+病理标注进行区域级和基于分类器的任务保留评估,并在SKM-TEA上进行零样本和微调协议转移评估。与零填充重建、UNet-image-SENSE、DC-UNet、Score-Diffusion、ELF-Diff、SENSE-VarNet和MoDL基线相比,SA-RDM-DC在fastMRI各加速因子下实现了最高的SSIM,同时保持亚秒级每切片推理,避免了迭代扩散基线的长采样时间。在病理感知分析中,SA-RDM-DC保留了病灶区域结构保真度,并减少了半月板预测的不稳定性。其自审计分数强烈识别fastMRI上的高误差重建,并在SKM-TEA协议转移下部分转移作为选择性审查信号。这些结果支持联合考虑图像保真度、病理保留、运行时间和病例特定可靠性的重建评估。

英文摘要

Accelerated magnetic resonance imaging reduces acquisition time, but reconstruction from undersampled k-space can blur diagnostically relevant structures or introduce failures that are not captured by global image metrics. We propose SA-RDM-DC, a Self-Auditing Residual generative Drifting Model with Data Consistency for accelerated knee MRI. The method adapts the newly proposed generative drifting paradigm to accelerated MRI by training a physics-conditioned drift field from the zero-filled reconstruction toward the fully sampled residual correction. It predicts image- and missing-k-space residual corrections, enforces data consistency with acquired k-space, uses frequency-aware and residual drifting supervision to recover fine detail, and produces dense error maps and slice-level risk scores in the same inference pass. We evaluate SA-RDM-DC on multi-coil fastMRI knee data at acceleration factors of 4, 8, and 12, with fastMRI+ pathology annotations for region-level and classifier-based task preservation, and on SKM-TEA for zero-shot and fine-tuned protocol-shift evaluation. Compared with zero-filled reconstruction, UNet-image-SENSE, DC-UNet, Score-Diffusion, ELF-Diff, SENSE-VarNet, and MoDL baselines, SA-RDM-DC achieves the highest SSIM across fastMRI acceleration factors while retaining subsecond per-slice inference and avoiding the long sampling time of iterative diffusion baselines. In pathology-aware analysis, SA-RDM-DC preserves lesion-region structural fidelity and reduces meniscus prediction instability. Its self-auditing scores strongly identify high-error reconstructions on fastMRI and partially transfer as a selective-review signal under SKM-TEA protocol shift. These results support reconstruction evaluation that jointly considers image fidelity, pathology preservation, runtime, and case-specific reliability.

URL PDF HTML 收藏
2605.24179 2026-05-26 eess.IV q-bio.QM 93%

7 Tesla Quantitative MRI and Machine Learning for Exploratory Motor Subtype Stratification and Diagnosis in Parkinson's Disease

7特斯拉定量MRI与机器学习用于帕金森病运动亚型分层和探索性诊断

Anne Louise Kristoffersen, Runa Geirmundsdatter Unsgård, Marc-Antoine Fortin, Ingrid Gylterud Kvålsgard, Kjersti Eline Stige, Thanh Pierre Doan, Erik Magnus Berntsen, Charalampos Tzoulis, Pål Erik Goa

专题命中 医学影像 :MRI(title,title_cn);diagnosis(title,abstract);分类 q-bio、eess.IV

AI总结 本研究利用7特斯拉MRI的定量图和深度学习自动脑分割,结合特征选择的机器学习分类器,实现了帕金森病运动亚型(姿势不稳与步态困难型 vs 震颤为主型)的高精度分层和诊断。

详情
AI中文摘要

帕金森病(PD)是一种高度异质性疾病,包括哪些运动症状占主导。支持亚型分层的影像生物标志物可以改善生物学理解和研究设计,并实现个性化治疗策略。本研究评估了基于深度学习的自动脑分割,结合7特斯拉MRI的定量图,是否能突出健康对照(HC)、姿势不稳与步态困难(PIGD)和震颤为主(TD)之间的差异,并随后用于客观的PD分层。特征选择可能提高机器学习分类器的性能。研究纳入21名HC和24名PD患者(PwP)。U-Net训练通过DSC评估。定义了两种分类方法,使用5折交叉验证,针对三个任务:(1)HC vs PwP;(2)PIGD vs TD;(3)多类,HC vs PIGD vs TD。方法A使用所有提取的特征。方法B找到分类任务的最优特征子集。U-Net在训练期间对所有ROI的平均DSC为0.86。方法A:任务1最佳准确率0.69,最佳AUC 0.73;任务2准确率0.69,AUC 0.90;任务3准确率0.62,AUC 0.66。方法B:任务1准确率0.82,AUC 0.93;任务2准确率1.00,AUC 1.00;任务3准确率0.73,AUC 0.91。基于深度学习的分割结合qMRI特征选择相对于使用所有特征提高了分类性能,支持可解释的低维成像特征用于PD诊断支持和表型分层的潜力。需要更大规模的多中心研究来评估泛化性和稳定性。

英文摘要

Parkinson's disease (PD) is a highly heterogeneous disease, including which motor symptoms are dominating. Imaging biomarkers that support subtype stratification could also improve biological understanding and study design, and enable personalized treatment strategies. This study evaluates whether deep-learning based automatic brain segmentation, in addition to quantitative maps from 7 Tesla MRI, can highlight differences between Healthy Controls (HC), Postural Instability and Gait Difficulty (PIGD) and Tremor Dominant (TD), and subsequently be used for objective PD stratification. The performance of machine learning classifiers may be improved with feature selection. 21 HC, and 24 people with PD (PwP) were included. The U-Net training was assessed with DSC. Two classification approaches using 5-fold cross-validation were defined across three tasks: (1) HC vs PwP; (2) PIGD vs TD; (3) multiclass, HC vs PIGD vs TD. Approach A used all extracted features. Approach B found the optimal subset of features for the classification tasks. The U-Net achieved mean DSC of 0.86 for all ROIs during training. Approach A: Task 1 best accuracy of 0.69 and best AUC of 0.73. Task 2 accuracy 0.69, AUC 0.90. Task 3 accuracy 0.62, AUC 0.66. Approach B: Task 1 accuracy of 0.82 and AUC of 0.93. Task 2 accuracy 1.00, AUC 1.00. Task 3 accuracy 0.73, AUC 0.91. DL-based segmentation combined with qMRI feature selection improved classification relative to using all features, supporting the potential of interpretable, low-dimensional imaging signatures for PD diagnosis support and phenotype stratification. Larger, multi-site studies are warranted to assess generalizability and stability.

URL PDF HTML 收藏
2601.00260 2026-07-01 cs.CV 版本更新 92%

TotalFM: An Organ-Separated 3D-CT Foundation Model Leveraging Large-Scale Routine Clinical Radiology Data

TotalFM:利用大规模常规临床放射学数据的器官分离3D-CT基础模型

Kohei Yamamoto, Tomohiro Kikuchi

机构 * Department of Radiology, Jichi Medical University(放射科,自治医科大学) Data Science Center, Jichi Medical University(数据科学中心,自治医科大学)

专题命中 医学影像 :CT(title,title_cn);radiology(title,abstract);分类 cs.CV

AI总结 提出TotalFM,一种基于器官分离的3D-CT放射学基础模型,通过自动化生成器官体积与发现句子对,结合VideoMAE自监督预训练和对比学习,在零样本器官级和发现级病变分类任务中优于现有模型。

详情
AI中文摘要

虽然放射学中的基础模型有望应用于各种临床任务,但在3D-CT体积数据上训练时,计算成本限制仍然是一个主要挑战。在本研究中,我们提出了TotalFM,一种放射学基础模型,它基于器官分离的概念,利用14万个系列的大规模数据集,高效地学习3D-CT图像与语言表达之间的对应关系。通过分割技术和基于大语言模型(LLM)的放射学报告处理,自动化创建器官体积和发现句子对,并结合通过VideoMAE的自监督预训练与使用体积-文本对的对比学习,我们旨在平衡计算效率和表示能力。在零样本器官级病变分类任务中,与CT-CLIP相比,所提模型在83%(5/6)的器官上取得了更高的F1分数,与Merlin相比在64%(9/14)的器官上更高。这些结果表明,在使用实际放射学报告句子的临床评估环境中,所提模型表现出高泛化性能。此外,在零样本发现级病变分类任务中,与Merlin相比,我们的模型在83%(25/30)的发现类别上取得了更高的AUROC。我们还在放射学报告生成任务中确认了与现有视觉语言模型(VLM)相当的性能。我们的结果表明,器官分离学习框架可以作为3D-CT基础模型实际实现的一个现实且有效的设计指南。源代码和预训练模型在此https URL公开提供。

英文摘要

While foundation models in radiology are expected to be applied to various clinical tasks, computational cost constraints remain a major challenge when training on 3D-CT volumetric data. In this study, we propose TotalFM, a radiological foundation model that efficiently learns the correspondence between 3D-CT images and linguistic expressions based on the concept of organ separation, utilizing a large-scale dataset of 140,000 series. By automating the creation of organ volume and finding-sentence pairs through segmentation techniques and Large Language Model (LLM)-based radiology report processing, and by combining self-supervised pre-training via VideoMAE with contrastive learning using volume-text pairs, we aimed to balance computational efficiency and representation capability. In zero-shot organ-wise lesion classification tasks, the proposed model achieved higher F1 scores in 83% (5/6) of organs compared to CT-CLIP and 64% (9/14) of organs compared to Merlin. These results suggest that the proposed model exhibits high generalization performance in a clinical evaluation setting using actual radiology report sentences. Furthermore, in zero-shot finding-wise lesion classification tasks, our model achieved a higher AUROC in 83% (25/30) of finding categories compared to Merlin. We also confirmed performance comparable to existing Vision-Language Models (VLMs) in radiology report generation tasks. Our results demonstrate that the organ-separated learning framework can serve as a realistic and effective design guideline for the practical implementation of 3D-CT foundation models. The source code and pretrained models are publicly available at https://github.com/jichi-labo/TotalFM.

URL PDF HTML 收藏
2604.16175 2026-04-20 cs.AI cs.CV 92%

MARCH: Multi-Agent Radiology Clinical Hierarchy for CT Report Generation

MARCH:多智能体放射科临床层级用于CT报告生成

Yi Lin, Yihao Ding, Yonghui Wu, Yifan Peng

机构 * Weill Cornell Medicine(韦尔·科恩医学中心) University of Western Australia(西澳大学) University of Florida(佛罗里达大学)

专题命中 医学影像 :CT(title,title_cn);radiology(title,abstract);分类 cs.CV

AI总结 MARCH通过模拟放射科专业层级,采用多智能体框架提升CT报告生成的临床准确性和语言准确性。

Comments Accepted by ACL 2026 main conference

详情
AI中文摘要

自动化3D放射学报告生成常面临临床幻觉和缺乏人类实践中的迭代验证。尽管最近的视觉-语言模型(VLMs)推动了该领域的发展,但它们通常作为单一的'黑箱'系统,缺乏临床工作流程中的协作监督特征。为解决这些挑战,我们提出了MARCH(多智能体放射科临床层级),一个模拟放射科部门专业层级的多智能体框架,并为不同的智能体分配专门的角色。MARCH利用住院医师智能体进行初始草稿撰写,使用多尺度CT特征提取,多个轮转医师智能体进行检索增强的修订,以及主任医师智能体协调迭代的立场基于共识讨论以解决诊断差异。在RadGenome-ChestCT数据集上,MARCH在临床准确性和语言准确性方面显著优于最先进的基线模型。我们的工作证明了建模人类-like组织结构可以提高AI在高风险医疗领域的可靠性。

英文摘要

Automated 3D radiology report generation often suffers from clinical hallucinations and a lack of the iterative verification found in human practice. While recent Vision-Language Models (VLMs) have advanced the field, they typically operate as monolithic "black-box" systems without the collaborative oversight characteristic of clinical workflows. To address these challenges, we propose MARCH (Multi-Agent Radiology Clinical Hierarchy), a multi-agent framework that emulates the professional hierarchy of radiology departments and assigns specialized roles to distinct agents. MARCH utilizes a Resident Agent for initial drafting with multi-scale CT feature extraction, multiple Fellow Agents for retrieval-augmented revision, and an Attending Agent that orchestrates an iterative, stance-based consensus discourse to resolve diagnostic discrepancies. On the RadGenome-ChestCT dataset, MARCH significantly outperforms state-of-the-art baselines in both clinical fidelity and linguistic accuracy. Our work demonstrates that modeling human-like organizational structures enhances the reliability of AI in high-stakes medical domains.

URL PDF HTML 收藏
2604.24146 2026-04-28 cs.CV 92%

EXACT: an explainable anomaly-aware vision foundation model for analysis of 3D chest CT

EXACT:一种可解释的异常感知视觉基础模型,用于3D胸部CT分析

Xuguang Bai, Mingxuan Liu, Tongxi Song, Yifei Chen, Hongjia Yang, Kasidit Anmahapong, Zihan Li, Ying Zhou, Qiyuan Tian

机构 * School of Biomedical Engineering, Tsinghua University(清华大学生物医学工程学院) Department of Radiology, Mianyang Central Hospital(绵阳市中心医院放射科) Center for Biomedical Imaging Research, Tsinghua University(清华大学生物医学成像研究中心)

专题命中 医学影像 :CT(title,title_cn);medical AI(abstract);diagnosis(abstract);radiology(abstract)

AI总结 EXACT通过学习空间解析表示,提升3D胸部CT的异常检测与可解释性,优于现有医学基础模型,适用于多疾病诊断和报告生成。

详情
AI中文摘要

胸部CT在疾病检测和管理中至关重要,但体积成像的复杂性已超出单一扫描级预测的能力。临床有用的AI必须能识别全体积疾病并定位异常,提供可解释的视觉证据。现有视觉-语言基础模型通常将扫描和报告压缩为全局图像-文本表示,限制了空间证据的保留。本文开发了EXACT,一种可解释的异常感知基础模型,用于3D胸部CT,通过配对的临床扫描和放射学报告学习空间解析表示。EXACT在25,692个CT报告对上预训练,使用解剖感知弱监督,联合学习器官分割和多实例异常定位,无需手动体素级标注。所得器官特定异常感知图将每个体素分配给疾病特定的异常评分,受限于其对应解剖结构,联合编码病变范围和器官级上下文。在回顾性多国多中心评估中,EXACT在临床相关CT任务上表现出广泛且一致的改进,涵盖多疾病诊断、零样本异常定位、下游适应和基于视觉的报告生成,优于现有三维医学基础模型。通过将常规临床CT扫描和自由文本报告转换为可解释的体素级表示,EXACT建立了一种可扩展的可信体积医学AI范式。

英文摘要

Chest computed tomography (CT) is central to the detection and management of thoracic disease, yet the growing scale and complexity of volumetric imaging increasingly exceed what can be addressed by scan-level prediction alone. Clinically useful AI for CT must not only recognize disease across the whole volume, but also localize abnormalities and provide interpretable visual evidence. Existing vision-language foundation models typically compress scans and reports into global image-text representations, limiting their ability to preserve spatial evidence and support clinically meaningful interpretation. Here we developed EXACT, an explainable anomaly-aware foundation model for three-dimensional chest CT that learns spatially resolved representations from paired clinical scans and radiology reports. EXACT was pre-trained on 25,692 CT-reports pairs using anatomy-aware weak supervision, jointly learning organ segmentation and multi-instance anomaly localization without manual voxel-level annotations. The resulting organ-specific anomaly-aware maps assign each voxel a disease-specific anomaly score confined to its corresponding anatomy, jointly encoding lesion extent and organ-level context. In retrospective multinational and multi-center evaluations, EXACT showed broad and consistent improvements across clinically relevant CT tasks, spanning multi-disease diagnosis, zero-shot anomaly localization, downstream adaptation, and visually grounded report generation, outperforming existing three-dimensional medical foundation models. By transforming routine clinical CT scans and free-text reports into explainable voxel-level representations, EXACT establishes a scalable paradigm for trustworthy volumetric medical AI.

URL PDF HTML 收藏
2604.19736 2026-04-22 cs.CV 92%

Generative Drifting for Conditional Medical Image Generation

生成漂移用于条件医学图像生成

Zirong Li, Siyuan Mei, Weiwen Wu, Andreas Maier, Lina Gölz, Yan Xia

机构 * Department of Orthodontics and Orofacial Orthopedics, Friedrich-Alexander-University Erlangen-Nuremberg(口腔正畸与面部骨科系,弗里德里希-艾萨克-埃尔兰-纽伦堡大学) Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-University Erlangen-Nuremberg(生物医学工程人工智能系,弗里德里希-艾萨克-埃尔兰-纽伦堡大学) Pattern Recognition Lab, Friedrich-Alexander-University Erlangen-Nuremberg(模式识别实验室,弗里德里希-艾萨克-埃尔兰-纽伦堡大学) Department of Biomedical Engineering, Sun-Yat-sen University(生物医学工程系,孙中山大学)

专题命中 医学影像 :MRI(summary_cn,abstract);CT(summary_cn,abstract);medical image(title,abstract);分类 cs.CV

AI总结 本文提出GDM框架,通过多目标学习提升3D医学图像生成的分布合理性与患者特异性保真度,同时保持单步推理效率,在MRI到CT合成和稀疏视图CT重建中优于多种基线方法。

详情
AI中文摘要

条件医学图像生成在许多临床相关成像任务中起重要作用。然而,现有方法在平衡推理效率、患者特异性保真度和分布层面合理性,尤其是在高维3D医学影像中仍面临根本挑战。本文提出GDM,一种生成漂移框架,将确定性医学图像预测重新表述为多目标学习问题,以联合促进分布层面合理性和患者特异性保真度,同时保持单步推理。GDM通过吸引-排斥漂移将漂移扩展到3D医学影像,最小化生成器推前与目标分布之间的差异。为在3D体数据中实现稳定的漂移学习,GDM从医学基础编码器构建多级特征库,以支持可靠亲和力估计和漂移场计算,跨互补的全局、局部和空间表示。此外,共享输出空间中的梯度协调策略改进了在竞争分布层面和保真度导向目标下的优化平衡。我们在两个代表性任务MRI到CT合成和稀疏视图CT重建中评估了所提出的框架。实验结果表明,GDM在MRI到CT合成和稀疏视图CT重建中优于多种基线方法,包括GAN、流匹配和SDE生成模型以及监督回归方法,同时提高了解剖保真度、定量可靠性、感知现实性和推理效率之间的平衡。这些发现表明,GDM为条件3D医学图像生成提供了一个实用且有效的框架。

英文摘要

Conditional medical image generation plays an important role in many clinically relevant imaging tasks. However, existing methods still face a fundamental challenge in balancing inference efficiency, patient-specific fidelity, and distribution-level plausibility, particularly in high-dimensional 3D medical imaging. In this work, we propose GDM, a generative drifting framework that reformulates deterministic medical image prediction as a multi-objective learning problem to jointly promote distribution-level plausibility and patient-specific fidelity while retaining one-step inference. GDM extends drifting to 3D medical imaging through an attractive-repulsive drift that minimizes the discrepancy between the generator pushforward and the target distribution. To enable stable drifting-based learning in 3D volumetric data, GDM constructs a multi-level feature bank from a medical foundation encoder to support reliable affinity estimation and drifting field computation across complementary global, local, and spatial representations. In addition, a gradient coordination strategy in the shared output space improves optimization balance under competing distribution-level and fidelity-oriented objectives. We evaluate the proposed framework on two representative tasks, MRI-to-CT synthesis and sparse-view CT reconstruction. Experimental results show that GDM consistently outperforms a wide range of baselines, including GAN-based, flow-matching-based, and SDE-based generative models, as well as supervised regression methods, while improving the balance among anatomical fidelity, quantitative reliability, perceptual realism, and inference efficiency. These findings suggest that GDM provides a practical and effective framework for conditional 3D medical image generation.

URL PDF HTML 收藏
2602.23214 2026-06-04 cs.CV cs.LG eess.IV 92%

Plug-and-Play Diffusion Meets ADMM: Dual-Variable Coupling for Robust Medical Image Reconstruction

即插即用扩散遇见ADMM:双变量耦合用于鲁棒医学图像重建

Chenhe Du, Xuanyu Tian, Qing Wu, Muyu Liu, Jingyi Yu, Hongjiang Wei, Yuyao Zhang

机构 * ShanghaiTech University(上海科技大学) Shanghai Jiao Tong University(上海交通大学)

专题命中 医学影像 :MRI(summary_cn,abstract);CT(summary_cn,abstract);medical image(title);分类 cs.CV、cs.LG、eess.IV

AI总结 提出双耦合即插即用扩散(DC-PnPDP)框架,通过引入经典对偶变量提供积分反馈并采用频谱均匀化(SH)处理结构伪影,解决了现有PnP求解器的稳态偏差和幻觉问题,在CT和MRI重建中实现了最先进的保真度和加速收敛。

Comments Accepted by ICML 2026

详情
AI中文摘要

即插即用扩散先验(PnPDP)框架通过将预训练生成模型视为模块化先验,已成为解决成像逆问题的强大范式。然而,我们发现当前PnP求解器(例如基于HQS或近端梯度)存在一个关键缺陷:它们作为无记忆算子,仅基于瞬时梯度更新估计。这种缺乏历史跟踪的做法不可避免地导致非消失稳态偏差,使得重建在严重损坏下无法严格满足物理测量。为了解决这个问题,我们提出了双耦合PnP扩散(DC-PnPDP),它恢复了经典对偶变量以提供积分反馈,逐步强制数据一致性和先验之间的一致性。然而,这种严格的几何耦合引入了第二个挑战:累积的对偶残差表现出频谱有色、结构化的伪影,违反了扩散先验的加性白高斯噪声(AWGN)假设,导致严重的幻觉。为了弥合这一差距,我们引入了频谱均匀化(SH),一种频域适应机制,将这些结构化残差调制为统计上合规的伪AWGN输入。这有效地将求解器的严格优化轨迹与去噪器的有效统计流形对齐。在CT和MRI重建上的大量实验表明,我们的方法解决了偏差-幻觉权衡,实现了最先进的保真度并显著加速收敛。代码可在https://github.com/duchenhe/DC-PnPDP获取。

英文摘要

Plug-and-Play diffusion prior (PnPDP) frameworks have emerged as a powerful paradigm for solving imaging inverse problems by treating pretrained generative models as modular priors. However, we identify a critical flaw in prevailing PnP solvers (e.g., based on HQS or Proximal Gradient): they function as memoryless operators, updating estimates solely based on instantaneous gradients. This lack of historical tracking inevitably leads to non-vanishing steady-state bias, where the reconstruction fails to strictly satisfy physical measurements under heavy corruption. To resolve this, we propose Dual-Coupled PnP Diffusion (DC-PnPDP), which restores the classical dual variable to provide integral feedback, progressively enforce agreement between the data-consistency and prior. However, this rigorous geometric coupling introduces a secondary challenge: the accumulated dual residuals exhibit spectrally colored, structured artifacts that violate the Additive White Gaussian Noise (AWGN) assumption of diffusion priors, causing severe hallucinations. To bridge this gap, we introduce Spectral Homogenization (SH), a frequency-domain adaptation mechanism that modulates these structured residuals into statistically compliant pseudo-AWGN inputs. This effectively aligns the solver's rigorous optimization trajectory with the denoiser's valid statistical manifold. Extensive experiments on CT and MRI reconstruction demonstrate that our approach resolves the bias-hallucination trade-off, achieving state-of-the-art fidelity with significantly accelerated convergence. The code is available at https://github.com/duchenhe/DC-PnPDP

URL PDF HTML 收藏
2602.00214 2026-07-29 cs.CV cs.AI 92%

A Geometric Multimodal Foundation Model Integrating Bp-MRI and Clinical Reports in Prostate Cancer Classification

一种整合Bp-MRI和临床报告的几何多模态基础模型用于前列腺癌分类

Juan A. Olmos, Antoine Manzanera, Fabio Martínez

机构 * Biomedical Imaging, Vision and Learning Laboratory (BIVL$^2$ab), UIS, Colombia(生物医学成像、视觉与学习实验室(BIVL²ab), UIS,哥伦比亚) U2IS, ENSTA, Institut Polytechnique de Paris, France(U2IS, ENSTA,巴黎理工学院,法国)

专题命中 医学影像 :MRI(title,title_cn);biomedical(abstract,comments);diagnosis(abstract);分类 cs.CV

AI总结 本文提出MFM-Geom模型,通过整合Bp-MRI和临床报告,利用几何方法提升前列腺癌分类的准确性和鲁棒性。

Comments Accepted at IEEE International Symposium on Biomedical Imaging (ISBI) 2026

Journal ref 2026 IEEE 23rd International Symposium on Biomedical Imaging (ISBI)

详情
AI中文摘要

前列腺癌(PCa)是全球男性中最常见的癌症之一。双参数MRI(bp-MRI)和临床变量对于PCa的识别和改善治疗决策至关重要。然而,这一过程易受专家解释的影响。此外,大多数现有的计算机辅助诊断方法专注于基于影像的模型,忽视了临床背景,并因数据稀缺而限制了学习稳健表示的能力。我们提出了一种几何多模态基础模型(FM),命名为MFM-Geom,该模型从bp-MRI和临床报告中学习表示,编码视觉发现和来自临床变量上下文的信息。在表示分类头中,该方法利用对称正定(SPD)矩阵和黎曼深度学习来整合来自生物医学多模态FM的影像-文本表示。使用10%的训练数据,MFM-Geom在基于类令牌嵌入的分类方法上表现更优(+8.3%,AUC-PR为90.67)。在外部数据集上的泛化验证证实了生物医学FM微调的鲁棒性,实现了AUC-PR为90.6。

英文摘要

Prostate cancer (PCa) is one of the most common cancers in men worldwide. Bi-parametric MRI (bp-MRI) and clinical variables are crucial for PCa identification and improving treatment decisions. However, this process is subjective to expert interpretations. Furthermore, most existing computer-aided diagnosis methods focus on imaging-based models, overlooking the clinical context and suffering from data scarcity, limiting their ability to learn robust representations. We propose a geometric multimodal Foundation Model (FM), named MFM-Geom, that learns representations from bp-MRI and clinical reports, encoding visual findings and information from the context of clinical variables. In the representations classification head, the approach leverages symmetric positive definite (SPD) matrices and Riemannian deep learning to integrate imaging-text representations from a biomedical multimodal FM. Using 10% of the training data, MFM-Geom outperformed baseline class token embedding-based classification (+8.3%, AUC-PR of 90.67). Generalization on external dataset confirmed the robustness of fine-tuning biomedical FM, achieving an AUC-PR of 90.6.

URL PDF HTML 收藏
2603.24847 2026-07-07 cs.CV 版本更新 92%

CORA: Generalizable coronary artery disease assessment and risk stratification from coronary CT angiography using pathology-centric representation learning

CORA:一种由病理合成驱动的冠状动脉CT血管造影分析和MACE风险评估基础模型

Jinkui Hao, Gorkem Durak, Halil Ertugrul Aktas, Ulas Bagci, Bradley D. Allen, Nilay S. Shah, Bo Zhou

机构 * Department of Radiology, Northwestern University(西北大学放射学系) Department of Biomedical Engineering, Northwestern University(西北大学生物医学工程系) Department of Cardiology, Northwestern University(西北大学心脏病学系) Department of Preventive Medicine, Northwestern University(西北大学预防医学系)

专题命中 医学影像 :CT(title,title_cn);pathology(title,abstract);分类 cs.CV

AI总结 CORA通过病理合成驱动的自监督框架,直接从体积CT血管造影数据中学习,提升冠状动脉疾病分析和MACE风险评估性能,实现29%的性能提升。

Comments Code is available at: https://github.com/Advanced-AI-in-Medicine-and-Physics-Lab/CORA

详情
AI中文摘要

冠状动脉疾病是全球心血管死亡的主要原因,可通过冠状动脉CT血管造影(CCTA)非侵入性评估。尽管深度学习在自动化CCTA分析中取得进展,但临床应用受限于专家标注数据稀缺。此外,广泛采用的无标签预训练策略,如掩码图像建模,本质上偏向于全局解剖统计,难以捕捉冠状动脉斑块的局部病理特征。本文引入CORA,一种用于全面心血管风险评估的3D视觉基础模型。CORA通过病理中心、合成驱动的自监督框架直接从体积CCTA中学习。利用解剖引导的病变合成引擎,模型被显式训练以检测模拟血管异常,使表征学习偏向于临床相关疾病特征而非主导背景解剖。我们在12,801个未标注的CCTA体积上训练CORA,并在来自九家独立医院的多中心数据集上全面评估模型。在诊断和解剖任务中,包括斑块表征、狭窄检测和冠状动脉分割,CORA在多个任务上均优于最先进的3D视觉基础模型,达到最高29%的性能提升。关键在于通过将成像编码器与大语言模型结合,将CORA扩展为多模态框架,显著提高了30天主要不良心脏事件(MACE)风险分层。我们的结果确立了CORA作为统一解剖评估和心血管风险预测的基础模型。

英文摘要

Coronary artery disease, a leading cause of cardiovascular mortality worldwide, can be assessed non-invasively by coronary computed tomography angiography (CCTA). Although deep learning has advanced automated CCTA analysis, clinical translation remains constrained by the scarcity of expert-annotated data and by the spatial sparsity of coronary pathology, which occupies only a small fraction of each scan. Widely used label-free pretraining strategies, such as masked image modeling and contrastive learning, optimize for global anatomical reconstruction and tend to under-represent these tiny localized pathological features. Here we present CORA, an annotation-efficient model for comprehensive coronary artery disease assessment. Rather than reconstructing background anatomy, CORA learns from volumetric CCTA through a synthesis-driven self-supervised strategy: an anatomy-guided engine inserts diverse synthetic calcified and non-calcified lesions into unlabeled scans, reframing pretraining as an abnormality-detection task that biases representation learning toward clinically relevant disease features. We pretrained CORA on 10,138 unlabeled CCTA volumes and evaluated it across datasets from nine independent hospitals. Across plaque characterization, stenosis detection, and coronary artery segmentation, CORA consistently outperformed strong self-supervised pretraining baselines, with the largest gains on external multi-center data, indicating robust generalization under distributional shift. Coupling the imaging encoder with structured clinical variables further enabled near-term major adverse cardiac event (MACE) risk stratification. Our results show that pathology-centric, synthesis-driven pretraining is an effective and scalable strategy for annotation-efficient coronary artery disease assessment from CCTA.

URL PDF HTML 收藏
2606.20143 2026-06-19 cs.CV 新提交 92%

HEad and neCK TumOR (HECKTOR) 2025: Benchmark of Segmentation, Diagnosis, and Prognosis in Multimodal PET/CT

头颈肿瘤 (HECKTOR) 2025 挑战赛:多模态 PET/CT 中的分割、诊断与预后基准

Numan Saeed, Salma Hassan, Shahad Hardan, Lishan Cai, Xinglong Liang, Moona Mazher, Abdul Qayyum, Yansong Bu, Mengye Lyu, Yue Lin, Mingyuan Meng, Chuanyi Huang, Lisheng Wang, Dalal Chamseddine, Shamimeh Ahrari, Beining Wu, Yifei Chen, Fuyou Mao, Hao Zhang, Baixiang Zhao, Surajit Ray, Muzi Guo, Lei Xiang, Jakob Dexl, Michael Ingrisch, Adrien Depeursinge, Arman Rahmim, Mathieu Hatt, Vincent Andrearczyk, Mohammad Yaqub

机构 * Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学) Amsterdam UMC(阿姆斯特丹大学医学中心) The Netherlands Cancer Institute(荷兰癌症研究所) Radboud University Medical Centre(拉德堡德大学医学中心) University College London(伦敦大学学院) Imperial College London(帝国理工学院) Shenzhen Technology University(深圳技术大学) Shenzhen University(深圳大学) Newland Digital Technology(新大陆数字技术) The University of Sydney(悉尼大学) Shanghai Jiao Tong University(上海交通大学) University Hospital, Nantes(南特大学医院) Nantes Université, Centrale Nantes, CNRS, LS2N(南特大学、南特中央理工学院、法国国家科学研究中心、LS2N实验室) Hangzhou Dianzi University(杭州电子科技大学) Tsinghua University(清华大学) Central South University(中南大学) University of Glasgow(格拉斯哥大学) China Mobile System Integration Co., Ltd.(中移系统集成有限公司) Subtle Medical Inc.(Subtle Medical公司) University Hospital, LMU Munich(慕尼黑大学医院) Munich Center for Machine Learning(慕尼黑机器学习中心) BC Cancer Research Institute(不列颠哥伦比亚癌症研究所) HES-SO Valais-Wallis University of Applied Sciences and Arts(HES-SO瓦莱州应用科学与艺术大学) Lausanne University Hospital (CHUV)(洛桑大学医院) LaTIM, INSERM, UMR 1101, Univ Brest(LaTIM实验室、法国国家健康与医学研究院、UMR 1101、布雷斯特大学)

专题命中 医学影像 :CT(title,title_cn);diagnosis(title);分类 cs.CV

AI总结 HECKTOR 2025 挑战赛利用多模态 PET/CT 和电子健康记录,建立了头颈癌自动分析的基准,涵盖肿瘤分割、复发预测和 HPV 分类三个任务,最佳算法分别达到 Dice 0.75、C-index 0.66 和平衡准确率 0.56。

Comments 17 pages, 4 figures, 4 tables. Overview paper for the HECKTOR 2025 challenge, held as a satellite event at MICCAI 2025. Challenge website: https://hecktor.grand-challenge.org/

详情
AI中文摘要

头颈癌 (HNC) 构成显著的全球健康负担,准确的肿瘤勾画对于有效的放疗计划至关重要。口咽部解剖结构的复杂性,加上肿瘤在影像上的异质性表现,使得手动分割耗时且存在观察者间差异。除分割外,从非侵入性影像预测长期临床结局(如无复发生存期 RFS)和确定人乳头瘤病毒 (HPV) 状态,仍然是具有挑战性但临床价值高的目标。HECKTOR 2025 挑战赛通过使用多模态 PET/CT 影像和电子健康记录,建立了一个用于自动 HNC 分析的全面基准。基于前几届(2020-2022),本次挑战赛采用了扩展的多机构数据集,包含来自全球 10 个中心的 1100 多名患者。参与者需完成三个互补目标:(1) 分割原发肿瘤体积 (GTVp) 和转移淋巴结 (GTVn),(2) 预测无复发生存期,(3) 分类 HPV 状态。挑战赛吸引了 35 个注册团队,其中 15 个最终提交在保留测试集上进行了评估。表现最佳的算法在分割上达到平均 Dice 相似系数 0.75,在生存预测上达到一致性指数 0.66,在 HPV 分类上达到平衡准确率 0.56。本文对所提交的方法进行了全面分析,评估了它们在不同病变特征上的性能,并讨论了它们在自动化肿瘤学工作流程和决策支持系统中临床转化的意义。

英文摘要

Head and neck cancers (HNC) represent a significant global health burden, with accurate tumor delineation being essential for effective radiotherapy planning. The complexity of the oropharyngeal anatomy, combined with the heterogeneous appearance of tumors on imaging, makes manual segmentation time-intensive and subject to inter-observer variability. Beyond segmentation, predicting long-term clinical outcomes, such as recurrence-free survival (RFS), and determining human papillomavirus (HPV) status from noninvasive imaging, remain challenging yet clinically valuable goals. The HECKTOR 2025 challenge addresses these needs by establishing a comprehensive benchmark for automated HNC analysis using multimodal PET/CT imaging and electronic health records. Building on previous editions (2020-2022), this challenge features an expanded multi-institutional dataset comprising over 1,100 patients from 10 centers worldwide. Participants were tasked with three complementary objectives: (1) segmenting primary gross tumor volumes (GTVp) and metastatic lymph nodes (GTVn), (2) predicting recurrence-free survival, and (3) classifying HPV status. The challenge attracted 35 registered teams, with 15 final submissions evaluated on a held-out test set. Top-performing algorithms achieved a mean Dice similarity coefficient of 0.75 for segmentation, a concordance index of 0.66 for survival prediction, and a balanced accuracy of 0.56 for HPV classification. This paper presents a comprehensive analysis of the submitted methodologies, evaluates their performance across different lesion characteristics, and discusses their implications for clinical translation in automated oncology workflows and decision support systems.

URL PDF HTML 收藏