arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.03417cs.CV
收藏

统一多任务框架实现可解释的胸部X光片分析

A unified multi-task framework enables interpretable chest radiograph analysis

University of Science and Technology of China(中国科学技术大学)

Lijian Xu, Ziyu Ni, Xinglong Liu, Xiaosong Wang, Hongsheng Li, Shaoting Zhang

AI总结:

提出IMT-CXR框架,通过统一Transformer架构模拟放射科医生诊断流程,实现疾病识别、属性表征和可追溯报告生成,在十个基准上表现优异,且临床评估中66%的AI报告达到或超越原始报告。

摘要:

虽然多模态深度学习推动了医学影像分析,但现有的黑箱系统可能局限于孤立任务,常常忽视临床诊断作为多任务过程对信任敏感的本质。我们提出IMT-CXR(可解释多任务Transformer用于胸部X光分析),该框架通过三个基于证据的阶段模拟放射科医生的诊断工作流:1)疾病识别;2)属性表征(如大小、位置、严重程度量化);3)具有可追溯决策路径的证据整合报告生成。该框架采用统一Transformer架构,通过医学领域指令调优优化,顺序执行四个临床任务:多标签疾病分类、病灶定位、解剖分割和放射学报告生成。实验验证表明,在直接推理和微调设置下,该框架在十个CXR基准上表现出竞争性性能。在一项对来自四个医疗中心的160份历史报告的盲评中,三位放射科医生认为66%的AI生成报告在诊断清晰度上达到或超越原始临床报告,凸显了该框架的转化潜力。通过建立从解剖发现到结论的可追溯诊断路径,这项工作弥合了AI技术指标与临床实用性之间的差距,推动了医学影像中可信赖AI系统的发展。

英文摘要:

While multimodal deep learning has advanced medical imaging analysis, existing black-box systems \textcolor{black}{may remain confined to isolated tasks, often overlooking} the trust-sensitive nature of clinical diagnosis as a multi-task process. We propose IMT-CXR (Interpretable Multi-task Transformer for Chest X-ray Analysis), a framework that emulates radiologists' diagnostic workflow through three evidence-driven stages: 1) Disease recognition; 2) Attribute characterization (e.g., size, location, severity quantification); 3) Evidence-integrated report generation with traceable decision pathways. The framework employs a unified transformer architecture optimized via medical-domain instruction tuning, sequentially executing four clinical tasks: multi-label disease classification, lesion localization, anatomical segmentation, and radiology report generation. Experimental validation demonstrates competitive performance on ten CXR benchmarks under direct inference and fine-tuning settings. In a blinded evaluation of 160 historical reports from four medical centers, three radiologists rated 66\% of AI-generated reports as comparable to or surpassing original clinical reports in diagnostic clarity, highlighting the framework's translational potential. By establishing traceable diagnostic pathways from anatomical findings to conclusions, this work bridges the gap between AI technical metrics and clinical utility, advancing trustworthy AI systems in medical imaging.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑