arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.16006cs.CV
收藏

BTReport: 一种用于脑肿瘤放射学报告生成的框架,结合临床相关特征

BTReport: A Framework for Brain Tumor Radiology Report Generation with Clinically Relevant Features

University of Washington(华盛顿大学);University of Washington School of Medicine(华盛顿大学医学院);Microsoft Health AI(微软健康人工智能);Johns Hopkins School of Medicine(约翰霍普金斯医学院)

Juampablo E. Heras Rivera, Dickson T. Chen, Tianyi Ren, Daniel K. Low, Asma Ben Abacha, Alberto Santamaria-Pang, Mehmet Kurt

AI总结:

BTReport通过确定性特征提取和大语言模型结合,生成可解释的脑肿瘤放射学报告,并提供配套数据集提升临床应用

摘要:

最近的放射学报告生成(RRG)进展主要由大规模配对图像-文本数据集推动;然而,神经肿瘤学领域的进展受限于缺乏开放的配对图像-报告数据集。在此,我们介绍了BTReport,一个开源框架,用于生成脑肿瘤RRG,通过确定性提取的成像特征构建自然语言放射学报告。与现有方法不同,BTReport对图像分析进行确定性特征提取,并仅使用大语言模型进行语法结构和叙述格式化。通过将RRG分为确定性特征提取步骤和报告生成步骤,生成的报告完全可解释且不易产生幻觉。我们证明了用于报告生成的特征能够预测关键的临床结果,包括生存率和IDH突变状态,并且由BTReport生成的报告比现有RRG基线更接近参考临床报告。最后,我们介绍了BTReport-BraTS,一个补充数据集,将BraTS成像与合成生成的放射学报告结合,这些报告由BTReport生成。该项目的代码可在https://github.com/KurtLabUW/BTReport上找到。

英文摘要:

Recent advances in radiology report generation (RRG) have been driven by large paired image-text datasets; however, progress in neuro-oncology has been limited due to a lack of open paired image-report datasets. Here, we introduce BTReport, an open-source framework for brain tumor RRG that constructs natural language radiology reports using deterministically extracted imaging features. Unlike existing approaches that rely on large general-purpose or fine-tuned vision-language models for both image interpretation and report composition, BTReport performs deterministic feature extraction for image analysis and uses large language models only for syntactic structuring and narrative formatting. By separating RRG into a deterministic feature extraction step and a report generation step, the generated reports are completely interpretable and less prone to hallucinations. We show that the features used for report generation are predictive of key clinical outcomes, including survival and IDH mutation status, and reports generated by BTReport are more closely aligned with reference clinical reports than existing baselines for RRG. Finally, we introduce BTReport-BraTS, a companion dataset that augments BraTS imaging with synthetically generated radiology reports produced with BTReport. Code for this project can be found at https://github.com/KurtLabUW/BTReport.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑