arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.14879cs.CVcs.AI

CT-Bench:一种用于CT中多模态病变理解的基准测试

CT-Bench: A Benchmark for Multimodal Lesion Understanding in Computed Tomography

Qingqing Zhu, Qiao Jin, Tejas S. Mathai, Yin Fang, Zhizheng Wang, Yifan Yang, Maame Sarfo-Gyamfi, Benjamin Hou, Ran Gu, Praveen T. S. Balamuralikrishna, Kenneth… 展开作者

Qingqing Zhu, Qiao Jin, Tejas S. Mathai, Yin Fang, Zhizheng Wang, Yifan Yang, Maame Sarfo-Gyamfi, Benjamin Hou, Ran Gu, Praveen T. S. Balamuralikrishna, Kenneth C. Wang, Ronald M. Summers, Zhiyong Lu

AI总结:

CT-Bench是一个用于CT多模态病变理解的基准测试,包含病变图像和元数据集以及多任务视觉问答基准测试,通过评估多种多模态模型并展示其在临床中的应用价值。

摘要:

人工智能(AI)可以自动在CT上勾勒出病变并生成放射学报告内容,但进展受限于公开可用的具有病变级注释的CT数据集稀缺。为弥补这一差距,我们引入了CT-Bench,一个首次出现的基准数据集,包含两个组成部分:一个包含20,335个病变的病变图像和元数据集,来自7,795个CT研究,包含边界框、描述和大小信息,以及一个包含2,850对问答对的多任务视觉问答基准测试,涵盖病变定位、描述、大小估计和属性分类。硬负例被包含在内以反映现实世界的诊断挑战。我们通过将多种最先进的多模态模型的表现与放射科医生的评估进行比较,评估了多个最先进的多模态模型,包括视觉语言和医学CLIP变体,证明了CT-Bench作为病变分析全面基准的价值。此外,对病变图像和元数据集进行模型微调在两个组件上都带来了显著的性能提升,突显了CT-Bench的临床实用性。

英文摘要:

Artificial intelligence (AI) can automatically delineate lesions on computed tomography (CT) and generate radiology report content, yet progress is limited by the scarcity of publicly available CT datasets with lesion-level annotations. To bridge this gap, we introduce CT-Bench, a first-of-its-kind benchmark dataset comprising two components: a Lesion Image and Metadata Set containing 20,335 lesions from 7,795 CT studies with bounding boxes, descriptions, and size information, and a multitask visual question answering benchmark with 2,850 QA pairs covering lesion localization, description, size estimation, and attribute categorization. Hard negative examples are included to reflect real-world diagnostic challenges. We evaluate multiple state-of-the-art multimodal models, including vision-language and medical CLIP variants, by comparing their performance to radiologist assessments, demonstrating the value of CT-Bench as a comprehensive benchmark for lesion analysis. Moreover, fine-tuning models on the Lesion Image and Metadata Set yields significant performance gains across both components, underscoring the clinical utility of CT-Bench.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑