arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.00316cs.CVcs.AIcs.CLcs.LG
收藏

用于临床推理的胸部ImaGenome数据集

Chest ImaGenome Dataset for Clinical Reasoning

IBM Almaden Research Center(IBM阿尔马登研究中心);Rensselaer Polytechnic Institute(伦斯勒理工学院);Virginia Polytechnic Institute and State University(弗吉尼亚理工学院暨州立大学);MIT Critical Data(麻省理工学院关键数据实验室);Albert Einstein Healthcare Network-Philadelphia Campus(阿尔伯特·爱因斯坦医疗网络费城院区);Harvard Medical School(哈佛医学院)
Joy T. Wu, Nkechinyere N. Agu, Ismini Lourentzou, Arjun Sharma, Joseph A. Paguio, Jasper S. Yao, Edward C. Dee, William Mitchell, Satyananda Kashyap, Andrea Gio… 展开作者

Joy T. Wu, Nkechinyere N. Agu, Ismini Lourentzou, Arjun Sharma, Joseph A. Paguio, Jasper S. Yao, Edward C. Dee, William Mitchell, Satyananda Kashyap, Andrea Giovannini, Leo A. Celi, Mehdi Moradi

摘要:

尽管近年来在从胸部X射线(CXR)图像自动检测放射学发现方面取得了进展,但由于缺乏针对不同发现的局部标记数据集,这些模型的可解释性的定量评价受到阻碍。除了少数专家标记的特定发现的小规模数据集(如肺炎和气胸)外,迄今为止,大多数CXR深度学习模型都是在从文本报告中提取的全局“弱”标签上训练的,或者通过联合图像和非结构化文本学习策略进行训练。受计算机视觉社区中Visual Genome工作的启发,我们构建了第一个具有场景图数据结构的Chest ImaGenome数据集来描述$242,072$图像。使用基于规则的联合自然语言处理(NLP)和基于图集的边界框检测流水线自动产生本地注释。通过放射科医师构建的CXR本体,将每个CXR的注释连接为以解剖结构为中心的场景图,这对于图像级推理和多模态融合应用是有用的。总体而言,我们提供:i)$29$ CXR解剖位置(具有边界框坐标的对象)及其属性之间的关系注释的$1,256$组合,结构化为每个图像的场景图,ii)在连续检查中的解剖位置之间的$670,000$局部比较关系(改善、恶化或无变化),以及ii)来自$500$独特患者的手动注释黄金标准场景图数据集。

英文摘要:

Despite the progress in automatic detection of radiologic findings from chest X-ray (CXR) images in recent years, a quantitative evaluation of the explainability of these models is hampered by the lack of locally labeled datasets for different findings. With the exception of a few expert-labeled small-scale datasets for specific findings, such as pneumonia and pneumothorax, most of the CXR deep learning models to date are trained on global "weak" labels extracted from text reports, or trained via a joint image and unstructured text learning strategy. Inspired by the Visual Genome effort in the computer vision community, we constructed the first Chest ImaGenome dataset with a scene graph data structure to describe $242,072$ images. Local annotations are automatically produced using a joint rule-based natural language processing (NLP) and atlas-based bounding box detection pipeline. Through a radiologist constructed CXR ontology, the annotations for each CXR are connected as an anatomy-centered scene graph, useful for image-level reasoning and multimodal fusion applications. Overall, we provide: i) $1,256$ combinations of relation annotations between $29$ CXR anatomical locations (objects with bounding box coordinates) and their attributes, structured as a scene graph per image, ii) over $670,000$ localized comparison relations (for improved, worsened, or no change) between the anatomical locations across sequential exams, as well as ii) a manually annotated gold standard scene graph dataset from $500$ unique patients.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑