Bootstrapping labels from radiology reports has become the scalable alternative to provide inexpensive ground truth for medical imaging. Because of the domain specific nature, state-of-the-art report labeling tools are predominantly rule-based. These tools, however, typically yield a binary 0 or 1 prediction that indicates the presence or absence of abnormalities. These hard targets are then used as ground truth to train image models in the downstream, forcing models to express high degree of certainty even on cases where specificity is low. This could negatively impact the statistical efficiency of image models. We address such an issue by training a Bidirectional Long-Short Term Memory Network to augment heuristic-based discrete labels of X-ray reports from all body regions and achieve performance comparable or better than domain-specific NLP, but with additional uncertainty estimates which enable finer downstream image model training.
Trust It or Not: Confidence-Guided Automatic Radiology Report Generation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Duke University(杜克大学);The Chinese University of Hong Kong(香港中文大学);Brigham and Women’s Hospital, Harvard Medical School(布莱根妇女医院,哈佛医学院);Lenovo Research(联想研究院);Lenovo Ltd.(联想集团有限公司);University of North Carolina at Charlotte(北卡罗来纳大学夏洛特分校)
Integrating MedCLIP and Cross-Modal Fusion for Automatic Radiology Report Generation
The Bishop Strachan School(毕夏普斯特拉坎学校);Baidu Inc.(百度公司);Beihang University(北京航空航天大学);Institute of Future Education(未来教育研究所);TechArena Canada Inc.(加拿大泰克Arena公司);College of Engineering(工程学院);Northeastern University(东北大学)
Radiology Report Generation with a Learned Knowledge Base and Multi-modal Alignment
Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Science and Technology of China(中国科学技术大学);Tencent Medical AI Lab(腾讯医疗人工智能实验室);University of Chinese Academy of Sciences(中国科学院大学)
A Self-Guided Framework for Radiology Report Generation
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Shenzhen University General Hospital(深圳大学总医院)
VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labels
Stanford University(斯坦福大学);VinBrain
从自由文本放射学报告中自动提取医学状况对于监督计算机视觉模型解释医学图像至关重要。在这项工作中,我们表明,放射科医生标记报告显着不同意放射科医生标记相应的胸部X射线图像,这降低了质量的报告标签作为图像标签的代理。我们开发和评估的方法,以产生标签的放射学报告,有更好的协议与放射科医生标记图像。我们的最佳性能方法称为VisualCheXbert,它使用生物医学预训练的BERT模型直接从放射学报告映射到图像标签,并通过训练用于从胸部X射线图像中检测医疗状况的计算机视觉模型确定监督信号。我们发现,VisualCheXbert优于使用现有放射学报告标签的方法,平均F1得分为0.14(95%CI 0.12,0.17)。我们还发现,VisualCheXpert更好地同意放射科医生标记胸部X射线图像比放射科医生标记相应的放射学报告之间的平均F1分数在0.12(95% CI 0.09,0.15)和0.21(95% CI 0.18,0.24)之间的几种医疗条件。
Phrase-grounded Fact-checking for Automatically Generated Chest X-ray Reports
Rensselaer Polytechnic Institute, NY, USA(罗文学院);IBM Research, Almaden, CA, USA(IBM研究院);Stanford University, CA, USA(斯坦福大学);Massachusetts General Hospital (MGH), Boston, USA(麻省总医院)
Highdicom: A Python library for standardized encoding of image annotations and machine learning model outputs in pathology and radiology
Martinos Center for Biomedical Imaging(马蒂诺斯生物医学成像中心);Massachusetts General Hospital(麻省总医院);MGH & BWH Center for Clinical Data Science(麻省总医院与布莱根妇女医院临床数据科学中心);Mass General Brigham(麻省医疗布列根);Isomics, Inc.(Isomics公司);Center for Integrated Diagnostics(综合诊断中心);Harvard Medical School(哈佛医学院);PixelMed Publishing, LLC.(PixelMed出版有限责任公司);Surgical Planning Laboratory(外科规划实验室);Brigham and Women’s Hospital(布莱根妇女医院)
Location-based Radiology Report-Guided Semi-supervised Learning for Prostate Cancer Detection
National Cancer Institute(美国国家癌症研究所);National Institutes of Health(美国国立卫生研究院);Clinical Center, National Institutes of Health(美国国立卫生研究院临床中心);Center for Cancer Research, National Cancer Institute(美国国家癌症研究所癌症研究中心)
Glioma Classification Using Multimodal Radiology and Histology Data
Institute of Cancer Research(癌症研究所);Universidad de Valladolid(巴利亚多利德大学);AGH University of Science and Technology(AGH科技大学);Cardiff University(卡迪夫大学);Aberystwyth University(阿伯里斯特威斯大学)
NeuroSymb-MRG: Differentiable Abductive Reasoning with Active Uncertainty Minimization for Radiology Report Generation
University of Macau(澳门大学);Tsinghua University(清华大学);Fudan University(复旦大学);Peking University(北京大学);The First People’s Hospital of Foshan(佛山市第一人民医院);Capital Medical University(首都医科大学);Rutgers Cancer Institute, NJ, USA(罗格斯癌症研究所(美国新泽西州);纽约大学朗格尼健康中心(美国纽约州));and NYU Langone Health, NY, USA(Techno国际新城(印度加尔各答));Techno International New Town, Kolkata, India
The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution
School of Computer Science and Technology(计算机科学与技术学院);Xinjiang University(新疆大学);Information Security Engineering Technology Research Center(信息安全工程技术研究中心)
Weakly Supervised Learning with Automated Labels from Radiology Reports for Glioma Change Detection
Lausanne University Hospital (CHUV)(洛桑大学医院);University of Lausanne (Unil)(洛桑大学);CIBM, Center for Biomedical Imaging(生物医学影像中心);Neuroscience Research Center(神经科学研究中心);Lundin Brain Tumor Research Center(Lundin脑肿瘤研究中心)
Building RadiologyNET: Unsupervised annotation of a large-scale multimodal medical database
University of Rijeka – Faculty of Engineering(里耶卡大学工程学院);Center for Artificial Intelligence and Cybersecurity(人工智能与网络安全中心);Medical University of Graz(格拉茨医科大学)
Prototype-Based Knowledge Guidance for Fine-Grained Structured Radiology Reporting
Computer Aided Medical Procedures, Technische Universität München, Germany(计算机辅助医疗程序,慕尼黑技术大学,德国);Munich Center for Machine Learning, Germany(慕尼黑机器学习中心,德国)
Argus: Benchmarking and Enhancing Vision-Language Models for 3D Radiology Report Generation
Imperial College London(帝国理工学院);The Ohio State University(俄亥俄州立大学);University of Hong Kong(香港大学);Hong Kong University of Science and Technology(香港科技大学)
RadGame: An AI-Powered Platform for Radiology Education
Harvard Medical School(哈佛医学院);Mass General Brigham(麻省总医院);Maastricht University(马斯特里赫特大学);Department of Medical Imaging, King Abdulaziz Medical City, Ministry of National Guard, Riyadh, Saudi Arabia(国王阿卜杜勒-阿齐兹医疗城医学影像科,沙特阿拉伯);National Strategic Technology Research Institute, Seoul National University Hospital(全国战略技术研究所,首尔国立大学医院);Saint Louis University School of Medicine(圣路易斯大学医学院);College of Medicine, King Saud bin Abdulaziz University for Health Sciences(国王萨勒曼·本·阿卜杜勒阿齐兹大学医学院);Tufts University School of Medicine(塔夫茨大学医学院);Department of Biomedical Informatics, Harvard Medical School(哈佛医学院生物医学信息学系)
AI-Driven Radiology Report Generation for Traumatic Brain Injuries
Higher School of Digital Economics, Manouba, University of Manouba, Tunisia(数字经济学高等学院,曼布巴,曼布巴大学,突尼斯);Higher Institute of Management of Tunis, University of Tunis, Tunisia(突尼斯管理高等学院,突尼斯大学,突尼斯);Emergency Department Charles Nicolle Hospital, Tunis El Manar University, Tunisia(查尔斯·尼科勒医院急诊部,突尼斯埃尔曼纳大学,突尼斯)