MMRad-22K: A Structured Multimodal Evidence Dataset for Chest X-ray Report Generation
MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, Shanghai Jiao Tong University(人工智能MOE实验室、人工智能研究院、计算机科学学院、上海交通大学);School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China (USTC)(生物医学工程学院、生命科学与医学系、中国科学技术大学);Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, USTC(医学影像、机器人、分析计算与学习中心(MIRACLE)、苏州市先进研究院、中国科学技术大学);Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine(放射科、浙江大学医学院第一附属医院)
Chest X-ray (CXR) reporting follows a region-based clinical workflow in which radiologists inspect anatomical regions and integrate localized findings into a final report. However, existing resources for CXR report generation provide these supervision signals in fragmented forms. We introduce MMRad-22K, a dataset that organizes regional textual observations, anatomical grounding coordinates, localized image evidence, and report targets into structured multimodal evidence units for CXR report generation. To motivate this formulation, we first compare different evidence formats for report generation and find that structured multimodal evidence is generally more useful than text-only or bounding box-based evidence. We then adapt a unified LVLM backbone using MMRad-22K and show that adaptation with multimodal evidence outperforms both textual-evidence adaptation and end-to-end adaptation on language and clinically oriented metrics. Under the same evaluation protocol, the adapted model also reaches a performance level comparable to several open-source LVLM references. Together, these results support MMRad-22K as a practical structured multimodal resource for training and evaluating CXR report generation aligned with clinical reading workflows.
MonteRET: AI Agent Enhancing Multimodal LLMs with Multi-granularity Knowledge Retrieval for Chest CT Report Generation
Weill Cornell Medicine(威尔康乃尔医学院);University of Western Australia(西澳大利亚大学);Indiana University(印第安纳大学);Regenstrief Institute(瑞根斯特里夫研究所);Yale University(耶鲁大学);University of California, Los Angeles(加州大学洛杉矶分校)
AOR: Anatomical Ontology-Guided Reasoning for Medical Large Multimodal Model in Chest X-Ray Interpretation
Fudan University(复旦大学);Xidian University(西安电子科技大学);KAIST(韩国科学技术院);Children’s Hospital of Fudan University(复旦大学附属儿童医院);Shanghai AI Laboratory(上海人工智能实验室);Hong Kong Polytechnic University(香港理工大学)
Specialty-Oriented Generalist Medical AI for Chest CT Screening
Rensselaer Polytechnic Institute(伦斯勒理工学院);Wake Forest University School of Medicine(维克森林大学医学院);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院)
Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Development
IBM Research(IBM研究);Almaden Research Center(阿尔马登研究中心);Department of Radiology and Imaging Sciences, Emory University(埃默里大学放射与影像科学系);Emory University(埃默里大学)
Addressing Asynchronicity in Clinical Multimodal Fusion via Individualized Chest X-ray Generation
School of Nursing, The Hong Kong Polytechnic University(香港理工大学护理学院);School of Software Engineering, South China University of Technology(华南理工大学软件学院);Department of Computer Science, Hong Kong Baptist University(香港浸会大学计算机科学系)
针对 EHR 与 CXR 采集不同步导致旧胸片影响临床预测的问题,提出 DDL-CXR,利用既往 CXR 和 EHR 时间序列条件化潜在扩散模型生成最新患者特异性表示,并在 MIMIC 上验证其性能优势。
Exploring the Capabilities of Large Language Model Encoders for Image-Text Retrieval in Chest X-rays
Interdisciplinary Program in Bioengineering, Seoul National University Graduate School(生物工程跨学科项目,首尔国立大学研究生院);Integrated Major in Innovative Medical Science, Seoul National University Graduate School(创新医学科学整合专业,首尔国立大学研究生院);Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院第一附属医院放射科);Seoul National University College of Medicine(首尔国立大学医学院);Department of Radiology, Seoul National University College of Medicine, Seoul National University Hospital(首尔国立大学医学院放射科,首尔国立大学医院);Institute of Medical and Biological Engineering, Seoul National University Medical Research Center(医学与生物工程研究所,首尔国立大学医学研究所以及);Institute of Radiation Medicine, Seoul National University Medical Research Center(放射医学研究所,首尔国立大学医学研究所以及)
BIO-CXRNET: A Robust Multimodal Stacking Machine Learning Technique for Mortality Risk Prediction of COVID-19 Patients using Chest X-Ray Images and Clinical Data
Qatar University(卡塔尔大学);North South University(北南大学);University of South Carolina(南卡罗来纳大学);Hamad General Hospital(哈马德综合医院);AFG College with the University of Aberdeen(阿伯丁大学AFG学院)
Beyond Diagnosis: Evaluating Multimodal LLMs for Pathology Localization in Chest Radiographs
University of California(加州大学);Dana-Farber Cancer Institute(达纳-法伯癌症研究所);Massachusetts General Hospital(麻省总医院);St. Jude Children’s Research Hospital(圣犹大儿童研究医院);Brigham and Women’s Hospital & Harvard Medical School(布里法伦医院及哈佛医学院)
Stanford University(斯坦福大学);Harvard University(哈佛大学);Harvard Medical School(哈佛医学院);Brigham and Women’s Hospital(布莱根和妇女医院);University of Texas Health Science Center at San Antonio(德克萨斯大学圣安东尼奥健康科学中心);Jawaharlal Institute of Postgraduate Medical Education and Research(贾瓦哈拉尔研究生医学教育与研究学院)
Multimodal Large Language Model driven Radiology Report Generation with Clinical Knowledge Enhancement
College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院);Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University(同济大学上海自主智能无人系统科学中心)
Multimodal self-supervised learning for lesion localization
Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院保罗·C·劳特伯生物医学成像研究中心);Peng Cheng Laboratory(鹏城实验室);University of Chinese Academy of Sciences(中国科学院大学);The University of Hong Kong(香港大学);Pazhou Laboratory (Huangpu)(琶洲实验室(黄埔));Nanchang University(南昌大学)
CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning
College of Health Science and Technology, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院健康科学与技术学院);Shanghai Innovation Institute(上海创新研究院);Clinical Center for Sports Medicine, Department of Orthopaedics, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院骨科临床中心);School of Basic Medical Sciences, Intelligent Medicine Institute, Fudan University(复旦大学基础医学学院);Department of Hematology, The First Affiliated Hospital, College of Medicine, Zhejiang University(浙江大学医学院第一附属医院血液科);MoE Key Laboratory of Brain-Inspired Intelligent Perception and Cognition, University of Science and Technology of China(中国科学技术大学脑启发智能感知与认知教育部重点实验室);Department of Public Health and Primary Care, University of Cambridge(剑桥大学公共卫生与初级保健学院);Department of Medicine, Faculty of Health Sciences, Universidad CEU Cardenal Herrera(CEU卡德纳尔-赫尔曼大学健康科学学院医学系);Faculty of Medicine, University of Helsinki(赫尔辛基大学医学院);X-LANCE Lab, School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院X-LANCE实验室);Department of Hepatobiliary Surgery, National Cancer Center / National Clinical Research Center for Cancer / Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院肿瘤医院肝胆外科);Department of Surgery, The Ohio State University Wexner Medical Center, The James Comprehensive Cancer Center(俄亥俄州立大学韦克斯纳医学中心外科部,詹姆斯综合癌症中心);Ningbo Institute of Technology, Beihang University(北航宁波理工学院)
Toward Clinically Acceptable Chest X-ray Report Generation: A Qualitative Retrospective Pilot Study of CXRMate-2
organization= Australian e-Health Research Centre, CSIRO Health;organization= Princess Alexandra Hospital, Metro South Health , city= Brisbane , country= Australia;organization= Queensland Digital Health Centre, University of Queensland , city= Brisbane , country= Australia;Informatics Directorate, Metro South Hospital;organization= School of Electrical Engineering;Computer Science, University of Queensland , city= Brisbane , country= Australia
Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomography
Department of Quantitative Biomedicine, University of Zurich(苏黎世大学定量生物医学系);ETH AI Center, ETH Zurich(苏黎世联邦理工学院人工智能中心);International School of Medicine, Istanbul Medipol University(伊斯坦布尔梅迪波尔大学国际医学院);Department of Electrical and Computer Engineering, Boston University(波士顿大学电气与计算机工程系);Division of Intramural Research, National Institutes of Health(美国国立卫生研究院内部研究部);Department of Computing, Imperial College London(伦敦帝国理工学院计算机系);Department of Computer Science, ETH Zurich(苏黎世联邦理工学院计算机科学系);Institute for Diagnostic and Interventional Radiology, University Hospital Zurich(苏黎世大学医院诊断与介入放射学研究所);Department Artificial Intelligence in Biomedical Engineering, FAU Erlangen-Nürnberg(埃尔朗根-纽伦堡工业大学生物医学工程人工智能系)
MOSCARD -- Causal Reasoning and De-confounding for Multimodal Opportunistic Screening of Cardiovascular Adverse Events
Department of Data Science & Engineering, Arizona State University(数据科学与工程系,亚利桑那州立大学);Department of Cardiovascular Medicine, Mayo Clinic(心血管医学系,梅奥诊所);Department of Radiology, Mayo Clinic(放射科,梅奥诊所);Catholic kwandong university international st. mary’s hospital(韩国天主教 kwandong 大学国际圣玛丽医院)
Integrating Eye-Gaze Data into CXR DL Approaches: A Preliminary study
INESC-ID(INESC-ID(葡萄牙国家系统与计算机工程研究所));Instituto Superior Técnico(里斯本高等技术学院);Universidade de Lisboa(里斯本大学);School of Information Systems(信息系统学院);Queensland University of Technology(昆士兰科技大学);Grupo Lusíadas(卢西亚达斯集团)
Fixed-Budget Parameter-Efficient Training with Frozen Encoders Improves Multimodal Chest X-Ray Classification
Department of Computer Science and Engineering, Indian Institute of Technology Kharagpur, India(计算机科学与工程系,印度理工学院Kharagpur分校);Knight Foundation School of Computing and Information Sciences, Florida International University, Florida, USA(骑士基金会计算与信息科学学院,佛罗里达国际大学)
Embedding Radiomics into Vision Transformers for Multimodal Medical Image Classification
Duke Kunshan University(昆山杜克大学);Jiangsu Provincial University Key (Construction) Laboratory for Smart Diagnosis and Treatment of Lung Cancer(江苏省高校重点(建设)实验室肺癌智能诊疗实验室);The First People’s Hospital of Kunshan(昆山市第一人民医院);Duke University(杜克大学)
Federated LoRA Adaptation of BiomedCLIP Across Four International Chest X-Ray Cohorts
North Carolina A&T State University(北卡罗来纳农工州立大学);Tribhuvan University(特里布文大学);University of Tennessee-Knoxville(田纳西大学诺克斯维尔分校);University of South Dakota(南达科他大学)