The use of machine learning to develop intelligent software tools for interpretation of radiology images has gained widespread attention in recent years. The development, deployment, and eventual adoption of these models in clinical practice, however, remains fraught with challenges. In this paper, we propose a list of key considerations that machine learning researchers must recognize and address to make their models accurate, robust, and usable in practice. Namely, we discuss: insufficient training data, decentralized datasets, high cost of annotations, ambiguous ground truth, imbalance in class representation, asymmetric misclassification costs, relevant performance metrics, generalization of models to unseen datasets, model decay, adversarial attacks, explainability, fairness and bias, and clinical validation. We describe each consideration and identify techniques to address it. Although these techniques have been discussed in prior research literature, by freshly examining them in the context of medical imaging and compiling them in the form of a laundry list, we hope to make them more accessible to researchers, software developers, radiologists, and other stakeholders.
Clinical Context-aware Radiology Report Generation from Medical Images using Transformers
School of Computer Science and Engineering(计算机科学与工程学院);Faculty of Engineering, University of New South Wales(新南威尔士大学工程学院);School of Computing(计算机学院);Faculty of Science and Engineering, Macquarie University(麦考瑞大学科学与工程学院)
本研究提出基于 transformer 的架构从胸部 X 光片生成放射学报告,实验证明其优于 LSTM 且速度更快,并强调需结合语言生成与分类指标以全面评估报告的连贯性与诊断价值。
Clinically Grounded Agent-based Report Evaluation: An Interpretable Metric for Radiology Report Generation
New York University(纽约大学);NYU Langone Health(纽约大学兰格医学中心);Genentech(基因泰克);NYU Grossman School of Medicine(纽约大学格罗斯曼医学院);Wenzhou Medical University(温州医科大学);Macau University of Science and Technology(澳门科学大学)
RadSEM: A Finding-by-Finding Metric for Clinical Consistency in Radiology Reports
JDH Algo, JD Health International Inc., China;Department of Big Data in Health Science, The First Affiliated Hospital of Wenzhou Medical University, China;Zhejiang Engineering Research Center for Hospital Emergency;Department of Intensive Care Unit, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
Detecting Spurious Correlations with Sanity Tests for Artificial Intelligence Guided Radiology Systems
Memorial Sloan Kettering Cancer Center(纪念斯隆凯特琳癌症中心);Rochester Institute of Technology(罗切斯特理工学院);Institute of Research and Medical Care (IRCCS) SDN(研究与医疗护理研究所(IRCCS)SDN);University of Cagliari(卡利亚里大学)
Structure is Supervision: Multiview Masked Autoencoders for Radiology
Department of Computer Science, ETH Zurich(苏黎世联邦理工学院计算机科学系);Department of Computer Science, UC Irvine(加州大学尔湾分校计算机科学系);Department of Quantitative Biomedicine, University of Zurich(苏黎世大学定量生物医学系)
Enhancing Reinforcement Learning for Radiology Report Generation with Evidence-aware Rewards and Self-correcting Preference Learning
Department of Computer Science and Engineering, ECUST(电子科技大学计算机科学与工程系);Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, P. R. China(教育部能源化工过程智能制造重点实验室);Zhejiang University(浙江大学);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新技术区(滨江)区块链与数据安全研究院)
Human-AI Interaction (HAIx) Lab, Indian Institute of Technology Gandhinagar(人类-人工智能交互实验室,印度理工学院冈丁加尔);Department of Computer Science and Engineering, Madhav Institute of Technology and Science Deemed University (MITS-DU)(计算机科学与工程系,马达夫技术与科学 deemed 大学(MITS-DU));Multimedia and Information Security Research Group, Department of Computer Science and Engineering, ABV-Indian Institute of Information Technology and Management(多媒体与信息安全研究组,计算机科学与工程系,ABV-印度信息科技与管理学院)
Scalable Training of Spatially Grounded 2D Vision-Language Models for Radiology
Computer Vision Group, University of Freiburg, Germany(德国弗莱堡大学计算机视觉组);Department of Radiology, Medical Center -- University of Freiburg, Germany(德国弗莱堡大学医学中心放射科);CRIION-AI Lab, Freiburg, Germany(德国弗莱堡CRIION-AI实验室)
The Double Dilemma in Multi-Task Radiology Report Generation: A Gradient Dynamics Analysis and Solution
School of Computer Science and Technology(计算机科学与技术学院);Xinjiang University(新疆大学);Information Security Engineering Technology Research Center(信息安全工程技术研究中心)
Highdicom: A Python library for standardized encoding of image annotations and machine learning model outputs in pathology and radiology
Martinos Center for Biomedical Imaging(马蒂诺斯生物医学成像中心);Massachusetts General Hospital(麻省总医院);MGH & BWH Center for Clinical Data Science(麻省总医院与布莱根妇女医院临床数据科学中心);Mass General Brigham(麻省医疗布列根);Isomics, Inc.(Isomics公司);Center for Integrated Diagnostics(综合诊断中心);Harvard Medical School(哈佛医学院);PixelMed Publishing, LLC.(PixelMed出版有限责任公司);Surgical Planning Laboratory(外科规划实验室);Brigham and Women’s Hospital(布莱根妇女医院)