Imbalanced token distributions naturally exist in text documents, leading neural language models to overfit on frequent tokens. The token imbalance may dampen the robustness of radiology report generators, as complex medical terms appear less frequently but reflect more medical information. In this study, we demonstrate how current state-of-the-art models fail to generate infrequent tokens on two standard benchmark datasets (IU X-RAY and MIMIC-CXR) of radiology report generation. % However, no prior study has proposed methods to adapt infrequent tokens for text generators feeding with medical images. To solve the challenge, we propose the \textbf{T}oken \textbf{Im}balance Adapt\textbf{er} (\textit{TIMER}), aiming to improve generation robustness on infrequent tokens. The model automatically leverages token imbalance by an unlikelihood loss and dynamically optimizes generation processes to augment infrequent tokens. We compare our approach with multiple state-of-the-art methods on the two benchmarks. Experiments demonstrate the effectiveness of our approach in enhancing model robustness overall and infrequent tokens. Our ablation analysis shows that our reinforcement learning method has a major effect in adapting token imbalance for radiology report generation.
Leveraging Prompt-Learning for Structured Information Extraction from Crohn's Disease Radiology Reports in a Low-Resource Language
Faculty of Data and Decision Sciences, Technion - Israel Institute of Technology(以色列理工学院数据与决策科学学院);Shaare Zedek Medical Center(沙雷泽德克医疗中心);Faculty of Biomedical Engineering, Technion - Israel Institute of Technology(以色列理工学院生物医学工程学院);Hospital for Sick Children(病童医院)
提出SMP-BERT提示学习方法,利用报告结构从希伯来语克罗恩病放射学报告中提取结构化信息,显著优于传统微调,尤其在罕见病症检测上(AUC 0.99 vs 0.94,F1 0.84 vs 0.34),推动低资源语言的AI诊断。
ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data
Northwestern Polytechnical University(西北工业大学);The Second Xiangya Hospital, Central South University(中南大学湘雅二医院);Clinical Research Center for Medical Imaging in Hunan Province(湖南省医学影像临床研究中心);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Institute of Medical Research, Northwestern Polytechnical University(西北工业大学医学研究院);Glasgow College, University of Electronic Science and Technology of China(电子科技大学格拉斯哥学院);Central South University(中南大学)