AI agents with tool-use capabilities show promise for integrating the domain expertise of various tools. In the medical field, however, tools are usually AI models that are inherently error-prone and can produce contradictory responses. Existing research on medical agents lacks sufficient understanding of the tools' realistic reliability and thus cannot effectively resolve tool conflicts. To address this gap, this paper introduces a framework that enables an agent to interact with tools and empirically learn their practical trustworthiness across different types of multimodal queries via agentic learning. As a concrete instantiation, we focus on chest X-ray analysis and present a tool-expertise-aware chest X-ray agent (TEA-CXA). When tool outputs disagree, the agent experimentally accepts or rejects multimodal tool results, receives rewards, and learns which tool to trust for each query type. Importantly, TEA-CXA extends existing codebases for reinforcement learning with multi-turn tool-calling that focus on textual inputs, to support multimodal contexts effectively. In addition, we enhance the codebase for medical use scenarios by supporting multiple tool calls in one turn, parallel tool inference, and multi-image accommodation within a single user query. Our code framework is applicable to general medical research on multi-turn tool-calling reinforcement learning in multimodal settings. Experiments show that TEA-CXA outperforms the state-of-the-art methods and a comprehensive set of baselines. Code will be released.
DUCX: Decomposing Unfairness in Tool-Using Chest X-ray Agents
Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Anhui, China(人工智能研究所,合肥国家科学中心,安徽,中国);The University of British Columbia, Vancouver, BC V6Z 1Z4, Canada(不列颠哥伦比亚大学,温哥华,BC V6Z 1Z4,加拿大);Vector Institute, Toronto, ON M5G 1M1, Canada(向量研究所,多伦多,ON M5G 1M1,加拿大)
Epanechnikov nonparametric kernel density estimation based feature-learning in respiratory disease chest X-ray images
Department of Data Science, Data Science and AI Laboratory(数据科学系);Catholic University of Argentina (UCA)(阿根廷天主教大学);MACS School(MACS学院);Heriot-Watt University(赫罗特-瓦特大学)
X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray Reasoning
Alibaba Group(阿里巴巴集团);Institute of Computing Technology(计算技术研究所);Sun Yat-sen University(中山大学);National University of Singapore(新加坡国立大学);Beijing Jiaotong University(北京交通大学);City University of Hong Kong(香港城市大学);Santa Clara University(圣克拉拉大学);University of Chinese Academy of Sciences(中国科学院大学);Carnegie Mellon University(卡内基梅隆大学)
Hybrid Explanation-Guided Learning for Transformer-Based Chest X-Ray Diagnosis
ARTORG Center for Biomedical Engineering Research, University of Bern(ARTORG生物医学工程研究中心,伯恩大学);Inselspital (Bern University Hospital)(Inselspital(伯恩大学医院));Insel Gruppe Bern Universitätsinstitut für Diagnostische, Interventionelle und Pädiatrische Radiologie(Bern大学诊断、介入和儿科放射学研究所);Department of Radiation Oncology, Inselspital, Bern University Hospital(放射肿瘤科,Inselspital,伯恩大学医院)
Deep Omni-supervised Learning for Rib Fracture Detection from Chest Radiology Images
Imsight AI Research Lab(Imsight AI 研究实验室);The Hong Kong University of Science and Technology(香港科技大学);HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute(香港科技大学深圳-香港协同创新研究院);The Chinese University of Hong Kong(香港中文大学)
Learning to Automatically Diagnose Multiple Diseases in Pediatric Chest Radiographs Using Deep Convolutional Neural Networks
Medical Imaging Center, Vingroup Big Data Institute(Vingroup大数据研究院医学影像中心);College of Engineering & Computer Science, VinUniversity(VinUniversity工程与计算机科学学院)
TB-Net: A Tailored, Self-Attention Deep Convolutional Neural Network Design for Detection of Tuberculosis Cases from Chest X-ray Images
University of Waterloo(滑铁卢大学);Waterloo Artificial Intelligence Institute(滑铁卢人工智能研究所);DarwinAI Corp.(DarwinAI公司);Niagara Health(尼亚加拉健康中心);McMaster University(麦克马斯特大学);Thunder Bay Regional Health Sciences Centre(桑德贝地区健康科学中心);Northern Ontario School of Medicine(北安大略医学院)
Improving Pneumonia Localization via Cross-Attention on Medical Images and Reports
School of Computing, University of Utah(犹他大学计算机学院);NVIDIA Corporation(英伟达公司);Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center(美国国立卫生研究院临床中心放射科与影像科学部);National Institutes of Health Clinical Center(美国国立卫生研究院临床中心);National Institutes of Health(美国国立卫生研究院)
MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancement
Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能研究院);Department of Magnetic Resonance Imaging, The First Affiliated Hospital of Zhengzhou University(郑州大学第一附属医院磁共振成像科);Department of Electronic Science, Xiamen University(厦门大学电子科学系)
Picking the Right Specialist: Attentive Neural Process-based Selection of Task-Specialized Models as Tools for Agentic Healthcare Systems
Department of Engineering Science, University of Oxford, United Kingdom(牛津大学工程科学系);Department of Computer Science, Khalifa University, Abu Dhabi, United Arab Emirates(哈利法大学计算机科学系)