Is it possible to develop an "AI Pathologist" to pass the board-certified examination of the American Board of Pathology? To achieve this goal, the first step is to create a visual question answering (VQA) dataset where the AI agent is presented with a pathology image together with a question and is asked to give the correct answer. Our work makes the first attempt to build such a dataset. Different from creating general-domain VQA datasets where the images are widely accessible and there are many crowdsourcing workers available and capable of generating question-answer pairs, developing a medical VQA dataset is much more challenging. First, due to privacy concerns, pathology images are usually not publicly available. Second, only well-trained pathologists can understand pathology images, but they barely have time to help create datasets for AI research. To address these challenges, we resort to pathology textbooks and online digital libraries. We develop a semi-automated pipeline to extract pathology images and captions from textbooks and generate question-answer pairs from captions using natural language processing. We collect 32,799 open-ended questions from 4,998 pathology images where each question is manually checked to ensure correctness. To our best knowledge, this is the first dataset for pathology VQA. Our dataset will be released publicly to promote research in medical VQA.
Path-RAG: Knowledge-Guided Key Region Retrieval for Open-ended Pathology Visual Question Answering
University of Texas at Austin（德克萨斯大学奥斯汀分校）；Arizona State University（亚利桑那州立大学）；University of California, Los Angeles（加利福尼亚大学洛杉矶分校）；Massachusetts Institute of Technology（麻省理工学院）
MediQAl: A French Medical Question Answering Dataset for Knowledge and Reasoning Evaluation
Data Clinic, University Hospital of Nantes, France（南特大学医院数据诊所，法国）；Nantes Université, École Centrale Nantes, CNRS, LS2N, France（南特大学，中央理工学院南特分校，国家科学研究中心，LS2N，法国）
Institute of Science and Technology, Taikang Insurance Group（泰康保险集团科学技术研究院）
In this paper, we introduce MeDiaQA, a novel question answering(QA) dataset, which constructed on real online Medical Dialogues. It contains 22k multiple-choice questions annotated by human for over 11k dialogues with 120k utterances between patients and doctors, covering 150 specialties of diseases, which are collected from haodf.com and dxy.com. MeDiaQA is the first QA dataset where reasoning over medical dialogues, especially their quantitative contents. The dataset has the potential to test the computing, reasoning and understanding ability of models across multi-turn dialogues, which is c…
PerMedCQA: Benchmarking Large Language Models on Medical Consumer Question Answering in Persian Language
School of Computer Science Institute for Research in Fundamental Sciences（计算机科学学院基础科学研究研究所）；School of Electrical and Computer Engineering University of Tehran（电气与计算机工程学院塔里班大学）；Department of Computer Science Faculty of Mathematical Sciences Alzahra University（计算机科学系数学科学学院阿扎赫拉大学）
Computer Science and Artificial Intelligence, MIT（麻省理工学院计算机科学与人工智能系）；Tongji Medical College, HUST（华中科技大学同济医学院）
Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical problems, MedQA, collected from the professional medical board exams. It covers three languages: English, simplified Chinese, and traditional Chinese, and contains 12,723, 34,251, and 14,123 questions for the three languages, respectively. We implement both rule-based and popular neural methods by sequentially combining a document retriever and a m…
RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answering
King’s College London（伦敦国王学院）；School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University（上海交通大学电子信息与电气工程学院）；School of Electrical and Computer Engineering, Carnegie Mellon University（卡内基梅隆大学电气与计算机工程学院）
Tencent Medical AI Lab（腾讯医疗人工智能实验室）；State University of New York at Buffalo（纽约州立大学布法罗分校）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；JD Urban Computing Business Unit（京东城市计算事业部）；University of Illinois at Chicago（伊利诺伊大学芝加哥分校）
The past few years have witnessed the flourishing of crowdsourced medical question answering (Q&A) websites. Patients who have medical information demands tend to post questions about their health conditions on these crowdsourced Q&A websites and get answers from other users. However, we observe that a large portion of new medical questions cannot be answered in time or receive only few answers from these websites. On the other hand, we notice that solved questions have great potential to solve this challenge. Motivated by these, we propose an end-to-end system that can automatically find simi…
Exploring the Role of Knowledge Graph-Based RAG in Japanese Medical Question Answering with Small-Scale LLMs
The University of Tokyo（东京大学）；NEC Laboratories America（NEC美国实验室）；Dokkyo Medical University（多摩医学大学）；Graduate School of Frontier Sciences, The University of Tokyo（东京大学前沿科学研究生院）
Despite the great success of word embedding, sentence embedding remains a not-well-solved problem. In this paper, we present a supervised learning framework to exploit sentence embedding for the medical question answering task. The learning framework consists of two main parts: 1) a sentence embedding producing module, and 2) a scoring module. The former is developed with contextual self-attention and multi-scale techniques to encode a sentence into an embedding tensor. This module is shortly called Contextual self-Attention Multi-scale Sentence Embedding (CAMSE). The latter employs two scorin…
This paper introduces MedMCQA, a new large-scale, Multiple-Choice Question Answering (MCQA) dataset designed to address real-world medical entrance exam questions. More than 194k high-quality AIIMS \& NEET PG entrance exam MCQs covering 2.4k healthcare topics and 21 medical subjects are collected with an average token length of 12.77 and high topical diversity. Each sample contains a question, correct answer(s), and other options which requires a deeper language understanding as it tests the 10+ reasoning abilities of a model across a wide range of medical subjects \& topics. A detailed explan…
Optimizing Medical Question-Answering Systems: A Comparative Study of Fine-Tuned and Zero-Shot Large Language Models with RAG Framework
Department of Electrical Engineering；Computer Science University of Toledo Toledo, USA；Institute of Mathematical Sciences Claremont Graduate University Claremont, USA；Department of Bioengineering University of Toledo Toledo, USA；Department of Computer Science Bowling Green State University Bowling Green, USA
Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
Technical University of Munich（慕尼黑工业大学）；TUM University Hospital Rechts der Isar（慕尼黑工业大学 Rechts der Isar 大学医院）；German Heart Center Munich（慕尼黑德国心脏中心）；Helmholtz Zentrum München（慕尼黑亥姆霍兹中心）；German Consortium for Translational Cancer Research（德国转化癌症研究联盟）
Integrating UMLS Knowledge into Large Language Models for Medical Question Answering
National University of Singapore（新加坡国立大学）；Duke-NUS Medical School（杜克-新加坡国立大学医学院）；University of Tokyo（东京大学）；National Institute of Advanced Industrial Science and Technology（日本产业技术综合研究所）；Singapore General Hospital（新加坡中央医院）；Zhejiang Lab（之江实验室）；National Institutes of Health（美国国立卫生研究院）；Yale University（耶鲁大学）
Recent advances in Natural Language Processing (NLP), and specifically automated Question Answering (QA) systems, have demonstrated both impressive linguistic fluency and a pernicious tendency to reflect social biases. In this study, we introduce Q-Pain, a dataset for assessing bias in medical QA in the context of pain management, one of the most challenging forms of clinical decision-making. Along with the dataset, we propose a new, rigorous framework, including a sample experimental design, to measure the potential biases present when making treatment decisions. We demonstrate its use by ass…
The Hong Kong Polytechnic University（香港理工大学）；West China Hospital of Sichuan University（四川大学华西医院）；Sichuan Academy of Medical Sciences（四川省医学科学院）；Sichuan Provincial People's Hospital（四川省人民医院）
Medical visual question answering (Med-VQA) has tremendous potential in healthcare. However, the development of this technology is hindered by the lacking of publicly-available and high-quality labeled datasets for training and evaluation. In this paper, we present a large bilingual dataset, SLAKE, with comprehensive semantic labels annotated by experienced physicians and a new structural medical knowledge base for Med-VQA. Besides, SLAKE includes richer modalities and covers more human body parts than the currently available dataset. We show that SLAKE can be used to facilitate the developmen…
A Systematic Study of Retrieval Pipeline Design for Retrieval-Augmented Medical Question Answering
Department of Mechatronics & Industrial Engineering, Chittagong University of Engineering & Technology（吉大港工程与技术大学机电与工业工程系）；Department of Mechanical Engineering, Chittagong University of Engineering & Technology（吉大港工程与技术大学机械工程系）
Improving Heart-Focused Medical Question Answering in LLMs via Variance-Aware Rubric Rewards with GRPO
School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK, USA（电气与计算机工程学院，俄克拉荷马大学，诺曼，OK，USA）；Intelligent Neuromorphic and Quantum Understanding for Innovative Research and Engineering (INQUIRE) Laboratory, University of Oklahoma, Norman, OK, USA（创新研究与工程智能神经形态与量子理解实验室，俄克拉荷马大学，诺曼，OK，USA）；Khiabani Data Science and Analytics Institute, University of Oklahoma, Norman, OK, USA（Khiabani数据科学与分析研究所，俄克拉荷马大学，诺曼，OK，USA）；Data Institute for Societal Challenges (DISC), University of Oklahoma, Norman, OK, USA（社会挑战数据研究所（DISC），俄克拉荷马大学，诺曼，OK，USA）；School of Industrial and Systems Engineering, University of Oklahoma, Norman, OK, USA（工业与系统工程学院，俄克拉荷马大学，诺曼，OK，USA）；Office of Responsible Artificial Intelligence (ORAI), University of Arizona, Tucson, AZ, USA（负责任人工智能办公室（ORAI），亚利桑那大学，图森，AZ，USA）
CasiMedicos-Arg: A Medical Question Answering Dataset Annotated with Explanatory Argumentative Structures
Université Côte d’Azur（蔚蓝海岸大学）；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化研究所）；I3S（信息科学与信号处理实验室）；HiTZ Center - Ixa（HiTZ中心-Ixa团队）；University of the Basque Country UPV/EHU（巴斯克大学）
To Reason or Not to: Selective Chain-of-Thought in Medical Question Answering
Department of Electrical and Computer Engineering（电气与计算机工程系）；University of Minnesota（明尼苏达大学）；Division of Computational Health Sciences, Department of Surgery（计算健康科学 division，外科系）；Department of Computer Science and Engineering（计算机科学与工程系）；Health Data Science, School of Public Health（公共卫生学院健康数据科学系）
CURE: Confidence-driven Unified Reasoning Ensemble Framework for Medical Question Answering
School of Information Technology and Computer Science, Nile University（信息科技与计算机科学学院，尼罗大学）；Graduate School of Information Science, University of Hyogo（信息科学研究生院，播磨大学）；Advanced Medical Engineering Research Institute, University of Hyogo（先进医疗工程研究所，播磨大学）
