arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.04477cs.CVcs.AIcs.CLcs.LG

MedCLM:在医学视觉语言模型中通过思维链课程学习定位与推理

MedCLM: Learning to Localize and Reason via a CoT-Curriculum in Medical Vision-Language Models

A.I.MATICS Inc(A.I.MATICS公司);Boston University(波士顿大学);University of Southern California(南加州大学);Heuron(Heuron公司);MODULABS, Open Neural Networks Research Lab(MODULABS,开放神经网络研究实验室)

Soo Yong Kim, Suin Cho, Vincent-Daniel Yun, Gyeongyeon Hwang

AI总结:

针对医学成像中AI结合临床诊断推理的难题,提出MedCLM流水线生成带思维链的医学VQA数据,并设计三阶段集成式CoT课程策略,在多个基准上达SOTA,提供可扩展的临床对齐医学视觉语言模型开发框架。

摘要:

在医学成像领域,将临床诊断推理与人工智能相结合仍是一项核心挑战。我们提出MedCLM,这是一套自动化流水线,可通过将病灶框与器官分割及结构化推理依据相关联,将检测数据集转化为具备Chain-of-Thought(CoT,思维链)推理能力的大规模医学视觉问答(VQA)数据。这些上下文信号能让医学视觉语言模型生成带有逐步推理过程的问答对。为有效利用这些数据,我们提出集成式CoT课程策略,包含三个阶段:简单阶段使用显式病灶框实现视觉定位,中等阶段鼓励隐式定位,困难阶段用于弱监督推理。实验结果表明,MedCLM在多个医学VQA基准上取得了当前最优性能,为开发符合临床需求的医学视觉语言模型提供了可扩展框架。

英文摘要:

Bridging clinical diagnostic reasoning with AI remains a central challenge in medical imaging. We introduce MedCLM, an automated pipeline that converts detection datasets into large-scale medical visual question answering (VQA) data with Chain-of-Thought (CoT) reasoning by linking lesion boxes to organ segmentation and structured rationales. These contextual signals enable medical vision-language models to generate question-answer pairs with step-by-step reasoning. To utilize this data effectively, we propose an Integrated CoT-Curriculum Strategy composed of an Easy stage with explicit lesion boxes for visual grounding, a Medium stage that encourages implicit localization, and a Hard stage for weakly supervised reasoning. Experimental results demonstrate that MedCLM attains state-of-the-art performance on several medical VQA benchmarks, providing a scalable framework for developing clinically aligned medical vision-language models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑