动态决策学习:罕见疾病异常定位的测试时间演化
Dynamic Decision Learning: Test-Time Evolution for Abnormality Grounding in Rare Diseases
AI总结:
本文提出动态决策学习框架,通过优化指令和视觉扰动下的预测整合,提升冻结大视觉语言模型在罕见疾病异常定位中的表现,实验显示其在罕见疾病案例中mAP@75提升达105%。
摘要:
临床罕见疾病异常定位常受限于数据稀缺,导致监督微调不现实且单次推理不稳定。我们提出动态决策学习(DDL),一种框架,使冻结的大视觉语言模型(LVLM)能够在语言和视觉空间中通过优化指令和在视觉扰动下整合预测来细化决策。此过程提高了定位质量并生成基于共识的可靠性分数以量化模型置信度。在包含281种病理类型的罕见疾病数据集上,脑影像基准测试结果表明,DDL在罕见疾病案例中将mAP@75提升高达105%,优于适应基线和监督微调。此外,DDL在严重分布偏移和增加任务难度下展示了更稳定的可靠性分数与定位准确性之间的校准。代码可在:https://lijunrio.github.io/DDL/
英文摘要:
Clinical abnormality grounding for rare diseases is often hindered by data scarcity, making supervised fine-tuning impractical and single-pass inference highly unstable. We propose Dynamic Decision Learning (DDL), a framework that enables frozen large vision-language models (LVLMs) to refine their decisions across both language and visual spaces by optimizing instructions and consolidating predictions under visual perturbations. This process improves localization quality and produces a consensus-based reliability score that quantifies model confidence. Results on brain imaging benchmarks, including a rare-disease dataset with 281 pathology types across models ranging from 3B to 72B parameters, show that DDL improves mAP@75 by up to 105% on rare-disease cases and outperforms adaptation baselines and supervised fine-tuning. Furthermore, DDL demonstrates stronger calibration between reliability scores and localization accuracy under severe distribution shifts and increasing task difficulty. Code is available at: https://lijunrio.github.io/DDL/
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。