arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.06402cs.CV
收藏

MeDocVL:一种用于医疗文档理解与解析的视觉语言模型

MeDocVL: A Visual Language Model for Medical Document Understanding and Parsing

Visual Computing Group (VCG)(视觉计算组)

Wenjie Wang, Wei Wu, Ying Liu, Yuan Zhao, Xiaole Lv, Liang Diao, Zengjian Fan, Wenfeng Xie, Ziling Lin, De Shi, Lin Huang, Kaihe Xu, Hong Li

AI总结:

MeDocVL通过训练驱动的标签细化和噪声意识的混合后训练策略,实现了对医疗文档的高精度解析,优于现有OCR和VLM方法。

摘要:

医疗文档OCR具有挑战性,由于复杂的布局、领域特定术语和嘈杂的标注,同时需要严格字段级别的精确匹配。现有OCR系统和通用视觉语言模型往往无法可靠地解析此类文档。我们提出了MeDocVL,一种用于查询驱动的医疗文档解析的后训练视觉语言模型。我们的框架结合了训练驱动的标签细化,以从嘈杂标注中构建高质量的监督,同时采用噪声意识的混合后训练策略,整合强化学习和监督微调,以实现稳健和精确的提取。在医疗发票基准测试中,实验表明MeDocVL在嘈杂监督下始终优于传统OCR系统和强大的VLM基线,实现了最先进的性能。

英文摘要:

Medical document OCR is challenging due to complex layouts, domain-specific terminology, and noisy annotations, while requiring strict field-level exact matching. Existing OCR systems and general-purpose vision-language models often fail to reliably parse such documents. We propose MeDocVL, a post-trained vision-language model for query-driven medical document parsing. Our framework combines Training-driven Label Refinement to construct high-quality supervision from noisy annotations, with a Noise-aware Hybrid Post-training strategy that integrates reinforcement learning and supervised fine-tuning to achieve robust and precise extraction. Experiments on medical invoice benchmarks show that MeDocVL consistently outperforms conventional OCR systems and strong VLM baselines, achieving state-of-the-art performance under noisy supervision.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑