arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.01045cs.AI
收藏

Med-CRAFT:通过知识图谱遍历自动构建可解释的多跳视频工作负载

Med-CRAFT: An Information System for Explainable and Configurable Construction of Multimodal Medical QA Datasets

Beijing Institute of Technology(北京理工大学);The Hong Kong Polytechnic University(香港理工大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究所)

Shenxi Liu, Kan Li, Mingyang Zhao, Yuhang Tian, Bin Li

AI总结:

Med-CRAFT通过知识图谱遍历自动构建可解释的多跳视频工作负载,生成具有细粒度时间选择性和多跳逻辑复杂性的医疗视频推理基准。

摘要:

高质量、逻辑标注的视频数据集稀缺仍然是推动多模态大语言模型(MLLM)在医疗领域发展的主要瓶颈。传统手动标注成本高昂且不可扩展,而现有合成方法常面临随机幻觉和缺乏逻辑可解释性的问题。为了解决这些挑战,我们引入了\PipelineName,一种新的神经符号数据工程框架,将基准合成形式化为确定性图遍历过程。不同于黑盒生成方法,Med-CRAFT从原始视频流中提取结构化的视觉基本元素(例如手术工具、解剖边界),并将它们实例化为动态时空知识图。通过将查询生成锚定在图内的有效路径上,我们强制每个合成基准项都具有严格的思维链(CoT)溯源。我们实例化该流程以生成M3-Med-Auto,一个具有细粒度时间选择性和多跳逻辑复杂性的大规模医疗视频推理基准。全面评估表明,我们的自动化流程生成的查询工作负载的复杂性与专家整理的数据集相当。此外,逻辑对齐分析揭示了规定的图拓扑与最先进MLLM的推理步骤之间存在高度相关性,验证了系统将可验证逻辑编码进视觉-语言基准的能力。这项工作为在关键领域内可扩展、低成本构建稳健评估协议铺平了道路。

英文摘要:

Data-intensive artificial intelligence applications increasingly rely on large-scale, high-quality, explainable, and reproducible datasets, yet the construction of such datasets often remains labor-intensive, weakly traceable, and difficult to configure. This problem is particularly critical in multimodal medical scenarios, where each question-answer sample should be semantically consistent, grounded in visual and temporal evidence, and controllable in terms of reasoning complexity. To address these challenges, we propose Med-CRAFT, an information system for explainable and configurable construction of multimodal medical question answering datasets from instructional videos. Med-CRAFT organizes dataset construction as a provenance-aware pipeline that transforms raw medical instructional videos into structured operation knowledge graphs, evidence-grounded reasoning paths, and natural-language question-answer pairs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑