arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.22754cs.CVcs.AI
收藏

从工业故障排除指南中提取程序性知识:使用视觉语言模型

Procedural Knowledge Extraction from Industrial Troubleshooting Guides Using Vision Language Models

University of Groningen(Groningen大学)

Guillermo Gil de Avalle, Laura Maruster, Christos Emmanouilidis

AI总结:

本文研究如何利用视觉语言模型从工业故障排除指南中提取结构化知识,通过对比两种提示策略评估模型性能,揭示布局敏感性与语义稳健性的权衡。

摘要:

工业故障排除指南通过流程图般的图表编码诊断程序,其中空间布局和技术语言共同传达意义。为了将此知识整合到辅助工厂一线员工诊断和解决设备问题的操作支持系统中,信息必须首先被提取并结构化以便机器理解。然而,当手动执行时,这种提取过程是劳动密集型且容易出错的。视觉语言模型提供了自动化此过程的潜力,通过联合解释视觉和文本意义,但它们在这样的指南上的表现仍处于探索阶段。本文评估了两种VLMs在提取结构化知识方面的表现,比较了两种提示策略:标准指令引导与一种增强方法,该方法提示故障排除布局模式。结果揭示了模型之间的布局敏感性和语义稳健性之间的权衡,为实际部署决策提供了指导。

英文摘要:

Industrial troubleshooting guides encode diagnostic procedures in flowchart-like diagrams where spatial layout and technical language jointly convey meaning. To integrate this knowledge into operator support systems, which assist shop-floor personnel in diagnosing and resolving equipment issues, the information must first be extracted and structured for machine interpretation. However, when performed manually, this extraction is labor-intensive and error-prone. Vision Language Models offer potential to automate this process by jointly interpreting visual and textual meaning, yet their performance on such guides remains underexplored. This paper evaluates two VLMs on extracting structured knowledge, comparing two prompting strategies: standard instruction-guided versus an augmented approach that cues troubleshooting layout patterns. Results reveal model-specific trade-offs between layout sensitivity and semantic robustness, informing practical deployment decisions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑