arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.11678cs.AIcs.CV

超越像素:用于可靠图示审计的向量到图转换

Beyond Pixels: A Vector-to-Graph Framework for Reliable Schematic Auditing

Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(人工智能与数字经济广东实验室);Guangdong Power Grid Co., Ltd.(广东电网公司);Shanghai University(上海大学);Carleton University(卡尔顿大学)

Chengwei Ma, Zhen Tian, Zhou Zhou, Zhixian Xu, Xiaowei Zhu, Xia Hua, Si Shi, F. Richard Yu

AI总结:

本文提出向量到图转换方法,通过将CAD图转换为属性图,提升工程图示审计的准确性,克服基于像素方法的局限性。

摘要:

多模态大语言模型(MLLMs)在视觉理解方面取得了显著进展,但它们存在一个关键局限:结构盲区。即使是最先进的模型也无法捕捉工程图示中的拓扑结构和符号逻辑,因为其基于像素的范式会丢弃用于推理所需的显式向量定义关系。为了解决这一问题,我们提出了一种向量到图(V2G)流程,将CAD图转换为属性图,其中节点代表组件,边编码连接性,使结构依赖性显式化并可被机器审计。在电气合规性检查的诊断基准测试中,V2G在所有错误类别中均实现了显著的准确性提升,而领先的MLLMs仍接近随机水平。这些结果突显了基于像素的方法的系统不足,并证明了结构感知的表示为在工程领域部署多模态AI提供了可靠的途径。为了促进进一步研究,我们在此发布基准测试和实现:https://github.com/gm-embodied/V2G-Audit。

英文摘要:

Multimodal Large Language Models (MLLMs) have shown remarkable progress in visual understanding, yet they suffer from a critical limitation: structural blindness. Even state-of-the-art models fail to capture topology and symbolic logic in engineering schematics, as their pixel-driven paradigm discards the explicit vector-defined relations needed for reasoning. To overcome this, we propose a Vector-to-Graph (V2G) pipeline that converts CAD diagrams into property graphs where nodes represent components and edges encode connectivity, making structural dependencies explicit and machine-auditable. On a diagnostic benchmark of electrical compliance checks, V2G yields large accuracy gains across all error categories, while leading MLLMs remain near chance level. These results highlight the systemic inadequacy of pixel-based methods and demonstrate that structure-aware representations provide a reliable path toward practical deployment of multimodal AI in engineering domains. To facilitate further research, we release our benchmark and implementation at https://github.com/gm-embodied/V2G-Audit.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑