arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2609.05116cs.ETcs.IR

超越维护手册多模态检索增强生成:工具建议

Beyond Maintenance Manual Multimodal RAG: Suggesting What Tool

Seongjun Ha, Md Rashedul Islam

首次发表
浏览论文内容

中文总结 AI 辅助

针对飞机维修技术人员查阅维护手册耗时及工具需求不明确问题,提出MRAG-SWAT扩展MRAG流程,在检索流程时同步返回所需手工与专用工具,经8个查询验证可减少维修问题并支持适航。

中文摘要 AI 辅助

飞机维修技术人员几乎每项任务都需查阅维护手册(MM),在数百页中定位相关流程仍耗时良久。多模态检索增强生成(MRAG)已被提出解决该问题,使技术人员可通过自然语言查询检索流程及配套图表。但仅检索无法告知技术人员任务所需工具:MM仅在对应步骤才标注专用工具,完全未提及手工工具需求;选择手工工具时,技术人员需从零件图解目录(IPC)查找硬件尺寸并据此推断合适工具。为此,我们提出MRAG-SWAT,即MRAG流程的扩展版本,可在返回检索到的流程的同时,返回所需手工工具和专用工具。该框架针对莱康明IO-360-N1A发动机实现,并在8个测试查询上验证。通过在流程中呈现正确工具,MRAG-SWAT或可减少往返工具间的次数,避免因工具选择不当导致的飞机损坏,进而减少额外维修任务并支持持续适航。

英文摘要

Aircraft technicians are required to consult the maintenance manual (MM) for nearly every task, and locating the relevant procedure across hundreds of pages remains time-consuming. Multimodal retrieval augmented generation (MRAG) has been proposed to address this, allowing technicians to retrieve procedures, together with the accompanying figures, through natural-language queries. However, retrieval alone does not tell the technicians which tools the task requires. The MM identifies special tools only when the corresponding step is reached, and it does not state hand tool requirements at all; to select hand tools, technicians are required to find the hardware dimension from the illustrated parts catalog (IPC) and infer the right tool from it. We therefore propose MRAG-SWAT, an extension of the MRAG pipeline that returns the required hand tools and special tools alongside the retrieved procedure. The framework was implemented for the Lycoming IO-360-N1A engine and demonstrated on eight test queries. By presenting the correct tools together with the procedure, MRAG-SWAT may help reduce repeated trips to the tool crib, prevent damage to aircraft caused by improper tool selection, and thereby avoid additional maintenance tasks and support continued airworthiness.

↑