arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.04476cs.LG
收藏

LLM-R:结合分层智能体与RAG的领域自适应维护方案生成框架

LLM-R: A Framework for Domain-Adaptive Maintenance Scheme Generation Combining Hierarchical Agents and RAG

Beihang University(北京航空航天大学);Nanyang Technological University(南洋理工大学)

Laifa Tao, Qixuan Huang, Xianjun Wu, Weiwei Zhang, Yunlong Wu, Bin Li, Chen Lu, Xingshuo Hai

AI总结:

提出LLM-R框架,结合LORA-KR微调、分层智能体与RAG技术,实现领域自适应维护方案生成,准确率达91.59%。

摘要:

智能设备的日益普及凸显了维护在生产活动中的关键作用。交互式电子技术手册(IETMs)是支持智能设备维护的重要工具。然而,传统IETMs面临从图形用户界面(GUIs)向自然语言用户界面(LUIs)过渡以及管理复杂逻辑关系等挑战。此外,它们还需满足当前对更高智能化的需求。本文提出了一种基于大语言模型(LLM-R)的维护方案生成方法。该方法包含多项关键创新:我们提出了低秩自适应-知识保留(LORA-KR)损失技术,以按比例调整混合维护数据用于大语言模型的微调。该方法防止了混合数据引起的知识冲突,提高了模型在特定维护领域的适应性和推理能力。此外,采用基于分层任务智能体和指令级检索增强生成(RAG)技术来优化生成步骤,并缓解因模型无法访问上下文信息而产生的幻觉现象。这一增强提高了模型在处理已知或未知维护对象及维护方案场景时的灵活性和准确性。为验证所提方法在维护任务中的有效性,使用不同领域的对象构建了维护方案数据集。实验结果表明,所提方法生成的维护方案准确率达到91.59%,这表明该改进提升了维护方案的智能化水平,并为设备维护引入了新颖的技术途径。

英文摘要:

The increasing use of smart devices has emphasized the critical role of maintenance in production activities. Interactive Electronic Technical Manuals (IETMs) are vital tools that support the maintenance of smart equipment. However, traditional IETMs face challenges such as transitioning from Graphical User Interfaces (GUIs) to natural Language User Interfaces (LUIs) and managing complex logical relationships. Additionally, they must meet the current demands for higher intelligence. This paper proposes a Maintenance Scheme Generation Method based on Large Language Models (LLM-R). The proposed method includes several key innovations: We propose the Low Rank Adaptation-Knowledge Retention (LORA-KR) loss technology to proportionally adjust mixed maintenance data for fine-tuning the LLM. This method prevents knowledge conflicts caused by mixed data, improving the model's adaptability and reasoning ability in specific maintenance domains, Besides, Hierarchical Task-Based Agent and Instruction-level Retrieval-Augmented Generation (RAG) technologies are adopted to optimize the generation steps and mitigate the phenomenon of hallucination caused by the model's Inability to access contextual information. This enhancement improves the model's flexibility and accuracy in handling known or unknown maintenance objects and maintenance scheme scenarios. To validate the proposed method's effectiveness in maintenance tasks, a maintenance scheme dataset was constructed using objects from different fields. The experimental results show that the accuracy of the maintenance schemes generated by the proposed method reached 91.59%, indicating which improvement enhances the intelligence of maintenance schemes and introduces novel technical approaches for equipment maintenance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑