发表机构
Cisco Systems（思科系统公司）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本文提出CoVe-RAG+框架，结合验证链与检索增强生成，通过外部权威来源和迭代自验证减少LLM幻觉，在工程任务中事实准确性提升28%，增强用户信任。
AI 中文摘要
大型语言模型（LLMs）正逐渐被用于高级工程任务，包括计算机辅助设计（CAD）文档编制、标准合规性验证和知识检索。然而，它们容易产生幻觉，即输出看似合理但缺乏上下文依据的内容，这限制了它们在精度和合规性至关重要的高端工程应用中的可信度。本文提出了CoVe-RAG+，一个统一框架，将验证链（CoVe）与检索增强生成（RAG）相结合，以减轻大型语言模型（LLMs）生成结果中的幻觉。CoVe-RAG+支持LLM在外部权威来源（如工程标准、CAD信息和仿真报告）中进行验证，同时应用迭代自验证过程来验证重要声明。CoVe-RAG+在工程活动上进行了评估，如CAD模型文档编制、标准合规性验证和历史设计数据的再利用。实验结果表明，与基线CoVe和RAG方法相比，事实准确性提高了28%。此外，CoVe-RAG+通过提供说明性验证报告和来源可追溯性增强了用户信心。研究结果表明，CoVe-RAG+为在事实准确性至关重要的工程设计流程中实施LLMs提供了一种可扩展且可靠的选项。
英文摘要
Large Language Models (LLMs) are progressively used for advanced engineering tasks, includes Computer-Aided Design (CAD) documentation, standards compliance verification, and knowledge retrieval. Still, they are prone to produce hallucinations, outputs that seem convincing but aren't based on context that limit their trustworthiness in high-end engineering applications where precision and compliance are crucial. The paper introduces CoVe-RAG+, a unified framework that integrates Chain-of-Verification (CoVe) with Retrieval-Augmented Generation (RAG) to mitigate hallucinations in the results generated by large language models (LLMs). CoVe-RAG+ supports LLM verification in external sources of authority, such as engineering standards, CAD information, and simulation reports, while applying an iterative self-verification process to validate important claims. CoVe-RAG+ is assessed on engineering activities such as CAD model documentation, standards compliance verification, and the reutilization of historical design data. Experimental findings indicate a 28% improvement in factual accuracy relative to baseline CoVe and RAG methodologies. Moreover, CoVe-RAG+ strengthens user confidence by providing elucidative verification reports and source traceability. The findings indicate that CoVe-RAG+ provides a scalable and reliable option for implementing LLMs in engineering design processes where factual accuracy is critical.
Journal refProceedings of the ASME 2025 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE2025), Anaheim, CA, USA, August 17-20, 2025, Paper No. DETC2025-169730, V02BT02A032
