面向汽车行业PDF聊天机器人的RAG技术优化：基于本地部署Ollama模型的案例研究
Optimizing RAG Techniques for Automotive Industry PDF Chatbots: A Case Study with Locally Deployed Ollama Models
AI总结：
本研究针对汽车工业离线PDF聊天机器人需求，基于Langchain框架提出本地Ollama模型的多维RAG优化方案，解决多栏布局等文档处理难题，构建专有数据集验证后，在多项指标上显著优于基线模型。
摘要：
随着汽车工业生产环境对离线PDF聊天机器人的需求不断增长，在本地低性能环境中优化大语言模型（LLM）的部署变得日益重要。本研究聚焦于利用本地部署的Ollama模型，增强检索增强生成（RAG）技术以处理复杂的汽车行业文档。我们基于Langchain框架，针对Ollama的本地RAG实现提出了一种多维优化方法。\n我们的方法解决了汽车文档处理中的关键挑战，包括多栏布局和技术规范问题。我们针对汽车行业文档的独特特性，在PDF处理、检索机制和上下文压缩方面进行了改进。此外，我们遵循LangGraph最佳实践，设计了支持嵌入流水线的自定义类，以及一个支持self-RAG（自检索增强生成）的智能体。\n为评估我们的方法，我们构建了一个包含典型汽车行业文档的专有数据集，涵盖技术报告和公司规章制度。我们在三个数据集上对比了优化后的RAG模型、self-RAG智能体与朴素RAG基线的性能，这三个数据集分别是：我们的汽车行业数据集、QReCC和CoQA。结果显示，模型在上下文精确率、上下文召回率、答案相关性和忠实度方面均有显著提升，在汽车行业数据集上的表现尤为突出。\n我们的优化方案为汽车行业部署本地RAG系统提供了有效解决方案，满足了工业生产环境中PDF聊天机器人的特定需求。本研究对推动汽车行业的信息处理和智能化生产具有重要意义。
英文摘要：
With the growing demand for offline PDF chatbots in automotive industrial production environments, optimizing the deployment of large language models (LLMs) in local, low-performance settings has become increasingly important. This study focuses on enhancing Retrieval-Augmented Generation (RAG) techniques for processing complex automotive industry documents using locally deployed Ollama models. Based on the Langchain framework, we propose a multi-dimensional optimization approach for Ollama's local RAG implementation. Our method addresses key challenges in automotive document processing, including multi-column layouts and technical specifications. We introduce improvements in PDF processing, retrieval mechanisms, and context compression, tailored to the unique characteristics of automotive industry documents. Additionally, we design custom classes supporting embedding pipelines and an agent supporting self-RAG based on LangGraph best practices. To evaluate our approach, we constructed a proprietary dataset comprising typical automotive industry documents, including technical reports and corporate regulations. We compared our optimized RAG model and self-RAG agent against a naive RAG baseline across three datasets: our automotive industry dataset, QReCC, and CoQA. Results demonstrate significant improvements in context precision, context recall, answer relevancy, and faithfulness, with particularly notable performance on the automotive industry dataset. Our optimization scheme provides an effective solution for deploying local RAG systems in the automotive sector, addressing the specific needs of PDF chatbots in industrial production environments. This research has important implications for advancing information processing and intelligent production in the automotive industry.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
