arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.00544cs.AIcs.LG
收藏

一种基于基础模型的燃烧科学可靠知识处理框架

A Reliable Knowledge Processing Framework for Combustion Science using Foundation Models

University of Michigan(密歇根大学)

Vansh Sharma, Venkat Raman

AI总结:

本研究针对燃烧科学领域多元数据处理需求,提出融合RAG框架、提示工程与离线开源大模型的知识处理框架,可降低成本、提升准确性与隐私性,有效减少幻觉问题,为科学数据同化研究提供基础。

摘要:

本研究探索将大语言模型(large language models, LLMs)融入科学数据同化,以燃烧科学为案例展开研究。研究利用集成了检索增强生成(Retrieval-Augmented Generation, RAG)框架的基础模型,提出了一种处理各类燃烧研究数据的方法,覆盖实验研究、模拟仿真和文献资料三类数据。燃烧研究的多面性凸显了知识处理在从海量多元来源中梳理和提取有价值信息方面的关键作用。所提出的方法在优化数据隐私性与准确性的同时,降低了计算成本与经济开销。该方法融合了提示工程与离线开源LLM,支持用户自主选择基础模型。本研究对文本分割策略进行了全面梳理,开展了不同LLM之间的对比研究,并探索了多种优化后的提示词以验证框架的有效性。通过接入外部数据库,该框架在生成准确回答、构建严谨论证方面的表现优于传统LLM。此外,本研究还深入探究了用于高效提取科学文献信息的优化提示模板。为解决幻觉问题和虚假研究文献问题,本研究设计了定制工作流,搭配检测算法以过滤不准确信息。尽管仍存在可改进之处,该框架能在极少人工监督的情况下持续输出准确的领域专属回答。所提出的与提示无关的方法为后续相关研究提供了可行方向。本研究强调了将LLM与知识处理技术融入科学研究的重要意义,为数据同化与数据利用领域的进展奠定了基础。

英文摘要:

This research explores the integration of large language models (LLMs) into scientific data assimilation, focusing on combustion science as a case study. Leveraging foundational models integrated with Retrieval-Augmented Generation (RAG) framework, the study introduces an approach to process diverse combustion research data, spanning experimental studies, simulations, and literature. The multifaceted nature of combustion research emphasizes the critical role of knowledge processing in navigating and extracting valuable information from a vast and diverse pool of sources. The developed approach minimizes computational and economic expenses while optimizing data privacy and accuracy. It incorporates prompt engineering and offline open-source LLMs, offering user autonomy in selecting base models. The study provides a thorough examination of text segmentation strategies, conducts comparative studies between LLMs, and explores various optimized prompts to demonstrate the effectiveness of the framework. By incorporating an external database, the framework outperforms a conventional LLM in generating accurate responses and constructing robust arguments. Additionally, the study delves into the investigation of optimized prompt templates for the purpose of efficient extraction of scientific literature. The research addresses concerns related to hallucinations and false research articles by introducing a custom workflow developed with a detection algorithm to filter out inaccuracies. Despite identified areas for improvement, the framework consistently delivers accurate domain-specific responses with minimal human oversight. The prompt-agnostic approach introduced holds promise for future deliberations. The study underscores the significance of integrating LLMs and knowledge processing techniques in scientific research, providing a foundation for advancements in data assimilation and utilization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑