arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.00470cs.CLcs.AI
收藏

PatternGPT:一种面向大语言模型文本生成的模式驱动框架

PatternGPT :A Pattern-Driven Framework for Large Language Model Text Generation

College of Information Science and Engineering, Henan University of Technology(河南工业大学信息科学与工程学院)

Le Xiao, Xin Shan

AI总结:

针对大语言模型易产生幻觉、无法直接用外部知识的问题,提出模式驱动框架PatternGPT,通过模式提取、多智能体共享和优质模式搜索优化生成质量,可应用于智能对话等领域。

摘要:

大语言模型(LLM)已展现出出色的文本生成能力,能够为众多下游任务生成流畅的类人响应。然而,由于大语言模型易产生幻觉且无法直接使用外部知识,将其应用于现实世界的关键任务仍具挑战性。为应对上述挑战,本文提出PatternGPT,一种面向大语言模型的模式驱动文本生成框架。首先,该框架利用大语言模型的提取能力生成丰富多样的结构化、形式化模式,为引入外部知识进行计算提供便利;随后借鉴联邦学习的思想,采用多智能体实现共享以获取更多样化的模式;最后利用判断准则和优化算法搜索高质量模式,用以指导模型生成。该框架具备生成多样化模式、保护数据隐私、融合外部知识、提升生成质量等优势,为优化大语言模型的文本生成能力提供了有效方法,使其能更好地应用于智能对话与内容生成领域。

英文摘要:

Large language models(LLMS)have shown excellent text generation capabilities, capable of generating fluent human-like responses for many downstream tasks. However, applying large language models to real-world critical tasks remains challenging due to their susceptibility to hallucinations and inability to directly use external knowledge. To cope with the above challenges, this paper proposes PatternGPT, a pattern-driven text generation framework for Large Language Models. Firstly, the framework utilizes the extraction capability of Large Language Models to generate rich and diversified structured and formalized patterns, which facilitates the introduction of external knowledge to do the computation, and then draws on the idea of federated learning to use multiple agents to achieve the sharing in order to obtain more diversified patterns, and finally uses judgment criteria and optimization algorithm to search for high-quality patterns to guide the generation of models. Finally, external knowledge such as judgment criteria and optimization algorithms are used to search for high-quality patterns, and the searched patterns are used to guide model generation. This framework has the advantages of generating diversified patterns, protecting data privacy, combining external knowledge, and improving the quality of generation, which provides an effective method to optimize the text generation capability of large language models, and make it better applied to the field of intelligent dialogue and content generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑