arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.09355cs.CL
收藏

NL2GenSym:基于大语言模型将自然语言转化为SOAR认知架构的生成式符号规则

NL2GenSym: Natural Language to Generative Symbolic Rules for SOAR Cognitive Architecture via Large Language Models

College of Systems Engineering, National University of Defense Technology(系统工程学院,国防科技大学);State Key Laboratory of Digital Intelligent Modeling and Simulation(数字智能建模与仿真国家重点实验室);Test Center, National University of Defense Technology(测试中心,国防科技大学)

Fang Yuan, Junjie Zeng, Yue Hu, Zhengqiu Zhu, Quanjun Yin, Yuxiang Xie

AI总结:

本文提出NL2GenSym框架,通过引入基于执行落地的生成器-评论家机制结合LLM与SOAR,自主从自然语言生成符号规则,在WJP数据集上实现超86%成功率并显著降低决策周期,且使小模型表现优于大模型。

摘要:

SOAR是一种经典的基于符号的认知架构,一直致力于促进通用且类人智能体的发展。然而,其手动编写规则的过程十分费力,阻碍了实际应用。新兴的大语言模型(LLMs)在高效生成规则方面展现出巨大潜力。然而,目前存在一个关键空白:当前研究主要集中于概念框架,且缺乏稳健的实验验证。为了填补这一空白,我们提出了自然语言到生成式符号规则(NL2GenSym),这是一种将LLMs与SOAR集成以从自然语言中自主生成生成式符号规则的新颖框架。具体而言,该框架引入了一种新颖的基于执行落地的生成器-评论家机制。基于LLM的生成器在访问检索增强生成(RAG)的自演化领域知识库的引导下,从自然语言中提出规则。随后,这些规则在SOAR环境中立即执行,以严格验证其正确性。基于这种基于执行落地的反馈,具有反思能力的基于LLM的评论器驱动这些规则的迭代优化。在我们专用的Water Jug Problem(WJP)数据集上进行的实验利用了Gemini和Qwen系列模型,验证了我们框架的有效性。它在从自然语言生成规则方面实现了超过86%的成功率。至关重要的是,该框架还生成了新颖的启发式规则,将解决WJP的平均决策周期减少至最优解的1.98倍以及基线方法的1/1000。此外,我们的初步实验表明,NL2GenSym使较小参数模型能够实现比较大规模同类模型更好的性能。

英文摘要:

SOAR, a classic symbol-based cognitive architecture, has been fostering the development of general, human-like intelligent agents. Nevertheless, its practical adoption is hindered by the laborious manual rule coding. Emerging Large Language Models (LLMs) present the immense potential for efficient rules generation. However, there is a critical gap that current research predominantly focuses on conceptual frameworks and lacks robust experimental validation. To bridge this gap, we propose \textit{N}atural \textit{L}anguage to \textit{Gen}erative \textit{Sym}bolic Rules (NL2GenSym), a novel framework that integrates LLMs with SOAR to autonomously produce generative symbolic rules from natural language. Specifically, our framework introduces a novel Execution-Grounded Generator-Critic mechanism. The LLM-based Generator, guided by a Retrieval-Augmented Generation-accessed self-evolving domain knowledge base, proposes rules from natural language. Subsequently, these rules are immediately executed within the SOAR environment to rigorously validate their correctness. Based on this execution-grounded feedback, a reflective LLM-based Critic drives the iterative refinement of these rules. Experiments on our specialized Water Jug Problem (WJP) dataset, utilizing both Gemini and Qwen series models, validate the efficacy of our framework. It achieves a success rate over 86\% in generating rules from natural language. Crucially, the framework also generates novel heuristic rules, reducing average decision cycles for solving the WJP to 1.98 times the optimal solution and 1/1000 of baseline methods. Additionally, our initial experiments show that NL2GenSym enables smaller-parameter models to achieve better performance than larger counterparts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑