arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.09176cs.AIcs.CLcs.SC
收藏

认知大语言模型:面向制造决策的认知架构与大语言模型融合研究

Cognitive LLMs: Towards Integrating Cognitive Architectures and Large Language Models for Manufacturing Decision-making

The Pennsylvania State University(宾夕法尼亚州立大学);Bosch Center for Artificial Intelligence(博世人工智能中心);Carnegie Mellon University(卡内基梅隆大学)

Siyu Wu, Alessandro Oltramari, Jonathan Francis, C. Lee Giles, Frank E. Ritter

AI总结:

针对大语言模型在制造决策中存在的幻觉、缺乏充分依据等问题,提出融合ACT-R认知架构与LLM的神经符号架构LLM-ACTR,在制造设计任务上相较纯LLM基线实现了任务性能和决策依据性的双重提升。

摘要:

弥合认知架构类人但受限的推理过程与大语言模型(LLM)广泛但常含噪声的推理行为之间的分歧,仍是一项具有挑战性但令人振奋的研究方向,其目标是在生产系统中实现可靠的机器推理能力。众所周知,认知架构的开发初衷是在计算层面建模人类认知决策的内部机制,因此新的研究探索了为LLM注入复现此类过程所需知识的目标,例如引导式感知、记忆、目标设定和行动。此前将LLM用于具身决策的方法在复杂推理任务中表现不佳,这类任务需要较慢的、深思熟虑的认知过程,而非快速直观的推理——相关研究报告了缺乏充分 grounding( grounding:基础 grounding,指模型输出与现实世界/事实依据的关联)的问题,比如幻觉。为解决这些挑战,我们提出了LLM-ACTR,这是一种新型神经符号架构,通过将ACT-R认知架构与LLM融合,实现符合人类认知的、通用的决策能力。我们的框架将ACT-R内部决策过程的知识提取并嵌入为潜在神经表征,将该信息注入可训练的LLM适配器层,然后针对下游预测任务微调LLM。我们在新型面向制造的设计任务上开展的实验表明,与采用思维链推理策略的纯LLM基线相比,我们的方法既提升了任务性能,也增强了具身决策能力。

英文摘要:

Resolving the dichotomy between the human-like yet constrained reasoning processes of Cognitive Architectures and the broad but often noisy inference behavior of Large Language Models (LLMs) remains a challenging but exciting pursuit, for enabling reliable machine reasoning capabilities in production systems. Because Cognitive Architectures are famously developed for the purpose of modeling the internal mechanisms of human cognitive decision-making at a computational level, new investigations consider the goal of informing LLMs with the knowledge necessary for replicating such processes, e.g., guided perception, memory, goal-setting, and action. Previous approaches that use LLMs for grounded decision-making struggle with complex reasoning tasks that require slower, deliberate cognition over fast and intuitive inference -- reporting issues related to the lack of sufficient grounding, as in hallucination. To resolve these challenges, we introduce LLM-ACTR, a novel neuro-symbolic architecture that provides human-aligned and versatile decision-making by integrating the ACT-R Cognitive Architecture with LLMs. Our framework extracts and embeds knowledge of ACT-R's internal decision-making process as latent neural representations, injects this information into trainable LLM adapter layers, and fine-tunes the LLMs for downstream prediction. Our experiments on novel Design for Manufacturing tasks show both improved task performance as well as improved grounded decision-making capability of our approach, compared to LLM-only baselines that leverage chain-of-thought reasoning strategies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑