arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.12147cs.AIcs.CL
收藏

通过大型语言模型引出问题规范

Eliciting Problem Specifications via Large Language Models

Center for Integrated Cognition(综合认知中心);IQM Research Institute(IQM研究所)

Robert E. Wray, James R. Kirk, John E. Laird

AI总结:

本文设计基于 LLM 的认知任务分析智能体,将自然语言问题类别转化为问题空间规范,使现有认知系统可借助通用弱方法求解多类实例。

摘要:

认知系统通常需要人类将问题定义转化为某种规范,以便认知系统利用该规范尝试解决问题或执行任务。在本文中,我们说明大型语言模型(LLM)可用于将以自然语言定义的问题类别映射为半形式化规范,随后现有推理与学习系统可利用该规范解决该问题类别的实例。我们提出了支持 LLM 的认知任务分析智能体的设计。该系统通过 LLM 智能体实现,为以自然语言指定的任务生成问题空间定义。LLM 提示源自 AI 文献中对问题空间的定义以及通用问题解决策略(Polya 的《How to Solve It》)。随后,认知系统可以使用该问题空间规范,应用领域通用的问题解决策略(诸如搜索之类的“弱方法”),来解决该问题类别中的多个问题实例。这一结果虽然尚属初步,但表明通过去除问题表述中的人工中介环节,同时保留认知系统的核心能力(如稳健推理和在线学习),有望加快认知系统研究。

英文摘要:

Cognitive systems generally require a human to translate a problem definition into some specification that the cognitive system can use to attempt to solve the problem or perform the task. In this paper, we illustrate that large language models (LLMs) can be utilized to map a problem class, defined in natural language, into a semi-formal specification that can then be utilized by an existing reasoning and learning system to solve instances from the problem class. We present the design of LLM-enabled cognitive task analyst agent(s). Implemented with LLM agents, this system produces a definition of problem spaces for tasks specified in natural language. LLM prompts are derived from the definition of problem spaces in the AI literature and general problem-solving strategies (Polya's How to Solve It). A cognitive system can then use the problem-space specification, applying domain-general problem solving strategies ("weak methods" such as search), to solve multiple instances of problems from the problem class. This result, while preliminary, suggests the potential for speeding cognitive systems research via disintermediation of problem formulation while also retaining core capabilities of cognitive systems, such as robust inference and online learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑