arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.08270cs.AIcs.CL
收藏

作为认知主体知识源的语言模型

Language Models as a Knowledge Source for Cognitive Agents

Center for Integrated Cognition(综合认知中心)

Robert E. Wray, III, James R. Kirk, John E. Laird

摘要:

语言模型(LM)是在大量语料库上训练的自动补全引擎。LM已经成为自然语言处理的一个重大突破,它提供的功能远远超出了句子完成,包括问答、摘要和自然语言推理。虽然这些能力中的许多都有潜在的应用认知系统,利用语言模型作为任务知识的来源,特别是任务学习,提供了显着的,近期的好处。我们介绍了语言模型和各种任务,他们已被应用,然后审查知识提取方法从语言模型。由此产生的分析概述了使用语言模型作为认知系统的新知识源的挑战和机遇。它还确定了可能的方法来提高知识提取语言模型使用认知系统提供的能力。成功的核心将是认知代理自身学习LM中隐含的知识的抽象模型的能力,以及有效和高效地提取高质量知识的方法。为了说明,我们介绍了一个假设的机器人代理,并描述了如何语言模型可以扩展其任务知识,提高其性能和代理可以使用的知识和方法的种类,以利用知识内的语言模型。

英文摘要:

Language models (LMs) are sentence-completion engines trained on massive corpora. LMs have emerged as a significant breakthrough in natural-language processing, providing capabilities that go far beyond sentence completion including question answering, summarization, and natural-language inference. While many of these capabilities have potential application to cognitive systems, exploiting language models as a source of task knowledge, especially for task learning, offers significant, near-term benefits. We introduce language models and the various tasks to which they have been applied and then review methods of knowledge extraction from language models. The resulting analysis outlines both the challenges and opportunities for using language models as a new knowledge source for cognitive systems. It also identifies possible ways to improve knowledge extraction from language models using the capabilities provided by cognitive systems. Central to success will be the ability of a cognitive agent to itself learn an abstract model of the knowledge implicit in the LM as well as methods to extract high-quality knowledge effectively and efficiently. To illustrate, we introduce a hypothetical robot agent and describe how language models could extend its task knowledge and improve its performance and the kinds of knowledge and methods the agent can use to exploit the knowledge within a language model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑