arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2206.01044cs.AI
收藏

用于评估通用人工智能(AGI)的人工开放世界:一种概念设计

Artificial Open World for Evaluating AGI: a Conceptual Design

Peking University(北京大学)

Bowen Xu, Quansheng Ren

AI总结:

针对AGI评估中存在的“开发者经验陷阱”难题,本文提出“人工开放世界”评估方法的概念设计,通过构建开发者测试前无法感知的开放人工世界,配套通用问题形式与量化指标,为AGI评估提供新的可行思路。

摘要:

如何评估通用人工智能(Artificial General Intelligence,AGI)是一个长期被讨论却悬而未决的关键问题。在窄人工智能(narrow AI)研究中,这似乎算不上严峻问题,因为该领域的研究者聚焦于特定问题以及认知的一个或若干方面,且评估标准有明确的定义。相比之下,AGI智能体应当能解决智能体和开发者都从未遇到过的问题。然而,一旦开发者用某个问题对智能体进行测试和调试,这个从未遇到的问题就变成了已遇到的问题,如此一来,问题在一定程度上是开发者利用自身经验解决的,而非智能体独立解决。我们将这一矛盾称为“开发者经验陷阱”,它导致这类问题很难成为公认的评估标准。\n本文提出了一种名为“人工开放世界(Artificial Open World)”的评估方法,旨在跳出这一陷阱。其核心思路是:现实世界中的大部分经验不必适用于人工世界,且该世界在某种意义上应当是开放的,使得开发者在测试前无法感知这个世界、也无法自行解决其中的问题,但测试后他们可以查看所有数据。该世界以与现实世界相似的方式生成,本文还提出了问题的通用形式,并设计了一项旨在量化研究进展的指标。本文阐述了人工开放世界的概念设计,其形式化与实现工作将留待未来开展。

英文摘要:

How to evaluate Artificial General Intelligence (AGI) is a critical problem that is discussed and unsolved for a long period. In the research of narrow AI, this seems not a severe problem, since researchers in that field focus on some specific problems as well as one or some aspects of cognition, and the criteria for evaluation are explicitly defined. By contrast, an AGI agent should solve problems that are never-encountered by both agents and developers. However, once a developer tests and debugs the agent with a problem, the never-encountered problem becomes the encountered problem, as a result, the problem is solved by the developers to some extent, exploiting their experience, rather than the agents. This conflict, as we call the trap of developers' experience, leads to that this kind of problems is probably hard to become an acknowledged criterion. In this paper, we propose an evaluation method named Artificial Open World, aiming to jump out of the trap. The intuition is that most of the experience in the actual world should not be necessary to be applied to the artificial world, and the world should be open in some sense, such that developers are unable to perceive the world and solve problems by themselves before testing, though after that they are allowed to check all the data. The world is generated in a similar way as the actual world, and a general form of problems is proposed. A metric is proposed aiming to quantify the progress of research. This paper describes the conceptual design of the Artificial Open World, though the formalization and the implementation are left to the future.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑