部分嵌入式智能体中的走线问题分类
Categorizing Wireheading in Partially Embedded Agents
摘要:
$\textit{Embedded agents}$没有明确地与其环境分离,缺乏清晰的I/O通道。这些智能体可以推理和修改它们的内部部分,它们被激励去捷径或$\textit{wirehead}$,以获得最大的回报。在本文中,我们提供了一个分类的方式,其中wireheading可能发生,其次是wirehead-vulnerable代理的定义。从完全二元的通用代理AIXI开始,我们引入了一系列部分嵌入式代理,并确定了这些代理可以利用的wireheading机会,实验证明了GRL仿真平台AIXIjs的结果。我们上下文中的wireheading在更广泛的类的所有错位问题-代理的目标与人类设计师的目标冲突-和猜想,唯一的其他可能类型的错位是规范游戏。出于这种分类法,我们定义wirehead脆弱的代理作为嵌入式代理,选择不同的行为完全二元代理缺乏访问其内部部分。
英文摘要:
$\textit{Embedded agents}$ are not explicitly separated from their environment, lacking clear I/O channels. Such agents can reason about and modify their internal parts, which they are incentivized to shortcut or $\textit{wirehead}$ in order to achieve the maximal reward. In this paper, we provide a taxonomy of ways by which wireheading can occur, followed by a definition of wirehead-vulnerable agents. Starting from the fully dualistic universal agent AIXI, we introduce a spectrum of partially embedded agents and identify wireheading opportunities that such agents can exploit, experimentally demonstrating the results with the GRL simulation platform AIXIjs. We contextualize wireheading in the broader class of all misalignment problems - where the goals of the agent conflict with the goals of the human designer - and conjecture that the only other possible type of misalignment is specification gaming. Motivated by this taxonomy, we define wirehead-vulnerable agents as embedded agents that choose to behave differently from fully dualistic agents lacking access to their internal parts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。