arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1606.00652cs.AI
收藏

通用人工智能中的死亡与自杀

Death and Suicide in Universal Artificial Intelligence

Australian National University(澳大利亚国立大学)

Jarryd Martin, Tom Everitt, Marcus Hutter

摘要:

强化学习(RL)是研究智能行为的一般范式,其应用范围从人工智能到心理学和经济学。AIXI是RL问题的通用解决方案;它可以学习任何可计算环境。AIXI的一个技术上的微妙之处在于它是使用和不需要为1的半测度上的混合来定义的,而不是在适当的概率测度上。在这项工作中,我们认为,不足的半测量可以自然地被解释为代理人的估计其死亡的概率。我们正式定义死亡一般智能代理,如AIXI,并证明了一些相关的定理,他们的行为。值得注意的发现包括,代理人的行为可以从根本上改变奖励信号的正线性变换(从自杀到教条式的自我保护),以及代理人的后验信念,它将生存随着时间的推移而增加。

英文摘要:

Reinforcement learning (RL) is a general paradigm for studying intelligent behaviour, with applications ranging from artificial intelligence to psychology and economics. AIXI is a universal solution to the RL problem; it can learn any computable environment. A technical subtlety of AIXI is that it is defined using a mixture over semimeasures that need not sum to 1, rather than over proper probability measures. In this work we argue that the shortfall of a semimeasure can naturally be interpreted as the agent's estimate of the probability of its death. We formally define death for generally intelligent agents like AIXI, and prove a number of related theorems about their behaviour. Notable discoveries include that agent behaviour can change radically under positive linear transformations of the reward signal (from suicidal to dogmatically self-preserving), and that the agent's posterior belief that it will survive increases over time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑