AI人体潜在安全性研究注意事项(ARCHES)
AI Research Considerations for Human Existential Safety (ARCHES)
摘要:
这份报告以积极的方式审视了人工智能技术研究如何以一种更关注人类作为一个物种的长期生存前景的方式进行指导。从消极的角度来看,我们要问的是,下个世纪人工智能的发展可能会给人类带来什么样的生存风险,当代技术研究可以根据什么原则来解决这些风险。介绍了一个假设的人工智能技术的关键属性,称为\emph{prepotence},这是有用的描绘各种潜在的存在风险,从人工智能,即使人工智能范式可能会改变。一组\auxref{dirtot}当代研究\directions,然后检查其潜在的利益存在的安全。每一个研究方向都解释了一个由企业驱动的动机,以及现有工作的例子,从中建立。研究方向对社会提出了自己的风险和好处,可能会在不同的影响范围内发生,特别是如果在没有充分的预见和监督的情况下部署重大发展,则不能保证有利于存在安全。因此,每个方向都伴随着对潜在负面影响的考虑。
英文摘要:
Framed in positive terms, this report examines how technical AI research might be steered in a manner that is more attentive to humanity's long-term prospects for survival as a species. In negative terms, we ask what existential risks humanity might face from AI development in the next century, and by what principles contemporary technical research might be directed to address those risks. A key property of hypothetical AI technologies is introduced, called \emph{prepotence}, which is useful for delineating a variety of potential existential risks from artificial intelligence, even as AI paradigms might shift. A set of \auxref{dirtot} contemporary research \directions are then examined for their potential benefit to existential safety. Each research direction is explained with a scenario-driven motivation, and examples of existing work from which to build. The research directions present their own risks and benefits to society that could occur at various scales of impact, and in particular are not guaranteed to benefit existential safety if major developments in them are deployed without adequate forethought and oversight. As such, each direction is accompanied by a consideration of potentially negative side effects.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。