AGI安全性的增强功利主义
Augmented Utilitarianism for AGI Safety
摘要:
鉴于人工智能系统的研究不断取得进展,表现出稳定增长的解决问题的能力,识别实用的解决方案,在AGI安全的价值对齐问题正成为当务之急。在这种情况下,一个突出的挑战,已经解决了多个研究人员是适当的制定效用函数或等价物可靠地捕捉人类的道德观念。然而,规定适当的效用函数有可能“不正当地举例说明”,因此迄今尚未就负责任的积极反措施达成最后共识。在这种背景下,我们提出了一个新的社会技术伦理框架表示的扩大功利主义,直接阐明了反常的实例化问题。我们详细阐述了人工智能和更普遍的科学技术如何增强,它可能使社会能够制定和更新道德效用函数,同时共同经历动态的道德增强。此外,我们阐明了需要考虑体现模拟的效用函数的AGIs与人类价值观的设计。最后,我们讨论了未来的前景,使用所提出的科学为基础的伦理框架,并提到可能的挑战。
英文摘要:
In the light of ongoing progresses of research on artificial intelligent systems exhibiting a steadily increasing problem-solving ability, the identification of practicable solutions to the value alignment problem in AGI Safety is becoming a matter of urgency. In this context, one preeminent challenge that has been addressed by multiple researchers is the adequate formulation of utility functions or equivalents reliably capturing human ethical conceptions. However, the specification of suitable utility functions harbors the risk of "perverse instantiation" for which no final consensus on responsible proactive countermeasures has been achieved so far. Amidst this background, we propose a novel socio-technological ethical framework denoted Augmented Utilitarianism which directly alleviates the perverse instantiation problem. We elaborate on how augmented by AI and more generally science and technology, it might allow a society to craft and update ethical utility functions while jointly undergoing a dynamical ethical enhancement. Further, we elucidate the need to consider embodied simulations in the design of utility functions for AGIs aligned with human values. Finally, we discuss future prospects regarding the usage of the presented scientifically grounded ethical framework and mention possible challenges.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。