人工智能即算法模仿:为什么人工“智能体”不是(也不会是)真正的能动者
Artificial intelligence is algorithmic mimicry: why artificial "agents" are not (and won't be) proper agents
AI总结:
本文通过比较生命系统与算法系统在自创生、具身性和问题世界三方面的根本差异,论证当前算法框架下不可能产生真正的 AGI 与能动性,主张聚焦窄 AI 的风险与机遇。
摘要:
开发人工通用智能(AGI)的前景如何?我通过系统比较生命系统与算法系统来研究这一问题,并特别关注“能动性”这一概念。二者之间存在三个根本差异:(1)生命系统是自创生的,即自我制造的,因此能够设定自身的内在目标;而算法存在于计算环境中,其目标函数均由外部能动者提供。(2)生命系统是具身的,其符号层面与物理层面之间不存在分离;而算法运行在最大限度地将软件与硬件隔离开的计算架构上。(3)生命系统置身于一个大世界中,其中大多数问题都是定义不良的(且并非所有问题都可定义);而算法存在于一个小世界中,其中所有问题都是定义良好的。这三个差异意味着生命系统与算法系统具有截然不同的能力和局限。特别是,在当前人工智能研究的算法框架内,开发出超越单纯模仿的真正 AGI 的可能性极低。因此,关于算法工具恰当开发与部署的讨论,应围绕当前窄人工智能的危险与机遇展开,而非围绕人工系统中涌现真正能动性这一极不可能的前景。
英文摘要:
What is the prospect of developing artificial general intelligence (AGI)? I investigate this question by systematically comparing living and algorithmic systems, with a special focus on the notion of "agency." There are three fundamental differences to consider: (1) Living systems are autopoietic, that is, self-manufacturing, and therefore able to set their own intrinsic goals, while algorithms exist in a computational environment with target functions that are both provided by an external agent. (2) Living systems are embodied in the sense that there is no separation between their symbolic and physical aspects, while algorithms run on computational architectures that maximally isolate software from hardware. (3) Living systems experience a large world, in which most problems are ill-defined (and not all definable), while algorithms exist in a small world, in which all problems are well-defined. These three differences imply that living and algorithmic systems have very different capabilities and limitations. In particular, it is extremely unlikely that true AGI (beyond mere mimicry) can be developed in the current algorithmic framework of AI research. Consequently, discussions about the proper development and deployment of algorithmic tools should be shaped around the dangers and opportunities of current narrow AI, not the extremely unlikely prospect of the emergence of true agency in artificial systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。