AI时间表如何影响潜在风险?
How Do AI Timelines Affect Existential Risk?
摘要:
超人类的人工通用智能可能在本世纪被创造出来,并可能成为存在风险的重要来源。推迟超级智能人工智能(ASI)的创造可以通过增加人类处理人工智能对齐问题的时间来降低总体存在风险。然而,由于人工合成技术可以降低大多数风险,推迟建立人工合成技术也可能增加其他存在的风险,特别是来自合成生物学和分子纳米技术等先进未来技术的风险。如果AI存在风险相对于其他存在风险的总和较高,则延迟创建ASI将倾向于降低总存在风险,反之亦然。战争和硬件过剩等其他因素可能会增加AI风险,而认知增强可能会降低AI风险。为了降低总体存在风险,人类应该采取积极的行动,例如进行存在风险分析、人工智能治理和安全,并通过促进差异化技术发展来减少存在风险的所有来源。
英文摘要:
Superhuman artificial general intelligence could be created this century and would likely be a significant source of existential risk. Delaying the creation of superintelligent AI (ASI) could decrease total existential risk by increasing the amount of time humanity has to work on the AI alignment problem. However, since ASI could reduce most risks, delaying the creation of ASI could also increase other existential risks, especially from advanced future technologies such as synthetic biology and molecular nanotechnology. If AI existential risk is high relative to the sum of other existential risk, delaying the creation of ASI will tend to decrease total existential risk and vice-versa. Other factors such as war and a hardware overhang could increase AI risk and cognitive enhancement could decrease AI risk. To reduce total existential risk, humanity should take robustly positive actions such as working on existential risk analysis, AI governance and safety, and reducing all sources of existential risk by promoting differential technological development.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。