大爆炸,低门槛——公共领域中的风险评估
Big Bang, Low Bar -- Risk Assessment in the Public Arena
AI总结:
本文针对公共风险讨论中易忽视“灾难性越强的潜在风险越需关注其低概率可能”这一原则的问题,以近期AI生存风险讨论为例,指出该原则被忽视的普遍现象及典型案例。
摘要:
风险管理的基本原则之一是,我们应始终关注事态可能严重恶化的方式,即便这些情况看似不太可能发生。潜在失败的灾难性越强,我们要安全地忽略它,所需的发生概率就越低。这一原则看似显而易见,但在有关风险的公共讨论中却很容易被忽视,哪怕是理应更清楚这一点的资深评论者也不例外。本文的撰写契机是近期关于人工智能潜在生存风险的讨论中对这一原则的忽视。这一缺陷并非该案例独有,但该领域近期的争论提供了一些尤为鲜明的例子,体现出这一原则多么容易被忽略。
英文摘要:
One of the basic principles of risk management is that we should always keep an eye on ways that things could go badly wrong, even if they seem unlikely. The more disastrous a potential failure, the more improbable it needs to be, before we can safely ignore it. This principle may seem obvious, but it is easily overlooked in public discourse about risk, even by well-qualified commentators who should certainly know better. The present piece is prompted by neglect of the principle in recent discussions about the potential existential risks of artificial intelligence. The failing is not peculiar to this case, but recent debates in this area provide some particularly stark examples of how easily the principle can be overlooked.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。