黑天鹅假说:人类非理性在AI安全中的作用
A Black Swan Hypothesis: The Role of Human Irrationality in AI Safety
AI总结:
本文针对黑天鹅事件现有定义的不足,提出空间黑天鹅事件概念(不变环境中因人类认知偏差产生的高风险罕见事件),完成黑天鹅事件分类与数学形式化定义,为相关预防算法研发铺路。
摘要:
黑天鹅事件是统计上罕见且风险极高的事件。定义黑天鹅事件的典型观点强烈假定其源于不可预测的时变环境,但学界目前缺乏对黑天鹅事件的全面定义。为此,本文对标准观点的完整性提出质疑,指出高风险、统计罕见的事件也可能因人类对其价值和发生概率的认知偏差,在不变环境中发生,我们将这类事件称为空间黑天鹅事件。本文首先对黑天鹅事件进行了细致分类,重点聚焦空间黑天鹅事件,并通过数学形式化了黑天鹅事件的定义。我们希望这些定义能为开发通过理性修正人类认知来预防此类事件的算法奠定基础。
英文摘要:
Black swan events are statistically rare occurrences that carry extremely high risks. A typical view of defining black swan events is heavily assumed to originate from an unpredictable time-varying environments; however, the community lacks a comprehensive definition of black swan events. To this end, this paper challenges that the standard view is incomplete and claims that high-risk, statistically rare events can also occur in unchanging environments due to human misperception of their value and likelihood, which we call as spatial black swan event. We first carefully categorize black swan events, focusing on spatial black swan events, and mathematically formalize the definition of black swan events. We hope these definitions can pave the way for the development of algorithms to prevent such events by rationally correcting human perception.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。