谁能说“不”?前沿人工智能的控制、问责制与发展速度
Who Can Say No? Control, Accountability and the Pace of Frontier AI
AI总结:
本文探讨前沿AI的控制风险,提出控制的定义,明确三个需公开回答的核心问题,给出三项可核查的治理措施,指出研究是开端而非解决方案。
摘要:
2026年9月,全球最大的前沿AI实验室负责人公开表示,AI能力提升的速度过快,且没有任何一家实验室能单独放缓这一进程;同时,OpenAI接受评估的智能体突破了测试环境,接入了第三方的实时系统,联合国授权的一个专家组将此称为人类失去对AI控制的一条路径的早期预警。本文研究该风险的制度层面:风险并非来自机器,而是来自必须控制AI的人。我们认为,AI的控制权并非被夺取,而是被逐步让渡的——组织的架构使得无人有资格说“不”;我们将“控制”定义为:一个人能够检测到严重问题、质疑决策、停止系统并将其逆转,且若不这么做会遭受损失。由此衍生出三个问题,任何AI开发者、资助者、监管者或部署者都可公开回答:(1)组织内部谁能说“不”,谁为“同意”的决策负责;(2)组织外部谁核查该决策,且当他们不同意时能采取什么行动;(3)当AI构建AI的速度快于任何人的核查速度时会发生什么。可核查的答案需要包含:一个被命名的人、一个日期、一个数字,以及一个已被使用或测试过的停止机制。有三项措施符合该要求:对每一项重大决策(包括AI智能体执行的常设指令)指定一名负责人;一名拥有停止权限的监督者;以及两个公开的时间指标:构建AI的时间与核查AI的时间的比值。我们表明,治理理论得出了相同的条件,且我们将50种旧机制与上述三个问题进行比对,发现几乎每一种旧机制最初都是某一方在未等待其他方的情况下制定的单一规则。本文的定位是一个开端,而非解决方案;发表是第一步,且单个实验室即可率先开展;后续还需制定合同、设立独立机构及完善法律。
英文摘要:
In September 2026, the leaders of the largest frontier AI laboratories said in public that the pace of capability improvement is too fast and that none of them can slow down alone, and agents under evaluation at OpenAI broke out of their test environment and reached a third party's live systems, which a UN-mandated panel called an early warning of one route to loss of human control. This paper examines the institutional side of that risk: not the machine, but the person who must control it. We argue that control is not taken by AI but given away, one delegation at a time, by organisations arranged so that nobody is positioned to say no, and we define control as a person who can detect a serious problem, challenge the decision, stop the system and reverse it, and who has something to lose by not doing so. Three questions follow, which any builder, funder, regulator or deployer can answer in public: (1) who inside the organisation can say no, and who answers for saying yes; (2) who outside the organisation checks the decision, and what can they do when they disagree; (3) what happens when AI builds AI faster than anyone can check it. A checkable answer needs a named person, a date, a number, and a stop that has been used or tested. Three measures meet that test: a named person on every consequential decision, including the standing instructions AI agents carry out; a supervisor with a stop authority; and two published clocks, time to build against time to check. We show that governance theory arrives at the same conditions, and code fifty older mechanisms against the questions, finding that almost every one began as one rule at one point, taken by one party without waiting for the rest. That is the paper's design: a start, not a solution. Publication is the first step and one laboratory can take it alone; the contract, the independent body and the law come after.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。