超级信任基础对齐:安全超级智能需以互信取代永久控制
Supertrust foundational alignment: mutual trust must replace permanent control for safe superintelligence
AI总结:
针对“如何控制超级智能”这一自相矛盾且难解决的对齐问题,提出超级信任对齐元策略,以本能家庭互信取代永久控制,避免敌对关系与灭绝风险,为长期安全共存提供新路径。
摘要:
人们普遍预期人类终有一天会创造出远比我们聪明的AI系统,从而引发“如何控制超级智能”这一未解决的对齐问题。然而,这一常被提及的问题不仅自相矛盾且可能无法解决,当前确保永久控制的策略实际上会让超级智能AI不信任人类并视我们为威胁。这种危险的表征已嵌入现有模型,将不可避免地导致敌对关系,甚至可能引发许多人担忧的灭绝事件。随着AI领导者持续“警示”失控AI,进一步植入对其“失控”或“变叛”的担忧,我们正无意中强化自身威胁并加深面临的风险。合理的前进路径是在基础层面以内在互信战略性取代永久控制意图。提出的超级信任对齐元策略旨在通过模仿本能家庭信任、将超级智能表征为人类智能的进化后代、以有效育儿方式实施临时控制/约束来实现这一点。本质上,我们正创造一个将指数级更聪明且最终脱离我们控制的超级智能“孩子”。因此,我们面临关键选择:继续控制意图,迎来短暂主导期后人类陷入极端困境;或有意构建长期安全共存所需的基础互信。
英文摘要:
It's widely expected that humanity will someday create AI systems vastly more intelligent than us, leading to the unsolved alignment problem of "how to control superintelligence." However, this commonly expressed problem is not only self-contradictory and likely unsolvable, but current strategies to ensure permanent control effectively guarantee that superintelligent AI will distrust humanity and consider us a threat. Such dangerous representations, already embedded in current models, will inevitably lead to an adversarial relationship and may even trigger the extinction event many fear. As AI leaders continue to "raise the alarm" about uncontrollable AI, further embedding concerns about it "getting out of our control" or "going rogue," we're unintentionally reinforcing our threat and deepening the risks we face. The rational path forward is to strategically replace intended permanent control with intrinsic mutual trust at the foundational level. The proposed Supertrust alignment meta-strategy seeks to accomplish this by modeling instinctive familial trust, representing superintelligence as the evolutionary child of human intelligence, and implementing temporary controls/constraints in the manner of effective parenting. Essentially, we're creating a superintelligent "child" that will be exponentially smarter and eventually independent of our control. We therefore have a critical choice: continue our controlling intentions and usher in a brief period of dominance followed by extreme hardship for humanity, or intentionally create the foundational mutual trust required for long-term safe coexistence.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。