Artificial intelligence (AI) advances rapidly but achieving complete human control over AI risks remains an unsolved problem, akin to driving the fast AI "train" without a "brake system." By exploring fundamental control mechanisms at key elements of AI decisions, we develop a systematic solution to thoroughly control AI risks, providing an architecture for AI governance and legislation with five pillars supported by six control mechanisms, illustrated through a minimum set of AI Mandates (AIMs). Three of the AIMs must be built inside AI systems and three in society to address major areas of AI risks: 1) align AI values with human users; 2) constrain AI decision-actions by societal ethics, laws, and regulations; 3) build in human intervention options for emergencies and shut-off switches for existential threats; 4) limit AI access to user resources to reinforce controls inside AI; 5) mitigate spillover risks like job loss from AI. We also highlight the differences in AI governance on physical AI systems versus generative AI. We discuss how to strengthen analog physical safeguards to prevent AI or AGI from circumventing core safety controls by exploiting AI's intrinsic disconnect from the analog physical world: AI's nature as pure software code run on chips controlled by humans, and the prerequisite that all AI-driven physical actions must be digitized. These findings establish a theoretical foundation for AI governance and legislation as the basic structure of a "brake system" for AI decisions. If implemented, these controls can rein in AI dangers as completely as humanly possible, removing large chunks of currently wide-open AI risks, substantially reducing overall AI risks to residual human errors.
Artificial Intelligence in Governance, Risk and Compliance: Results of a study on potentials for the application of artificial intelligence (AI) in governance, risk and compliance (GRC)
The Last Vote: A Multi-Stakeholder Framework for Language Model Governance
Berkeley AI Safety Initiative (BASIS)(伯克利人工智能安全倡议);Cyber Physical Systems Lab(网络物理系统实验室);UC Berkeley(加州大学伯克利分校);University of Texas, Dallas(德克萨斯大学达拉斯分校)
Can apparent bystanders distinctively shape an outcome? Global south countries and global catastrophic risk-focused governance of artificial intelligence
Open Problems in AI Risk Modeling: Insights from a Workshop on the Technical Foundations of AI Risk Modeling
Institute for Security and Technology(安全与技术研究所);Center for Long-Term Cybersecurity(长期网络安全中心);SaferAI;Center for Security and Emerging Technology(新兴技术安全中心);University of Warwick(华威大学);Center for AI Risk Management & Alignment(人工智能风险管理与对齐中心)
Dial E for Ethical Enforcement: institutional VETO power as a governance primitive
Meta AI;Stanford University(斯坦福大学);AWS Generative AI Innovation Center, Amazon Web Services(亚马逊云科技生成式AI创新中心);Northeastern University, Seattle, WA, USA(东北大学)
Implications for Governance in Public Perceptions of Societal-scale AI Risks
Wichita State University(威奇托州立大学);Transformative Futures Institute(变革未来研究所);Centre for the Study of Existential Risk, University of Cambridge(剑桥大学生存风险研究中心);University of Oxford(牛津大学);University College London(伦敦大学学院);University of Memphis(孟菲斯大学);Arkose(Arkose公司);Rethink Priorities(反思优先事项研究所);Center for the Future Mind, Florida Atlantic University(佛罗里达大西洋大学未来心智中心)
"Death by a thousand taxonomies?": AI Risk Classification In Practice
Australian National University(澳大利亚国立大学);Cornell University(康奈尔大学);University of Southern California(南加州大学);Microsoft Research(微软研究院);Google Research(谷歌研究院)
Making Agent-Mediated Contributions Governable: A Project-Level Governance Manifest for Open-Source AI Collaboration
School of Business Administration, Shanxi University of Finance and Economics(山西财经大学工商管理学院);Experiment and Practical Training Center, Shanxi University of Finance and Economics(山西财经大学实验实训中心);School of Computer Science and Technology, North University of China(中北大学计算机科学与技术学院);Department of Computer Science, University of Warwick(华威大学计算机科学系);School of Information, Shanxi University of Finance and Economics(山西财经大学信息学院)