A number of leading AI companies, including OpenAI, Google DeepMind, and Anthropic, have the stated goal of building artificial general intelligence (AGI) - AI systems that achieve or exceed human performance across a wide range of cognitive tasks. In pursuing this goal, they may develop and deploy AI systems that pose particularly significant risks. While they have already taken some measures to mitigate these risks, best practices have not yet emerged. To support the identification of best practices, we sent a survey to 92 leading experts from AGI labs, academia, and civil society and received 51 responses. Participants were asked how much they agreed with 50 statements about what AGI labs should do. Our main finding is that participants, on average, agreed with all of them. Many statements received extremely high levels of agreement. For example, 98% of respondents somewhat or strongly agreed that AGI labs should conduct pre-deployment risk assessments, dangerous capabilities evaluations, third-party model audits, safety restrictions on model usage, and red teaming. Ultimately, our list of statements may serve as a helpful foundation for efforts to develop best practices, standards, and regulations for AGI labs.
Credibility Governance: A Social Mechanism for Collective Self-Correction under Weak Truth Signals
School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院);Tsinghua University(清华大学);University of California, Los Angeles(加州大学洛杉矶分校);State Key Laboratory of General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,BIGAI)
Public Opinion and The Rise of Digital Minds: Perceived Risk, Trust, and Regulation Support
Americans for Responsible Innovation(美国负责任创新组织);Convergence Analysis(汇聚分析机构);University of Washington(华盛顿大学);Texas A&M University(得克萨斯农工大学);Sentience Institute(感知研究所);Leiden University(莱顿大学);National Taiwan University(台湾大学);National Cheng Kung University(成功大学);University of Chicago(芝加哥大学);Stanford University(斯坦福大学)
Global Center on AI Governance(全球人工智能治理中心);Research ICT Africa(非洲信息通信技术研究);University of Cape Town(开普敦大学);Kwame Nkrumah University of Science and Technology (KNUST)(夸梅·恩克鲁玛科技大学);International Development Research Centre(国际发展研究中心);AI Action Lab(人工智能行动实验室);Human Sciences Research Council (HSRC)(人文科学研究委员会);Niyel;Oxford Martin AI Governance Initiative(牛津马丁人工智能治理倡议);Equiano Institute(埃奎亚诺研究所);University of Cambridge(剑桥大学);Qhala;University of Oxford(牛津大学);University of Luxembourg(卢森堡大学)