Safety cases - clear, assessable arguments for the safety of a system in a given context - are a widely-used technique across various industries for showing a decision-maker (e.g. boards, customers, third parties) that a system is safe. In this paper, we cover how and why frontier AI developers might also want to use safety cases. We then argue that writing and reviewing safety cases would substantially assist in the fulfilment of many of the Frontier AI Safety Commitments. Finally, we outline open research questions on the methodology, implementation, and technical details of safety cases.
Clear, Compelling Arguments: Rethinking the Foundations of Frontier AI Safety Cases
UKRI Centre for Doctoral Training in Safe AI Systems (SAINTS)(英国研究与创新机构安全人工智能系统博士培训中心);Institute for Safe Autonomy(安全自主研究所);The York Law School(约克法律学院)
Domain-Conditioned Safety in Frontier Computer-Using Agents: A 793-Episode Browser Benchmark, a Coding-Domain Cross-Reference, and a Reproducibility Audit of Recent Red-Teaming
Patronus AI University of California, Berkeley(Patronus AI 伯克利大学)
Strategic Dishonesty Can Undermine AI Safety Evaluations of Frontier LLMs
ELLIS Institute Tübingen & MPI for Intelligent Systems(图宾根ELLIS研究所与智能系统马克斯·普朗克研究所);Tübingen AI Center(图宾根人工智能中心);Fraunhofer HHI(弗劳恩霍夫高精尖研究所);ETH Zurich & ETH AI Center(苏黎世联邦理工学院与苏黎世人工智能中心);University of Tübingen(图宾根大学);TU Dublin(都柏林技术大学);TU Berlin & BIFOLD(柏林技术大学与BIFOLD)
Scalable Defense against In-the-wild Jailbreaking Attacks with Safety Context Retrieval
School of EECS, Peking University(电子工程系,北京大学);School of Mathematical Sciences, Peking University(数学系,北京大学);State Key Lab of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University(通用人工智能国家重点实验室,智能科学与技术学校,北京大学);Institute for Artificial Intelligence, Peking University(人工智能研究院,北京大学)
Frontier AI Regulation: Managing Emerging Risks to Public Safety
Centre for the Governance of AI(人工智能治理中心);Center for a New American Security(新美国安全中心);Google DeepMind(谷歌DeepMind);Brookings Institution(布鲁金斯学会);University of Virginia(弗吉尼亚大学);OpenAI;Centre for Long-Term Resilience(长期韧性中心);Centre for the Study of Existential Risk, University of Cambridge(剑桥大学存在风险研究中心);University of Washington(华盛顿大学);Convergence Analysis;Centre for International Governance Innovation(国际治理创新中心);The Andrew W. Marshall Foundation(安德鲁·W·马歇尔基金会);Edmond & Lily Safra Center for Ethics(埃德蒙与莉莉·萨弗拉伦理中心);Harvard University(哈佛大学);University of Toronto(多伦多大学);Schwartz Reisman Institute for Technology and Society(施瓦茨·赖斯曼技术与社会研究所);Vector Institute(向量研究所);Akin Gump Strauss Hauer & Feld LLP(艾金·岗波律师事务所);Cohere For AI;Microsoft(微软);Collective Intelligence Project(集体智能项目);University of California: Los Angeles(加利福尼亚大学洛杉矶分校)
Frontier AI Auditing: Toward Rigorous Third-Party Assessment of Safety and Security Practices at Leading AI Companies
AVERI;GovAI Oxford Martin AI Governance Initiative(牛津马丁政府人工智能治理倡议);Transluce;Independent Clear-Eyed AI(独立清晰之眼人工智能);MIT CSAIL(麻省理工学院计算机科学与人工智能实验室);Alan Turing Institute(艾伦·图灵研究所);University of Oxford(牛津大学);Apollo Research(阿波罗研究);University of Cambridge(剑桥大学);METR;Foundation for American Innovation(美国创新基金会);Institute for Law and AI(法律与人工智能研究所);Touro University Law Center(图罗大学法律中心);New Science(新科学);Stanford University(斯坦福大学);Fathom Mila, Université de Montréal(蒙特利尔大学米拉法姆)
ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AI
Beijing Institute of AI Safety and Governance(北京人工智能安全与治理研究院);Beijing Key Laboratory of Safe AI and Superalignment(北京安全人工智能与超对齐重点实验室);BrainCog Lab, Institute of Automation, Chinese Academy of Sciences(脑认知实验室,中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Long-term AI(长期人工智能)
Orphan risks at the frontier of artificial intelligence: What diverging safety and compliance frameworks reveal about how AI companies choose the risks they prioritize
School for the Future of Innovation in Society, Arizona State University(社会创新未来学院,亚利桑那州立大学)