arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.17618cs.CY
收藏

前沿AI的动态安全案例

Dynamic safety cases for frontier AI

Carmen Cârlan, Francesca Gomez, Yohan Mathew, Ketana Krishna, René King, Peter Gebauer, Ben R. Smith

AI总结:

本文提出动态安全案例管理系统(DSCMS),借鉴自动驾驶领域的可检查安全论证和安全性能指标,支持前沿AI安全案例的初始创建与半自动化持续修订,以保持安全声明与系统状态一致,并应用于攻击性网络能力模板及治理结构。

摘要:

前沿人工智能(AI)系统既给社会带来益处,也带来风险。安全案例——由证据支持的结构化论证——是帮助确保这些系统安全开发和部署的一种方式。然而,AI能力的不断演变,以及运行环境的变化和对风险理解的深化,都需要机制来持续更新这些安全案例。通常,在其他行业,安全案例在部署前制定,部署后不需要频繁更新,这可能是一个手动且成本高昂的过程。本文提出了一种动态安全案例管理系统(DSCMS),以支持安全案例的初始创建及其随时间进行的系统性、半自动化修订。借鉴自动驾驶车辆(AV)领域开发的方法——最先进的可检查安全论证(CSA)结合UL 4600推荐的安全性能指标(SPIs),DSCMS帮助开发者保持系统安全声明与最新系统状态之间的一致性。我们在针对攻击性网络能力的安全案例模板上展示了这种方法,并提出了将其整合到安全关键决策治理结构中的途径。尽管初始安全论证的正确性仍然至关重要——特别是对于高风险严重性——DSCMS提供了一个适应新见解并加强事件响应的框架。我们概述了作为前沿AI系统持续安全保证一部分的这种方法的开发和实施所面临的挑战及进一步工作。

英文摘要:

Frontier artificial intelligence (AI) systems present both benefits and risks to society. Safety cases - structured arguments supported by evidence - are one way to help ensure the safe development and deployment of these systems. Yet the evolving nature of AI capabilities, as well as changes in the operational environment and understanding of risk, necessitates mechanisms for continuously updating these safety cases. Typically, in other sectors, safety cases are produced pre-deployment and do not require frequent updates post-deployment, which can be a manual, costly process. This paper proposes a Dynamic Safety Case Management System (DSCMS) to support both the initial creation of a safety case and its systematic, semi-automated revision over time. Drawing on methods developed in the autonomous vehicles (AV) sector - state-of-the-art Checkable Safety Arguments (CSA) combined with Safety Performance Indicators (SPIs) recommended by UL 4600, a DSCMS helps developers maintain alignment between system safety claims and the latest system state. We demonstrate this approach on a safety case template for offensive cyber capabilities and suggest ways it can be integrated into governance structures for safety-critical decision-making. While the correctness of the initial safety argument remains paramount - particularly for high-severity risks - a DSCMS provides a framework for adapting to new insights and strengthening incident response. We outline challenges and further work towards development and implementation of this approach as part of continuous safety assurance of frontier AI systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑