前沿AI部署中的控制监控实际挑战
Practical challenges of control monitoring in frontier AI deployments
AI总结:
本文探讨了前沿AI部署中控制监控面临的实际挑战,分析了同步、半同步和异步监控方案,并通过案例研究探讨了监督、延迟和恢复等关键问题。
摘要:
自动化控制监控可能在监督高度 capable 的AI代理方面发挥重要作用,这些代理我们不完全信任。先前的工作在简化设置中探索了控制监控,但将监控扩展到现实世界部署会引入额外的动态:并行代理实例、不可忽视的监督延迟、代理实例之间的渐进式攻击,以及基于单个有害行为识别欺骗性代理的难度。在本文中,我们分析了设计选择以解决这些挑战,重点关注三种具有不同延迟-安全性权衡的监控形式:同步、半同步和异步监控。我们引入了一个高层次的安全案例草图作为理解和比较这些监控协议的工具。我们的分析识别出三个挑战——监督、延迟和恢复,并在四个可能的未来AI部署案例研究中探讨了这些挑战。
英文摘要:
Automated control monitors could play an important role in overseeing highly capable AI agents that we do not fully trust. Prior work has explored control monitoring in simplified settings, but scaling monitoring to real-world deployments introduces additional dynamics: parallel agent instances, non-negligible oversight latency, incremental attacks between agent instances, and the difficulty of identifying scheming agents based on individual harmful actions. In this paper, we analyse design choices to address these challenges, focusing on three forms of monitoring with different latency-safety trade-offs: synchronous, semi-synchronous, and asynchronous monitoring. We introduce a high-level safety case sketch as a tool for understanding and comparing these monitoring protocols. Our analysis identifies three challenges -- oversight, latency, and recovery -- and explores them in four case studies of possible future AI deployments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。