在评估人工智能模型时优先考虑高后果生物能力
Prioritizing High-Consequence Biological Capabilities in Evaluations of Artificial Intelligence Models
AI总结:
本文基于人工智能模型的安全性、安全性和伦理问题,提出在评估人工智能模型时应优先考虑高后果风险,如大规模公众危害(如大流行病),并应在部署前进行评估,以建立针对性的AI安全评估方法,确保工具的安全性和防止潜在危害。
摘要:
随着人工智能能力的快速提升,过去一年中,各国政府和多国机构已宣布努力应对与人工智能模型相关的安全、安全和伦理问题。其中一项重要重点是减少人工智能模型的滥用。许多生物学家多年来一直在努力减少可能导致通过事故或滥用引发高后果疾病爆发的科研风险。科学家们已仔细考虑了哪些类型的生物科学研究具有潜在的益处和风险(双重用途),特别是随着科学进步加速了我们对生物体的工程能力和病原体新变种的创造能力。本文描述了科学家和政策专业人士在生物科学中的双重用途能力的先前经验研究如何帮助评估具有生物能力的人工智能模型的风险。我们主张人工智能模型的评估应优先处理高后果风险(可能导致大规模公众危害,如流行病),并在部署前进行评估,以便允许潜在的生物安全和/或生物安全措施。科学家在识别和缓解双重用途生物风险方面的经验可以帮助指导新的评估方法来评估生物人工智能模型。确定哪些AI能力最可能引发生物安全和生物安全问题是必要的,以便建立有针对性的AI安全评估方法,确保这些工具的安全性,防止事故和滥用,并避免阻碍巨大的潜在利益。
英文摘要:
As a result of rapidly accelerating AI capabilities, over the past year, national governments and multinational bodies have announced efforts to address safety, security and ethics issues related to AI models. One high priority among these efforts is the mitigation of misuse of AI models. Many biologists have for decades sought to reduce the risks of scientific research that could lead, through accident or misuse, to high-consequence disease outbreaks. Scientists have carefully considered what types of life sciences research have the potential for both benefit and risk (dual-use), especially as scientific advances have accelerated our ability to engineer organisms and create novel variants of pathogens. Here we describe how previous experience and study by scientists and policy professionals of dual-use capabilities in the life sciences can inform risk evaluations of AI models with biological capabilities. We argue that AI model evaluations should prioritize addressing high-consequence risks (those that could cause large-scale harm to the public, such as pandemics), and that these risks should be evaluated prior to model deployment so as to allow potential biosafety and/or biosecurity measures. Scientists' experience with identifying and mitigating dual-use biological risks can help inform new approaches to evaluating biological AI models. Identifying which AI capabilities post the greatest biosecurity and biosafety concerns is necessary in order to establish targeted AI safety evaluation methods, secure these tools against accident and misuse, and avoid impeding immense potential benefits.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。