谁应该运行高级AI评估——AISIs？
Who Should Run Advanced AI Evaluations -- AISIs?
AI总结：
本文借鉴九个行业评估制度，建议公共机构直接参与安全关键的灰盒和白盒AI模型评估，而黑盒评估和审计可由私人市场提供，且AISI能力需随风险扩展，大型辖区需数百员工。
摘要：
人工智能（AI）安全研究所和世界各地的政府正在决定是否自己评估高级AI、支持私人评估生态系统，或两者兼而有之。评估制度已在广泛的行业背景下建立，以监测和评估公司对法规的遵守情况。评估是理解和管理技术风险所必需的一种治理工具。本文借鉴了九个此类制度，以告知（i）谁应该评估高级AI的哪些部分；以及（ii）公共机构可能需要多少能力才能有效评估高级AI。首先，公共和私人评估者之间的有效责任分配在很大程度上取决于具体的行业和评估条件。基于高级AI的风险概况、评估过程中所涉及信息的敏感性，以及验证AI实验室安全和效益声明的高昂成本，我们建议公共机构直接参与安全关键型，特别是灰盒和白盒AI模型评估。在其他行业背景下已成熟应用的治理和安全审计，以及黑盒模型评估，可能更适合由在公共监督下的私人评估者和审计师市场提供。其次，为了有效履行其在高级AI审计中的角色，公共机构需要广泛访问模型和设施。AISI的能力应随着行业的风险水平、规模和市场集中度而扩展，在欧盟或美国等大型司法管辖区，评估可能需要数百名员工，类似于核安全和生命科学领域。
英文摘要：
Artificial Intelligence (AI) Safety Institutes and governments worldwide are deciding whether they evaluate advanced AI themselves, support a private evaluation ecosystem or do both. Evaluation regimes have been established in a wide range of industry contexts to monitor and evaluate firms' compliance with regulation. Evaluation is a necessary governance tool to understand and manage the risks of a technology. This paper draws from nine such regimes to inform (i) who should evaluate which parts of advanced AI; and (ii) how much capacity public bodies may need to evaluate advanced AI effectively. First, the effective responsibility distribution between public and private evaluators depends heavily on specific industry and evaluation conditions. On the basis of advanced AI's risk profile, the sensitivity of information involved in the evaluation process, and the high costs of verifying safety and benefit claims of AI Labs, we recommend that public bodies become directly involved in safety critical, especially gray- and white-box, AI model evaluations. Governance and security audits, which are well-established in other industry contexts, as well as black-box model evaluations, may be more efficiently provided by a private market of evaluators and auditors under public oversight. Secondly, to effectively fulfil their role in advanced AI audits, public bodies need extensive access to models and facilities. AISI's capacity should scale with the industry's risk level, size and market concentration, potentially requiring 100s of employees for evaluations in large jurisdictions like the EU or US, like in nuclear safety and life sciences.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
