arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.06317cs.AI
收藏

量化AI风险评估:机遇与挑战

Quantitative AI Risk Assessments: Opportunities and Challenges

IBM Research(IBM研究院)

David Piorkowski, Michael Hind, John Richards

AI总结:

本文探讨量化AI风险评估的机遇与挑战,分析在不了解模型构建背景下评估已建成模型风险的方法,讨论相关指标应用问题及其对AI法规的潜在影响。

摘要:

尽管人工智能(AI)系统正越来越多地被用于为组织、个人和社会创造价值,但已识别并显现出重大的伴随风险。这些风险已引发拟议法规、诉讼和普遍的社会担忧。与任何有前景的技术一样,组织希望从AI技术的积极能力中获益,同时降低风险。降低风险的最佳方式是实施全面的AI生命周期治理,在AI系统的设计、开发、部署和监控过程中描述并执行政策和程序。尽管对全面治理的支持已开始显现,但组织往往需要在不了解模型构建方式或无法接触原始开发者的情况下,识别部署已构建模型的风险。这种评估将以类似家庭检查员评估已建成房屋风险或医生根据一系列测试评估患者整体健康状况的方式,定量评估现有模型的风险。技术社区的指标可用于量化若干AI风险,但在决定如何利用这些指标创建量化AI风险评估方面存在诸多问题。本文探讨了这些问题,重点关注此类方法的机遇、挑战和潜在影响,并讨论其可能如何影响AI法规。

英文摘要:

Although AI systems are increasingly being leveraged to provide value to organizations, individuals, and society, significant attendant risks have been identified and have manifested. These risks have led to proposed regulations, litigation, and general societal concerns. As with any promising technology, organizations want to benefit from the positive capabilities of AI technology while reducing the risks. The best way to reduce risks is to implement comprehensive AI lifecycle governance where policies and procedures are described and enforced during the design, development, deployment, and monitoring of an AI system. Although support for comprehensive governance is beginning to emerge, organizations often need to identify the risks of deploying an already-built model without knowledge of how it was constructed or access to its original developers. Such an assessment will quantitatively assess the risks of an existing model in a manner analogous to how a home inspector might assess the risks of an already-built home or a physician might assess overall patient health based on a battery of tests. Several AI risks can be quantified using metrics from the technical community. However, there are numerous issues in deciding how these metrics can be leveraged to create a quantitative AI risk assessment. This paper explores these issues, focusing on the opportunities, challenges, and potential impacts of such an approach, and discussing how it might influence AI regulations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑