arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.07918cs.CYcs.AIcs.LG
收藏

论开放基础模型的社会影响

On the Societal Impact of Open Foundation Models

Princeton University(普林斯顿大学);Stanford University(斯坦福大学);Massachusetts Institute of Technology(麻省理工学院);Georgetown University(乔治城大学);Center for Democracy and Technology(民主与技术中心);Eleuther AI;Humane Intelligence;Brookings Institution(布鲁金斯学会);Hugging Face;Australian National University(澳大利亚国立大学);Open Source Initiative(开源倡议组织);Institute for Advanced Study(高等研究院);Meta;University of California, Berkeley(加州大学伯克利分校);Mozilla AI
Sayash Kapoor, Rishi Bommasani, Kevin Klyman, Shayne Longpre, Ashwin Ramaswami, Peter Cihon, Aspen Hopkins, Kevin Bankston, Stella Biderman, Miranda Bogen, Rumm… 展开作者

Sayash Kapoor, Rishi Bommasani, Kevin Klyman, Shayne Longpre, Ashwin Ramaswami, Peter Cihon, Aspen Hopkins, Kevin Bankston, Stella Biderman, Miranda Bogen, Rumman Chowdhury, Alex Engler, Peter Henderson, Yacine Jernite, Seth Lazar, Stefano Maffulli, Alondra Nelson, Joelle Pineau, Aviya Skowron, Dawn Song, Victor Storchan, Daniel Zhang, Daniel E. Ho, Percy Liang, Arvind Narayanan

AI总结:

本文提出开放基础模型风险评估框架,分析其独特属性带来的益处与滥用风险,指出当前研究不足,为实证评估其社会影响指明方向。

摘要:

基础模型是强大的技术:它们的公开发布方式直接塑造了其社会影响。在这篇立场论文中,我们聚焦于开放基础模型,此处将其定义为那些模型权重广泛可用的模型(例如Llama 2、Stable Diffusion XL)。我们识别出开放基础模型的五个独特属性(例如更强的可定制性、较差的监控性),这些属性既带来了益处也带来了风险。开放基础模型呈现出显著的好处,但也存在一些注意事项,这些好处涵盖创新、竞争、决策权力的分配以及透明度。为了理解其被滥用的风险,我们设计了一个风险评估框架来分析其边际风险。在多个滥用向量(例如网络攻击、生物武器)中,我们发现当前的研究不足以有效刻画开放基础模型相对于已有技术的边际风险。该框架有助于解释为何在某些情况下边际风险较低,通过揭示过去的研究侧重于框架的不同子集并采用不同假设来澄清关于滥用风险的分歧,并阐述了一条更具建设性辩论的前进道路。总体而言,我们的工作通过概述需要哪些研究来实证验证其理论益处和风险,有助于对开放基础模型的社会影响进行更扎实的评估。

英文摘要:

Foundation models are powerful technologies: how they are released publicly directly shapes their societal impact. In this position paper, we focus on open foundation models, defined here as those with broadly available model weights (e.g. Llama 2, Stable Diffusion XL). We identify five distinctive properties (e.g. greater customizability, poor monitoring) of open foundation models that lead to both their benefits and risks. Open foundation models present significant benefits, with some caveats, that span innovation, competition, the distribution of decision-making power, and transparency. To understand their risks of misuse, we design a risk assessment framework for analyzing their marginal risk. Across several misuse vectors (e.g. cyberattacks, bioweapons), we find that current research is insufficient to effectively characterize the marginal risk of open foundation models relative to pre-existing technologies. The framework helps explain why the marginal risk is low in some cases, clarifies disagreements about misuse risks by revealing that past work has focused on different subsets of the framework with different assumptions, and articulates a way forward for more constructive debate. Overall, our work helps support a more grounded assessment of the societal impact of open foundation models by outlining what research is needed to empirically validate their theoretical benefits and risks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑