Princeton University(普林斯顿大学);Stanford University(斯坦福大学);Massachusetts Institute of Technology(麻省理工学院);Georgetown University(乔治城大学);Center for Democracy and Technology(民主与技术中心);Eleuther AI;Humane Intelligence;Brookings Institution(布鲁金斯学会);Hugging Face;Australian National University(澳大利亚国立大学);Open Source Initiative(开源倡议组织);Institute for Advanced Study(高等研究院);Meta;University of California, Berkeley(加州大学伯克利分校);Mozilla AI
Sayash Kapoor, Rishi Bommasani, Kevin Klyman, Shayne Longpre, Ashwin Ramaswami, Peter Cihon, Aspen Hopkins, Kevin Bankston, Stella Biderman, Miranda Bogen, Rumm… 展开作者
Sayash Kapoor, Rishi Bommasani, Kevin Klyman, Shayne Longpre, Ashwin Ramaswami, Peter Cihon, Aspen Hopkins, Kevin Bankston, Stella Biderman, Miranda Bogen, Rumman Chowdhury, Alex Engler, Peter Henderson, Yacine Jernite, Seth Lazar, Stefano Maffulli, Alondra Nelson, Joelle Pineau, Aviya Skowron, Dawn Song, Victor Storchan, Daniel Zhang, Daniel E. Ho, Percy Liang, Arvind Narayanan
Foundation models are powerful technologies: how they are released publicly directly shapes their societal impact. In this position paper, we focus on open foundation models, defined here as those with broadly available model weights (e.g. Llama 2, Stable Diffusion XL). We identify five distinctive properties (e.g. greater customizability, poor monitoring) of open foundation models that lead to both their benefits and risks. Open foundation models present significant benefits, with some caveats, that span innovation, competition, the distribution of decision-making power, and transparency. To understand their risks of misuse, we design a risk assessment framework for analyzing their marginal risk. Across several misuse vectors (e.g. cyberattacks, bioweapons), we find that current research is insufficient to effectively characterize the marginal risk of open foundation models relative to pre-existing technologies. The framework helps explain why the marginal risk is low in some cases, clarifies disagreements about misuse risks by revealing that past work has focused on different subsets of the framework with different assumptions, and articulates a way forward for more constructive debate. Overall, our work helps support a more grounded assessment of the societal impact of open foundation models by outlining what research is needed to empirically validate their theoretical benefits and risks.
Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education
Arizona State University(亚利桑那州立大学);Makerere University(马凯雷雷大学);Auckland University of Technology(奥克兰理工大学);Eastern Institute of Technology(东部理工学院);University of Glasgow(格拉斯哥大学);University of Trento(特伦托大学);Temple University(天普大学);University of Exeter(埃克塞特大学);University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);Monash University(蒙纳士大学);University of Toronto(多伦多大学)
Generative Artificial Intelligence: Evolving Technology, Growing Societal Impact, and Opportunities for Information Systems Research
Georgia State University(佐治亚州立大学);City University of Hong Kong(香港城市大学);Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));University of Virginia(弗吉尼亚大学)
Implications for Governance in Public Perceptions of Societal-scale AI Risks
Wichita State University(威奇托州立大学);Transformative Futures Institute(变革未来研究所);Centre for the Study of Existential Risk, University of Cambridge(剑桥大学生存风险研究中心);University of Oxford(牛津大学);University College London(伦敦大学学院);University of Memphis(孟菲斯大学);Arkose(Arkose公司);Rethink Priorities(反思优先事项研究所);Center for the Future Mind, Florida Atlantic University(佛罗里达大西洋大学未来心智中心)
ARTAI: An Evaluation Platform to Assess Societal Risk of Recommender Algorithms
University College Dublin(都柏林大学学院);School of Computer Science(计算机科学学院);School of Information and Communication(信息与通信学院);Dublin City University(都柏林城市大学);School of Computing(计算机学院);University College Cork(科克大学学院);School of Computer Science & IT(计算机科学与信息技术学院);Insight SFI Research Centre for Data Analytics(Insight SFI数据分析研究中心)