arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.04490cs.CY
收藏

人工智能风险优先级排序:基于272位国际专家的德尔菲研究

Prioritization of Risks from Artificial Intelligence: A Delphi Study of 272 International Experts

Alexander K. Saeri, Jess Graham, Michael Noetel, Peter Slattery, Dennis Ah-king, Edla Aittokallio, Ibitola Akindehin, Abbas Al Mahdi, Elie Alhajjar, Rafael Ande… 展开作者

Alexander K. Saeri, Jess Graham, Michael Noetel, Peter Slattery, Dennis Ah-king, Edla Aittokallio, Ibitola Akindehin, Abbas Al Mahdi, Elie Alhajjar, Rafael Andersson Lipcsey, Gary Ang, Catherine M. Azam, Amos Azaria, Rishal Balkissoon, Isabel Barberá, Claudio Bareato, Jonathan Barry, Michael Basehart, Andrew M. Bean, Danny Belitz, Samantha Augusta Bennett, Kayla Blomquist, Damian Borstel, Ben Bucknall, Tomas Bueno Momcilovic, Aurelie Bugeau, Nicholas Caputo, Stephen Casper, Gulam Chagani, Ze Shen Chin, Jiyeon Cho, Jay Chooi, Joel N. Christoph, Dmytro Chumachenko, Kieran Conboy, Elizabeth M. Daly, Tom David, Paul de Font-Reaulx, Antonio De Santis, Fabrizio Degni, Christopher W. DiCarlo, Yawen Duan, Janet Egan, Ian W. Eisenberg, Sherif M. Elsafty, Adam Ennamli, Mark Esposito, Nicola Fabiano, Gallo Fall, Neil R. Fernandes, Pip Foweraker, Chiara Gallese, Sandra Galletti, Andrew Gamino-Cheong, Rokas Gipiškis, Gwyn Glasser, Delaram Golpayegani, Jeff Grayson, Hans Gundlach, Josiah Hagen, Alexander Hagenah, Amelia S. Haines, The Anh Han, Yixiong Hao, Kasii Harris, Tianxing He, Koen Holtman, Giorgos Iacovides, Kenneth L. Ingham, Krystal Jackson, Adam Jones, Himanshu Joshi, Brian Judge, Arturs Kanepajs, Shreya Kapoor, Win Myat Nwe Khine, Aidan Kierans, Aleksandra Korolova, Markus Krebsz, Nicholas Kruus, Joe Kwon, Valeria Lazzaroli, Ray X. Lee, Evelina Leivada, Stephan Lewandowsky, Michael B. Li, Xiaojian Li, Geunsik Lim, Henrique Lisakowski, Fabio Lonardoni, Todd C. Lowe, Jackson G. Lu, Alexander Lyzhov, Nada Madkour, Parv Mahajan, David Manheim, Kareem Mathias, Claudio Mayrink Verdun, Sean McGregor, Scott McLean, Matthew J. McMahon, Minas Megalokonomos, Nicolas Moës, Fernando Mourao, Yaroslav Mukhin, Malcolm Murray, Simon Mylius, Neeraj Nagpal, Koichi Nakada, Anna Neumann, Jessica Newman, Kwan Yee Ng, Minh N. Nguyen, Quynh Phuong Nguyen, Seán S. Ó hÉigeartaigh, Daria Onitiu, Kelly Onu, Oscar Oviedo-Trespalacios, Ugur Ozer, Chanwoo Park, M. Alejandra Parra-Orlandoni, Patricia Paskov, Anna M. Pastwa, Burak Piskin, Jacob Pratt, Claudiu A. Predincea, Marjana Prifti Skenduli, Kenneth Priore, Mukunda Madhab Pujari, Zhenting Qi, Preethi Raghunathan, Robi Rahman, Deepika Raman, Max Reddel, Jyoti Ruparel, Emma B. Ruttkamp-Bloem, Tiffany Saade, Greg Sadler, Said Saillant, Paul M. Salmon, Ayrton San Joaquin, Lama Saouma, Maziya Sarangpurwala, Supheakmungkol Sarin, Daniel S. Schiff, Anna D. Schilling, Chris Schmitz, Reva Schwartz, Abeer Sharma, Tianhao Shen, Kehan Sheng, Maury D. Shenk, Eli Sherman, Chandler Smith, Julie M. Smith, Estevenson Solano, Oliver Sourbut, Madhulika Srikumar, Ryan Stendall, Jakob Stenseke, Michael Stern, Joshua Sternfeld, Nikko Stevens, Ilia Sucholutsky, Yuanyuan Sun, Mariami Tkeshelashvili, Cristian Trout, Brian Tse, Nikolaos Tsinganos, Michelle Vaccaro, Anthony R. Valiaveedu, Ramakrishnan Veeramony, Jeremy Verdo, Pulkit Verma, Andrea Luigi Vitali, Jinge Wang, JR Washebek, Yonah Welker, George F. Westerman, James Williams, Tristan Williams, Rongwu Xu, Mick Yang, Xuemeng Yang, Sander Zeijlemaker, Jingyu Zhang, Marta Ziosi, Neil Thompson

AI总结:

通过三轮德尔菲研究,272位国际专家评估了24种AI风险的概率、严重性、脆弱群体和责任方,发现未来五年内最严重的风险来自危险能力、竞争动态、武器与网络攻击等,且多数风险有超过10%的灾难性结果概率。

摘要:

人工智能带来了许多风险,从常见的当代危害到前所未有的潜在灾难性风险。有效的风险管理需要优先级排序:我们必须了解哪些风险最严重,谁最脆弱,以及谁最有责任应对这些风险。我们报告了2025年末进行的一项三轮德尔菲研究的结果,该研究涉及272位国际AI专家。专家们对24种AI风险在危害概率和严重性、部门和行为者脆弱性、行为者责任以及总体关注度方面进行了评分。专家估计,未来5年内最严重的五种危害可能来自危险能力、竞争动态、武器与网络攻击(包括CBRNE)、权力集中和虚假信息。在一切照旧的情景下,专家判断24种风险中有18种在未来5年(2025-2030年)内发生灾难性结果(例如超过100万人死亡或超过1000亿美元经济损失)的概率超过10%。在实施务实缓解措施的情景下,专家仍判断五种风险有超过10%的概率导致灾难性结果:危险能力、武器与网络攻击、环境危害、不平等与失业以及权力集中。所有24种风险被认为有超过5%的可能性导致灾难性结果。AI用户和普通公众被认为最易受这些风险影响,但专家将应对这些风险的最高责任分配给通用AI开发者和治理行为者(包括政府、监管机构和标准制定机构)。在大多数风险中,专家认为信息、金融和国家安全是最脆弱的部门。这些发现可以指导AI风险优先级排序,并阐明专家关于谁应承担缓解责任的期望。

英文摘要:

Artificial intelligence poses many risks, ranging from familiar present-day harms to unprecedented and potentially catastrophic ones. Effective risk management requires prioritization: we must understand which risks are most severe, who is most vulnerable, and who is most responsible for addressing them. We report results from a three-round Delphi study conducted late 2025 with 272 international AI experts. Experts rated 24 AI risks on harm probability and severity, sector and actor vulnerability, actor responsibility, and overall concern. Experts estimated the five most severe harms in the next 5 years were likely to come from dangerous capabilities, competitive dynamics, weapons & cyberattacks (including CBRNE), power centralization, and false information. In a business-as-usual scenario, experts judged 18 of 24 risks as having a more than 10% probability of catastrophic outcomes (e.g., more than 1 million deaths or more than USD 100B in financial loss) in the next 5 years (2025-2030). In a scenario where pragmatic mitigations are implemented, experts still judged five risks as having a more than 10% probability of catastrophic outcomes: dangerous capabilities, weapons & cyberattacks, environmental harm, inequality & unemployment, and power centralization. All 24 risks were judged as being more than 5% likely to cause catastrophic outcomes. AI users and the general public were judged the most vulnerable to these risks, but experts assigned the highest responsibility for addressing them to general-purpose AI developers and governance actors (including governments, regulators, and standards bodies). Across most risks, experts identified information, finance, and national security as the most vulnerable sectors. These findings can guide AI risk prioritization and clarify expert expectations about who should bear responsibility for mitigation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑