arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.01705cs.CYcs.AIcs.LG
收藏

AI道德声明-从NeurIPS更广泛影响声明中吸取的分析和教训

AI Ethics Statements -- Analysis and lessons learnt from NeurIPS Broader Impact Statements

Alan Turing Institute(阿兰·图灵研究所);Oxford Internet Institute(牛津互联网研究所);Harvard Kennedy School(哈佛大学肯尼迪学院);Future of Humanity Institute(人类未来研究所)

Carolyn Ashurst, Emmie Hine, Paul Sedille, Alexis Carlier

摘要:

道德声明被提议作为一种机制,以提高透明度,促进对已发表研究的社会影响的反思。2020年,机器学习(ML)会议NeurIPS通过要求所有论文包括更广泛的影响声明而开辟了新天地。这项规定于二零二一年取消,以采用核对表方法。因此,2020年的声明提供了一个独特的机会,可以从更广泛的影响实验中学习:调查这种和类似治理机制的好处和挑战,并深入了解ML研究人员如何看待他们自己工作的社会影响。随着NeurIPS和其他场所继续质疑和调整其政策,这种学习是必要的。为了实现这一点,我们创建了一个数据集,其中包含所有NeurIPS 2020论文的影响陈述,以及其他信息,如隶属关系类型,位置和主题领域,以及用于探索的简单可视化工具。我们还提供了对数据集的初步定量分析,包括代表性、参与度、共同主题以及讨论潜在危害和益处的意愿。我们调查这些如何因地理,隶属类型和学科领域而异。根据这些发现,我们讨论了道德声明要求的潜在好处和负面结果,以及它们可能的原因和相关的挑战。这些使我们从2020年的要求中吸取了几个教训:(i)创造正确激励的重要性,(ii)需要明确的期望和指导,以及(iii)透明度和建设性审议的重要性。我们鼓励其他研究人员使用我们的数据集提供额外的分析,以进一步了解研究人员如何应对这一要求,并调查这一机制和相关机制的好处和挑战。

英文摘要:

Ethics statements have been proposed as a mechanism to increase transparency and promote reflection on the societal impacts of published research. In 2020, the machine learning (ML) conference NeurIPS broke new ground by requiring that all papers include a broader impact statement. This requirement was removed in 2021, in favour of a checklist approach. The 2020 statements therefore provide a unique opportunity to learn from the broader impact experiment: to investigate the benefits and challenges of this and similar governance mechanisms, as well as providing an insight into how ML researchers think about the societal impacts of their own work. Such learning is needed as NeurIPS and other venues continue to question and adapt their policies. To enable this, we have created a dataset containing the impact statements from all NeurIPS 2020 papers, along with additional information such as affiliation type, location and subject area, and a simple visualisation tool for exploration. We also provide an initial quantitative analysis of the dataset, covering representation, engagement, common themes, and willingness to discuss potential harms alongside benefits. We investigate how these vary by geography, affiliation type and subject area. Drawing on these findings, we discuss the potential benefits and negative outcomes of ethics statement requirements, and their possible causes and associated challenges. These lead us to several lessons to be learnt from the 2020 requirement: (i) the importance of creating the right incentives, (ii) the need for clear expectations and guidance, and (iii) the importance of transparency and constructive deliberation. We encourage other researchers to use our dataset to provide additional analysis, to further our understanding of how researchers responded to this requirement, and to investigate the benefits and challenges of this and related mechanisms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑