arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.01458cs.CYcs.AIcs.HC
收藏

调查被认为有害?反思调查在人工智能研究、开发与治理中的使用

Surveys Considered Harmful? Reflecting on the Use of Surveys in AI Research, Development, and Governance

International Computer Science Institute(国际计算机科学研究所);eBay;Arizona State University(亚利桑那州立大学);IBM Research(IBM研究院);King’s College London(伦敦国王学院)

Mohammmad Tahaei, Daricia Wilkinson, Alisa Frik, Michael Muller, Ruba Abu-Salma, Lauren Wilcox

AI总结:

本文通过六国试点调查反思与44篇论文的系统综述,批判性分析AI公众调查的西方偏误、部署论述不足及报告透明度不一致问题,并提出负责任设计与解释调查的原则性问题。

摘要:

在人工智能(AI)研究、开发和治理中,让公众参与的呼声日益高涨,这促使人们使用调查来捕捉人们与AI相关的价值观、看法和经验。在本文中,我们批判性地审视了与这些主题相关的人类参与者调查的现状。通过对一项覆盖六个国家的试点调查进行反思性分析,并对44篇以AI相关公众调查为特色的论文进行系统性文献综述,我们探讨了迄今为止与调查相关的突出观点和方法论细微差别。我们发现,关于AI主题的公众调查在设计上容易受到特定西方知识、价值观和假设的影响,包括在伦理概念和社会价值观的定位方面;对部署策略缺乏足够的批判性论述;并且在报告中表现出不一致的透明度形式。基于我们的发现,我们为所在社群提炼了引发思考的议题和启发性问题,以认识调查在实现参与目标方面的局限,并培育共同原则,从而谨慎、负责任地设计、部署和解释调查。

英文摘要:

Calls for engagement with the public in Artificial Intelligence (AI) research, development, and governance are increasing, leading to the use of surveys to capture people's values, perceptions, and experiences related to AI. In this paper, we critically examine the state of human participant surveys associated with these topics. Through both a reflexive analysis of a survey pilot spanning six countries and a systematic literature review of 44 papers featuring public surveys related to AI, we explore prominent perspectives and methodological nuances associated with surveys to date. We find that public surveys on AI topics are vulnerable to specific Western knowledge, values, and assumptions in their design, including in their positioning of ethical concepts and societal values, lack sufficient critical discourse surrounding deployment strategies, and demonstrate inconsistent forms of transparency in their reporting. Based on our findings, we distill provocations and heuristic questions for our community, to recognize the limitations of surveys for meeting the goals of engagement, and to cultivate shared principles to design, deploy, and interpret surveys cautiously and responsibly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑