arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2201.07763cs.AIcs.CY

何时可以打破规则?基于经验数据的道德判断知识表示

When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data

University of Exeter(埃克塞特大学);Massachusetts Institute of Technology(麻省理工学院);Harvard University(哈佛大学);European University Institute(欧洲大学学院);Tulane University(杜兰大学);Max Planck Institute for Human Development(马克斯·普朗克人类发展研究所);IBM Research(IBM研究院)

Edmond Awad, Sydney Levine, Andrea Loreggia, Nicholas Mattei, Iyad Rahwan, Francesca Rossi, Kartik Talamadupula, Joshua Tenenbaum, Max Kleiman-Weiner

AI总结:

本研究通过插队场景实验收集人类道德判断数据,提出基于偏好结构的建模方法,以捕捉道德判断的灵活性并嵌入AI系统,修正了标准双过程理论。

摘要:

人类道德心智最显著的特点之一是其灵活性。我们能够对从未见过的情况做出道德判断,能够决定应打破既定规则,也能即时发明新规则。捕捉这种灵活性是开发能够解读并产生类人道德判断的人工智能系统的核心挑战之一。本文详细介绍了一项针对现实世界决策者的研究结果,这些决策者判断打破一项既定规范(“不得插队”)是否可接受。我们收集了人类参与者在多种场景下对插队行为可接受性进行评判的数据。然后,为了有效地将这些推理能力嵌入机器,我们提出了一种基于偏好结构的方法来建模这些能力,该方法捕捉了对标准“双过程”道德判断理论的一种新颖修正。

英文摘要:

One of the most remarkable things about the human moral mind is its flexibility. We can make moral judgments about cases we have never seen before. We can decide that pre-established rules should be broken. We can invent novel rules on the fly. Capturing this flexibility is one of the central challenges in developing AI systems that can interpret and produce human-like moral judgment. This paper details the results of a study of real-world decision makers who judge whether it is acceptable to break a well-established norm: ``no cutting in line.'' We gather data on how human participants judge the acceptability of line-cutting in a range of scenarios. Then, in order to effectively embed these reasoning capabilities into a machine, we propose a method for modeling them using a preference-based structure, which captures a novel modification to standard ``dual process'' theories of moral judgment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑