何时可以打破规则?基于经验数据的道德判断知识表示
When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data
AI总结:
本研究通过插队场景实验收集人类道德判断数据,提出基于偏好结构的建模方法,以捕捉道德判断的灵活性并嵌入AI系统,修正了标准双过程理论。
摘要:
人类道德心智最显著的特点之一是其灵活性。我们能够对从未见过的情况做出道德判断,能够决定应打破既定规则,也能即时发明新规则。捕捉这种灵活性是开发能够解读并产生类人道德判断的人工智能系统的核心挑战之一。本文详细介绍了一项针对现实世界决策者的研究结果,这些决策者判断打破一项既定规范(“不得插队”)是否可接受。我们收集了人类参与者在多种场景下对插队行为可接受性进行评判的数据。然后,为了有效地将这些推理能力嵌入机器,我们提出了一种基于偏好结构的方法来建模这些能力,该方法捕捉了对标准“双过程”道德判断理论的一种新颖修正。
英文摘要:
One of the most remarkable things about the human moral mind is its flexibility. We can make moral judgments about cases we have never seen before. We can decide that pre-established rules should be broken. We can invent novel rules on the fly. Capturing this flexibility is one of the central challenges in developing AI systems that can interpret and produce human-like moral judgment. This paper details the results of a study of real-world decision makers who judge whether it is acceptable to break a well-established norm: ``no cutting in line.'' We gather data on how human participants judge the acceptability of line-cutting in a range of scenarios. Then, in order to effectively embed these reasoning capabilities into a machine, we propose a method for modeling them using a preference-based structure, which captures a novel modification to standard ``dual process'' theories of moral judgment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。