arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.07671cs.AI
收藏

我们究竟为何要将道德决策自动化?

Why should we ever automate moral decision making?

Carnegie Mellon University(卡内基梅隆大学);University of Oxford(牛津大学)

Vincent Conitzer

AI总结:

本文针对AI道德决策因缺乏成熟数学框架、训练环境不足及人类道德缺陷引发的担忧,阐述了应推动AI参与带道德成分决策的理由并讨论相关风险。

摘要:

尽管人们普遍信任AI在生活各方面做出决策,但当AI涉及具有重大道德影响的决策时,担忧便随之产生。由于伦理学往往难以用简单的数学模型来阐释,道德推理缺乏精确的数学框架这一现状加剧了这些担忧。与逻辑推理、不确定性推理和战略决策等拥有明确数学框架的领域不同,道德推理缺乏被广泛认可的框架。这种缺失引发了人们对AI道德决策能力可信度的质疑。\n 如今AI系统通常接受训练的环境似乎不够丰富,无法让这类系统从零开始学习伦理规范,而且即便我们拥有合适的环境,目前也不清楚如何才能实现这种学习。另一种方法是让AI从人类的道德决策中学习。这一学习过程可以包括在特定领域汇总经过整理的人类判断或示范,或者利用输入了广泛数据的foundation model(基础模型)。不过,考虑到人类道德决策本身存在的不完善性,担忧依然存在。\n 鉴于此,我们究竟为何要将道德决策自动化——把所有道德决策都交给人类难道不是更好吗?本文阐述了我们应当预期AI系统参与带有道德成分的决策的若干理由,并对相关风险进行了简要讨论。

英文摘要:

While people generally trust AI to make decisions in various aspects of their lives, concerns arise when AI is involved in decisions with significant moral implications. The absence of a precise mathematical framework for moral reasoning intensifies these concerns, as ethics often defies simplistic mathematical models. Unlike fields such as logical reasoning, reasoning under uncertainty, and strategic decision-making, which have well-defined mathematical frameworks, moral reasoning lacks a broadly accepted framework. This absence raises questions about the confidence we can place in AI's moral decision-making capabilities. The environments in which AI systems are typically trained today seem insufficiently rich for such a system to learn ethics from scratch, and even if we had an appropriate environment, it is unclear how we might bring about such learning. An alternative approach involves AI learning from human moral decisions. This learning process can involve aggregating curated human judgments or demonstrations in specific domains, or leveraging a foundation model fed with a wide range of data. Still, concerns persist, given the imperfections in human moral decision making. Given this, why should we ever automate moral decision making -- is it not better to leave all moral decision making to humans? This paper lays out a number of reasons why we should expect AI systems to engage in decisions with a moral component, with brief discussions of the associated risks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑