论道德偏好的稳定性:计算式 elicitation 方法的一个问题
On The Stability of Moral Preferences: A Problem with Computational Elicitation Methods
AI总结:
本文通过两周十次重复肾脏分配道德调查,发现参与者对争议情境的回答改变率约10–18%,且与反应时间和决策难度相关,揭示一次性计算式道德偏好 elicitation 的稳定性风险。
摘要:
偏好 elicitation 框架在参与式伦理 AI 工具研究中占据重要地位,并为询问和纳入不同利益相关者的道德价值观提供了一种可行机制。作为 elicitation 过程的一部分,关于道德偏好、意见和判断的调查通常只对每位参与者实施一次。如果参与者的反应随时间保持稳定,即在所有其他相关因素保持不变的情况下,他们今天的回答与稍后对相同问题的回答相同,那么这种方法实践是合理的。然而,我们不知道这种情况出现的频率。参与者真实的道德偏好可能发生变化,可能受到暂时情绪或突发念头的影响,也可能受到我们未追踪的环境因素影响。如果参与者的道德反应以这些方式不稳定,就会引出重要的方法论和理论问题:究竟如何确定参与者真实的道德偏好、意见和判断。我们在此探讨这种可能性:在两周内的十个不同场次中,让相同的调查参与者十次回答相同的道德问题,即当只有一个肾脏可用时哪位患者应获得肾脏;各场次之间只改变题目的呈现顺序。我们测量了参与者对简单(研究一)和更复杂(研究二)的重复情境给出不同回答的频率。平均而言,在各项研究中,参与者对有争议情境改变回答的比例约为 10–18%,并且观察到这种不稳定性与反应时间和决策难度呈正相关。我们讨论了这些结果对道德偏好 elicitation 有效性的影响,强调反应不稳定会导致利益相关者与基于其道德判断训练的 AI 工具之间出现价值错配。
英文摘要:
Preference elicitation frameworks feature heavily in the research on participatory ethical AI tools and provide a viable mechanism to enquire and incorporate the moral values of various stakeholders. As part of the elicitation process, surveys about moral preferences, opinions, and judgments are typically administered only once to each participant. This methodological practice is reasonable if participants' responses are stable over time such that, all other relevant factors being held constant, their responses today will be the same as their responses to the same questions at a later time. However, we do not know how often that is the case. It is possible that participants' true moral preferences change, are subject to temporary moods or whims, or are influenced by environmental factors we don't track. If participants' moral responses are unstable in such ways, it would raise important methodological and theoretical issues for how participants' true moral preferences, opinions, and judgments can be ascertained. We address this possibility here by asking the same survey participants the same moral questions about which patient should receive a kidney when only one is available ten times in ten different sessions over two weeks, varying only presentation order across sessions. We measured how often participants gave different responses to simple (Study One) and more complicated (Study Two) repeated scenarios. On average, the fraction of times participants changed their responses to controversial scenarios was around 10-18% across studies, and this instability is observed to have positive associations with response time and decision-making difficulty. We discuss the implications of these results for the efficacy of moral preference elicitation, highlighting the role of response instability in causing value misalignment between stakeholders and AI tools trained on their moral judgments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。