关于主动学习在道德偏好获取中的利与弊
On the Pros and Cons of Active Learning for Moral Preference Elicitation
AI总结:
本文探讨了主动学习在道德偏好获取中的局限性,指出其依赖偏好稳定、假设类合适和噪声有限等假设,通过模拟发现违反假设时主动学习性能可能下降,但在条件较好时仍可行,建议谨慎使用。
摘要:
计算偏好获取方法是在特定情境下定量学习人们偏好的工具。近期的偏好获取研究提倡将主动学习作为一种高效方法,用于迭代地构建查询(以特定情境案例之间的比较形式呈现),这些查询最有可能提供关于智能体潜在偏好的信息。在本研究中,我们主张将主动学习用于道德偏好获取依赖于对潜在道德偏好的某些假设,而这些假设在实践中可能会被违背。具体而言,我们强调以下常见假设:(a) 偏好随时间稳定且对呈现的查询序列不敏感,(b) 选择了合适的假设类来建模道德偏好,以及 (c) 智能体响应中的噪声是有限的。虽然这些假设可能适用于某些领域的偏好获取,但先前的道德心理学研究表明它们可能对道德判断无效。通过对违反上述假设的偏好进行合成模拟,我们观察到在某些设置下,主动学习的性能可能与基本的随机查询选择方法相似或更差。然而,模拟结果也表明,如果不稳定程度或噪声相对较小,并且智能体的偏好可以用用于学习的假设类近似表示,主动学习仍然可行。我们的研究强调了实践中有效道德偏好获取相关的细微差别,并提倡谨慎使用主动学习作为获取道德偏好的方法。
英文摘要:
Computational preference elicitation methods are tools used to learn people's preferences quantitatively in a given context. Recent works on preference elicitation advocate for active learning as an efficient method to iteratively construct queries (framed as comparisons between context-specific cases) that are likely to be most informative about an agent's underlying preferences. In this work, we argue that the use of active learning for moral preference elicitation relies on certain assumptions about the underlying moral preferences, which can be violated in practice. Specifically, we highlight the following common assumptions (a) preferences are stable over time and not sensitive to the sequence of presented queries, (b) the appropriate hypothesis class is chosen to model moral preferences, and (c) noise in the agent's responses is limited. While these assumptions can be appropriate for preference elicitation in certain domains, prior research on moral psychology suggests they may not be valid for moral judgments. Through a synthetic simulation of preferences that violate the above assumptions, we observe that active learning can have similar or worse performance than a basic random query selection method in certain settings. Yet, simulation results also demonstrate that active learning can still be viable if the degree of instability or noise is relatively small and when the agent's preferences can be approximately represented with the hypothesis class used for learning. Our study highlights the nuances associated with effective moral preference elicitation in practice and advocates for the cautious use of active learning as a methodology to learn moral preferences.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。