arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.12862cs.AI
收藏

迈向约束合规的目标制定与规划

Toward Constraint Compliant Goal Formulation and Planning

IQM Research Institute(IQM研究所)

Steven J. Jones, Robert E. Wray

AI总结:

本文研究伦理约束如何影响智能体目标制定与规划,比较义务论与功利主义框架下软硬约束的合规行为,并指出元认知判断对解决伦理冲突的关键作用。

摘要:

遵守规范、规则和偏好的一部分,是将约束(例如伦理知识)纳入个体的目标制定与规划过程。我们在一个简单领域中探究不同伦理框架中的知识编码如何影响智能体的目标制定与规划过程,并展示当智能体的相关约束集合包含不同类型的“硬”约束与“软”约束混合时,其满足与适度满足的能力。智能体如何尝试遵守伦理约束取决于伦理框架,我们研究了在遵守某项伦理规范时,义务论框架与功利主义框架之间的权衡。代表性场景突出表明,在以同一规范的不同框架执行同一任务时,会产生不同的行为。我们的探索表明,元认知判断在解决目标制定与规划过程中的伦理冲突方面具有重要作用。

英文摘要:

One part of complying with norms, rules, and preferences is incorporating constraints (such as knowledge of ethics) into one's goal formulation and planning processing. We explore in a simple domain how the encoding of knowledge in different ethical frameworks influences an agent's goal formulation and planning processing and demonstrate ability of an agent to satisfy and satisfice when its collection of relevant constraints includes a mix of "hard" and "soft" constraints of various types. How the agent attempts to comply with ethical constraints depends on the ethical framing and we investigate tradeoffs between deontological framing and utilitarian framing for complying with an ethical norm. Representative scenarios highlight how performing the same task with different framings of the same norm leads to different behaviors. Our explorations suggest an important role for metacognitive judgments in resolving ethical conflicts during goal formulation and planning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑