道德故事:关于规范、意图、行为及其后果的情境推理
Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences
摘要:
在社会环境中,人类的许多行为都受到潜规则的约束。要使人工系统完全融入社会环境,遵守这些规范是一个核心先决条件。我们研究当代NLG模型是否可以作为部署在社会环境中的系统的行为先验,通过产生行动假设,实现预定义的目标下的道德约束。此外,我们还研究了模型是否可以预测(非)道德行为的可能后果,或者通过生成相关规范来解释为什么某些行为是优选的。为此,我们引入了“道德故事”,这是一个结构化、分支化叙事的众包数据集,用于研究接地的、以目标为导向的社会推理。最后,我们提出了解码策略,有效地结合了多个专家模型,以显着提高质量生成的行动,后果和规范相比,强基线,例如,通过溯因推理。
英文摘要:
In social settings, much of human behavior is governed by unspoken rules of conduct. For artificial systems to be fully integrated into social environments, adherence to such norms is a central prerequisite. We investigate whether contemporary NLG models can function as behavioral priors for systems deployed in social settings by generating action hypotheses that achieve predefined goals under moral constraints. Moreover, we examine if models can anticipate likely consequences of (im)moral actions, or explain why certain actions are preferable by generating relevant norms. For this purpose, we introduce 'Moral Stories', a crowd-sourced dataset of structured, branching narratives for the study of grounded, goal-oriented social reasoning. Finally, we propose decoding strategies that effectively combine multiple expert models to significantly improve the quality of generated actions, consequences, and norms compared to strong baselines, e.g. though abductive reasoning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。