朝向认知忠实决策模型以改善AI对齐
Towards Cognitively-Faithful Decision-Making Models to Improve AI Alignment
AI总结:
提出一种基于公理的方法,从成对比较中学习认知忠实的决策过程,以解决标准偏好诱导方法未能捕捉人类决策认知过程的问题,并在肾脏分配任务中验证了模型的有效性。
摘要:
最近的AI趋势旨在将AI模型与以人为中心的学习目标(如个人偏好、效用或社会价值观)对齐。使用标准偏好诱导方法,研究人员和从业者构建人类决策和判断的模型,AI模型与之对齐。然而,标准诱导方法通常未能捕捉人类决策背后的认知过程,如启发式或简化的结构化思维模式。为了解决这一失败,我们采用公理化的方法从成对比较中学习认知忠实的决策过程。基于分析塑造人类决策的认知过程的文献,我们推导出一个模型类,其中特征首先通过学习的规则处理,然后通过固定规则(如Bradley-Terry规则)聚合以产生决策。这种结构化的信息处理确保了这些模型作为代表潜在人类决策过程的现实且可行的候选者。我们通过在肾脏分配任务中学习可解释的人类决策模型来展示这种建模方法的有效性,并表明我们提出的模型在准确性上匹配或超越了先前的人类成对决策模型。
英文摘要:
Recent AI trends seek to align AI models to learned human-centric objectives, such as personal preferences, utility, or societal values. Using standard preference elicitation methods, researchers and practitioners build models of human decisions and judgments, to which AI models are aligned. However, standard elicitation methods often fail to capture the cognitive processes behind human decision making, such as heuristics or simplifying structured thought patterns. To address this failure, we take an axiomatic approach to learning cognitively faithful decision processes from pairwise comparisons. Building on the literature analyzing cognitive processes that shape human decision-making, we derive a model class in which features are first processed with learned rules, then aggregated via a fixed rule, such as the Bradley-Terry rule, to produce a decision. This structured processing of information ensures that such models are realistic and feasible candidates to represent underlying human decision-making processes. We demonstrate the efficacy of this modeling approach by learning interpretable models of human decision making in a kidney allocation task, and show that our proposed models match or surpass the accuracy of prior models of human pairwise decision-making.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。