AI 中文总结
该论文提出需实用AI对齐方法镜像人类推理，指出认知对齐可提升AI可理解性与可信赖度，提出研究议程以缩小现有对齐方法与认知对齐需求的差距，助力用户信赖AI系统。
AI 中文摘要
AI系统越来越多地被用作决策辅助工具、决策代理或自主决策者。本立场论文指出，在许多场景，尤其是高风险决策中，我们需要准确的认知对齐AI系统，其推理方式与用户相似并如实传达推理过程。我们回顾了认知对齐可提升可理解性与可信赖度的证据，还提供了新的调查数据，显示当AI的判断或行动依据对用户重要时，许多用户认为认知对齐“必不可少”。我们概述了现有对齐方法与实现认知对齐所需条件之间的差距，并提出了缩小这些差距的研究议程。我们认为，认知对齐可能会阻碍AI在诸多预期应用中的采用，解决该问题对构建用户愿意且有理由信赖的AI系统至关重要。
英文摘要
AI systems are increasingly employed as decision aids, decision delegates, or autonomous decision-makers. This position paper argues that in many settings, particularly high-stakes decision-making, we need accurate cognitively-aligned AI systems that reason similarly to their users, and faithfully communicate their reasoning. We review evidence that cognitive alignment improves understandability and trustworthiness, and provide new survey data showing that many users find cognitive alignment "essential" when an AI's rationale for a judgment or action is important to them. We outline the gaps between existing alignment methods and what is needed to achieve cognitive alignment, and present a research agenda to address these gaps. We argue that cognitive misalignment represents a likely impediment to AI adoption in many envisioned applications, and that addressing it is important for creating AI systems on which users are both willing and justified to rely.
CommentsAccepted in ICML 2026
