迈向人机联合推理与价值对齐的对话
Towards Dialogues for Joint Human-AI Reasoning and Value Alignment
AI总结:
本文提出以探究性对话取代说服性对话,以支持人机联合推理,确保AI决策与人类价值对齐,并为相关研究提供路线图。
摘要:
我们认为,实现支持联合推理(即“探究”)的人机对话,对于确保人工智能决策与人类价值观和偏好保持一致至关重要。具体而言,我们指出基于逻辑的论证与对话模型,并建议将传统上对说服性对话的关注转向对探究性对话及其带来的独特挑战的关注。鉴于大型语言模型(LLMs)近期在性能上的显著进步,以及其预期在决策中使用的增加,我们为探究性对话研究提供了一份路线图,以支持在伦理上显著、因而要求决策价值对齐的人机联合推理任务。
英文摘要:
We argue that enabling human-AI dialogue, purposed to support joint reasoning (i.e., 'inquiry'), is important for ensuring that AI decision making is aligned with human values and preferences. In particular, we point to logic-based models of argumentation and dialogue, and suggest that the traditional focus on persuasion dialogues be replaced by a focus on inquiry dialogues, and the distinct challenges that joint inquiry raises. Given recent dramatic advances in the performance of large language models (LLMs), and the anticipated increase in their use for decision making, we provide a roadmap for research into inquiry dialogues for supporting joint human-LLM reasoning tasks that are ethically salient, and that thereby require that decisions are value aligned.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。