谁承担什么角色?人类与大语言模型在人机决策中的角色范式
Who Does What? Archetypes of Roles Assigned to LLMs During Human-AI Decision-Making
AI总结:
本文提出人类-LLM范式概念,通过分析113篇论文得出17种角色模式,并探讨其对决策结果的影响及设计权衡。
摘要:
大语言模型(LLMs)正在越来越多的高风险领域中支持决策过程,需要对塑造人类和LLMs在人机协同决策中角色和互动的社技术因素进行批判性反思。本文引入了人类-LLM范式的概念,定义为反复出现的社技术互动模式,这些模式结构了人类和LLMs在协作决策中的角色。我们描述了从113篇LLMs支持的决策论文的范围文献综述和主题分析中得出的17种人类-LLM范式。然后,我们评估这些多样化的范式在现实世界临床诊断案例中的应用,以考察采用不同的人类-LLM范式对LLMs输出和决策结果的潜在影响。最后,我们展示了在人类-LLM范式中相关的权衡和设计选择,包括决策控制、社会等级、认知强制策略和信息需求。通过我们的分析,我们表明选择人类-LLM互动范式可以影响LLMs的输出和决策,为设计人机决策系统的设计者带来了重要的风险和考虑。
英文摘要:
LLMs are increasingly supporting decision-making across high-stakes domains, requiring critical reflection on the socio-technical factors that shape how humans and LLMs are assigned roles and interact during human-in-the-loop decision-making. This paper introduces the concept of human-LLM archetypes -- defined as re-curring socio-technical interaction patterns that structure the roles of humans and LLMs in collaborative decision-making. We describe 17 human-LLM archetypes derived from a scoping literature review and thematic analysis of 113 LLM-supported decision-making papers. Then, we evaluate these diverse archetypes across real-world clinical diagnostic cases to examine the potential effects of adopting distinct human-LLM archetypes on LLM outputs and decision outcomes. Finally, we present relevant tradeoffs and design choices across human-LLM archetypes, including decision control, social hierarchies, cognitive forcing strategies, and information requirements. Through our analysis, we show that selection of human-LLM interaction archetype can influence LLM outputs and decisions, bringing important risks and considerations for the designers of human-AI decision-making systems
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。