arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.21337cs.HC
收藏

评估人机协作中共同基础的基准

A Benchmark to Assess Common Ground in Human-AI Collaboration

Microsoft Research(微软研究院);Harvard University(哈佛大学)

Christian Poelitz, Finale Doshi-Velez, Siân Lindley

AI总结:

本文提出一个评估人机协作中共同基础的基准,通过协作拼图任务验证,揭示人机交互与人类协作的差异。

摘要:

人工智能正越来越深入地融入日常生活,无论是专业工作环境还是休闲娱乐领域。这种整合要求人工智能超越仅作为信息或事务性任务助手的角色,向真正的协作伙伴迈进。有效协作,无论是人与人之间还是人与人工智能之间,都依赖于建立和维护共同基础:共享的信念、假设、目标和情境意识,这使协调行动和高效修复误解成为可能。尽管共同基础是人类协作的核心概念,但在人机协作研究中却受到有限关注。在本文中,我们介绍了一个基于人类-人类协作理论和实证研究的新型基准。该基准基于一个需要迭代互动、联合行动、参照协调和在不同情境意识条件下修复的协作拼图任务。我们通过一项确认性用户研究验证了该基准,其中人类参与者与人工智能协作解决该任务。结果表明,该基准再现了人类-人类协作的已建立理论和实证发现,同时揭示了人机交互中的明显差异。

英文摘要:

AI is becoming increasingly integrated into everyday life, both in professional work environments and in leisure and entertainment contexts. This integration requires AI to move beyond acting as an assistant for informational or transactional tasks toward a genuine collaborative partner. Effective collaboration, whether between humans or between humans and AI, depends on establishing and maintaining common ground: shared beliefs, assumptions, goals, and situational awareness that enable coordinated action and efficient repair of misunderstandings. While common ground is a central concept in human collaboration, it has received limited attention in studies of human-AI collaboration. In this paper, we introduce a new benchmark grounded in theories and empirical studies of human-human collaboration. The benchmark is based on a collaborative puzzle task that requires iterative interaction, joint action, referential coordination, and repair under varying conditions of situation awareness. We validate the benchmark through a confirmatory user study in which human participants collaborate with an AI to solve the task. The results show that the benchmark reproduces established theoretical and empirical findings from human-human collaboration, while also revealing clear divergences in human-AI interaction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑