arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.06976cs.MAcs.AI
收藏

谁在帮助谁?分析相互依赖性以评估人机协同中的合作

Who is Helping Whom? Analyzing Inter-dependencies to Evaluate Cooperation in Human-AI Teaming

Upasana Biswas, Vardhan Palod, Siddhant Bhambri, Subbarao Kambhampati

AI总结:

本文提出'建设性相互依赖'作为评估人机协同合作的新指标,发现训练智能体虽能获得高任务奖励,但无法诱导协作行为,揭示任务奖励与合作无必然联系。

摘要:

当前最先进的Human-AI协同和零样本合作方法仅关注任务完成,即任务奖励,作为唯一的评估指标,而对两个智能体如何相互作用漠不关心。此外,主观用户研究只能提供有限的关于团队内部合作质量的见解。具体来说,我们关注的是当训练好的智能体与人类配对时团队中出现的协作行为——这是一个现有文献中被忽视的问题。为了正式解决这个问题,我们提出了

英文摘要:

State-of-the-art methods for Human-AI Teaming and Zero-shot Cooperation focus on task completion, i.e., task rewards, as the sole evaluation metric while being agnostic to how the two agents work with each other. Furthermore, subjective user studies only offer limited insight into the quality of cooperation existing within the team. Specifically, we are interested in understanding the cooperative behaviors arising within the team when trained agents are paired with humans -- a problem that has been overlooked by the existing literature. To formally address this problem, we propose the concept of constructive interdependence -- measuring how much agents rely on each other's actions to achieve the shared goal -- as a key metric for evaluating cooperation in human-agent teams. We interpret interdependence in terms of action interactions in a STRIPS formalism, and define metrics that allow us to assess the degree of reliance between the agents' actions. We pair state-of-the-art agents HAT with learned human models as well as human participants in a user study for the popular Overcooked domain, and evaluate the task reward and teaming performance for these human-agent teams. Our results demonstrate that although trained agents attain high task rewards, they fail to induce cooperative behavior, showing very low levels of interdependence across teams. Furthermore, our analysis reveals that teaming performance is not necessarily correlated with task reward, highlighting that task reward alone cannot reliably measure cooperation arising in a team.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑