arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.08386cs.AIcs.LG
收藏

优化风险规避型人类-AI混合团队

Optimizing Risk-averse Human-AI Hybrid Teams

Università di Pisa(比萨大学);National Research Council (CNR)(国家研究委员会(CNR));Institute for Informatics and Telematics(信息与电信研究所)

Andrew Fuchs, Andrea Passarella, Marco Conti

AI总结:

本文提出通过标准强化学习训练管理者,在含失败状态的网格环境中动态委派人类或AI智能体决策,并在风险约束下减少委派变更,从而获得接近或恰好最优的团队路径。

摘要:

我们预计人类与AI系统在我们所称的混合团队中协作的情形将会增加。随着AI系统能力增强及其应用变得更加广泛,这种协作预计会增多。然而,它们的行为并非没有错误,因此混合团队是一种非常合适的解决方案。基于此,我们研究提升这些人类与AI系统团队绩效的方法。对于混合团队,我们将人类和AI系统都称为智能体。为了使团队绩效优于智能体单独行动时的表现,我们提出一个管理者,它通过标准强化学习方案进行学习,掌握如何随时间推移将作出决策的职责最佳地委派给任一智能体。我们还进一步引导管理者的学习,使其同时尽量减少由不良团队行为导致的委派变更次数。我们在若干网格环境中证明了管理者绩效的最优性;这些环境包含会终止一个回合且应当避免的失败状态。我们使用具有不同可接受风险程度(以与失败状态的接近程度表示)的智能体团队开展实验,衡量管理者依据其自身基于风险的约束作出有效委派决策的能力,随后将这些决策与最优决策进行比较。结果表明,我们的管理者能够成功学习理想的委派方式,使团队路径在路径长度和委派次数方面接近或恰好达到最优。

英文摘要:

We anticipate increased instances of humans and AI systems working together in what we refer to as a hybrid team. The increase in collaboration is expected as AI systems gain proficiency and their adoption becomes more widespread. However, their behavior is not error-free, making hybrid teams a very suitable solution. As such, we consider methods for improving performance for these teams of humans and AI systems. For hybrid teams, we will refer to both the humans and AI systems as agents. To improve team performance over that seen for agents operating individually, we propose a manager which learns, through a standard Reinforcement Learning scheme, how to best delegate, over time, the responsibility of taking a decision to any of the agents. We further guide the manager's learning so they also minimize how many changes in delegation are made resulting from undesirable team behavior. We demonstrate the optimality of our manager's performance in several grid environments which include failure states which terminate an episode and should be avoided. We perform our experiments with teams of agents with varying degrees of acceptable risk, in the form of proximity to a failure state, and measure the manager's ability to make effective delegation decisions with respect to its own risk-based constraints, then compare these to the optimal decisions. Our results show our manager can successfully learn desirable delegations which result in team paths near/exactly optimal with respect to path length and number of delegations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑