arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1106.4573cs.AI
收藏

面向现实世界的可调节自主性

Towards Adjustable Autonomy for the Real World

D. V. Pynadath, P. Scerri, M. Tambe

摘要:

可调整的自主性是指实体动态地改变自己的自主性,在关键情况下将决策控制权转移给其他实体(通常是将控制权转移给人类用户的代理)。确定这种控制权转移是否以及何时应该发生,可以说是可调节自治的基本研究问题。以前的工作已经调查了各种方法来解决这个问题,但往往集中在个人代理人的相互作用。不幸的是,需要代理和人类团队之间合作的领域揭示了这些以前的方法的两个关键缺点。首先,这些方法使用刚性的一次性控制转移,这可能导致多智能体设置中不可接受的协调失败。其次,他们忽略了成本(例如,在时间延迟或对动作的影响方面)。为了解决这些问题,本文提出了一种新的方法来调整自主权,基于控制权转移策略的概念。控制权转移策略由两种类型的动作的条件序列组成:(i)转移决策控制权的动作(例如,从代理到用户或反之亦然)和(ii)改变代理与团队成员的预先指定的协调约束的动作,旨在最小化误协调成本。目标是在对团队协调的干扰最小的情况下做出高质量的个人决策。我们提出了一个数学模型的控制权转移策略。该模型使用马尔可夫决策过程指导和通知战略的实施,该过程在不确定的环境和个人和团队的成本下选择最佳战略。该方法已被仔细评估,包括通过其在现实世界中的使用,部署多代理系统,协助研究小组在其日常活动。

英文摘要:

Adjustable autonomy refers to entities dynamically varying their own autonomy, transferring decision-making control to other entities (typically agents transferring control to human users) in key situations. Determining whether and when such transfers-of-control should occur is arguably the fundamental research problem in adjustable autonomy. Previous work has investigated various approaches to addressing this problem but has often focused on individual agent-human interactions. Unfortunately, domains requiring collaboration between teams of agents and humans reveal two key shortcomings of these previous approaches. First, these approaches use rigid one-shot transfers of control that can result in unacceptable coordination failures in multiagent settings. Second, they ignore costs (e.g., in terms of time delays or effects on actions) to an agent's team due to such transfers-of-control. To remedy these problems, this article presents a novel approach to adjustable autonomy, based on the notion of a transfer-of-control strategy. A transfer-of-control strategy consists of a conditional sequence of two types of actions: (i) actions to transfer decision-making control (e.g., from an agent to a user or vice versa) and (ii) actions to change an agent's pre-specified coordination constraints with team members, aimed at minimizing miscoordination costs. The goal is for high-quality individual decisions to be made with minimal disruption to the coordination of the team. We present a mathematical model of transfer-of-control strategies. The model guides and informs the operationalization of the strategies using Markov Decision Processes, which select an optimal strategy, given an uncertain environment and costs to the individuals and teams. The approach has been carefully evaluated, including via its use in a real-world, deployed multi-agent system that assists a research group in its daily activities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑