arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1908.09506eess.SYcs.SY
收藏

具有限时障碍函数的控制任务的约束学习

Constraint Learning for Control Tasks with Limited Duration Barrier Functions

Motoya Ohnishi, Gennaro Notomista, Masashi Sugiyama, Magnus Egerstedt

摘要:

当在非结构化环境中部署自治代理时,适应性和鲁棒性往往超过最优性作为主要考虑因素。换句话说,安全性和生存性的限制发挥了关键作用,在本文中,我们提出了一种新的,约束学习框架的控制任务的约束驱动控制的思想。然而,由于在无限范围内保持动态代理在状态约束内的控制策略并不总是可用的,因此这项工作考虑的是在有限时间范围T > 0内可以满足的约束,我们称之为有限持续时间安全性。因此,值函数学习可以作为一种工具,帮助我们找到有限时间的安全策略。我们表明,在某些应用程序中,存在的有限持续时间的安全政策实际上是足够的长期自治。这个想法在一群模拟机器人上得到了说明,这些机器人的任务是覆盖给定的区域,但偶尔需要放弃这项任务来给电池充电。我们展示了电池充电行为如何自然地出现作为约束的结果。此外,使用一个推车杆模拟环境中,我们展示了如何控制策略可以有效地从源任务,平衡杆,目标任务,移动推车到一个方向,而不会让杆倒下。

英文摘要:

When deploying autonomous agents in unstructured environments over sustained periods of time, adaptability and robustness oftentimes outweigh optimality as a primary consideration. In other words, safety and survivability constraints play a key role and in this paper, we present a novel, constraint-learning framework for control tasks built on the idea of constraints-driven control. However, since control policies that keep a dynamical agent within state constraints over infinite horizons are not always available, this work instead considers constraints that can be satisfied over some finite time horizon T > 0, which we refer to as limited-duration safety. Consequently, value function learning can be used as a tool to help us find limited-duration safe policies. We show that, in some applications, the existence of limited-duration safe policies is actually sufficient for long-duration autonomy. This idea is illustrated on a swarm of simulated robots that are tasked with covering a given area, but that sporadically need to abandon this task to charge batteries. We show how the battery-charging behavior naturally emerges as a result of the constraints. Additionally, using a cart-pole simulation environment, we show how a control policy can be efficiently transferred from the source task, balancing the pole, to the target task, moving the cart to one direction without letting the pole fall down.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑