arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1709.04889math.OCcs.LGcs.ROcs.SYeess.SY
收藏

实时控制导向学习

Control-Oriented Learning on the Fly

University of Texas at Austin(德克萨斯大学奥斯汀分校)

Melkior Ornik, Arie Israel, Ufuk Topcu

AI总结:

本文提出一种实时控制导向学习方法,用于在系统动力学几乎未知的情况下实现控制目标,通过小扰动学习局部动态并保证近似最优方向,验证了其在受损飞机避撞和Van der Pol振荡器中的有效性。

摘要:

本文聚焦于开发一种策略,用于控制其动力学几乎完全未知的系统。这种情况自然出现在系统经历关键故障的场景中。在这种情况下,保留满足基本控制目标的能力以避免即将来临的灾难至关重要。一个典型的此类目标是可达避障问题,其中系统需要在受限的状态空间中移动到某个状态。为了应对对系统动力学知识的限制,我们开发了一种贪心控制理论。贪心控制的主要目标是在任何给定时间,仅根据到目前为止获得的系统信息,优化系统的轨迹方向。我们提出了一种算法,利用小扰动的控制努力来学习局部动态,同时确保系统朝着看似近似最优的方向移动,并为其次优性能提供硬性界限。我们还验证了该算法在受损飞机避撞模拟以及Van der Pol振荡器示例中的有效性。

英文摘要:

This paper focuses on developing a strategy for control of systems whose dynamics are almost entirely unknown. This situation arises naturally in a scenario where a system undergoes a critical failure. In that case, it is imperative to retain the ability to satisfy basic control objectives in order to avert an imminent catastrophe. A prime example of such an objective is the reach-avoid problem, where a system needs to move to a certain state in a constrained state space. To deal with limitations on our knowledge of system dynamics, we develop a theory of myopic control. The primary goal of myopic control is to, at any given time, optimize the current direction of the system trajectory, given solely the information obtained about the system until that time. We propose an algorithm that uses small perturbations in the control effort to learn local dynamics while simultaneously ensuring that the system moves in a direction that appears to be nearly optimal, and provide hard bounds for its suboptimality. We additionally verify the usefulness of the algorithm on a simulation of a damaged aircraft seeking to avoid a crash, as well as on an example of a Van der Pol oscillator.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑