arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.09652eess.SYcs.SYmath.OC
收藏

基于奇异摄动的两点边界最优控制系统强化学习

Singular Perturbation-based Reinforcement Learning of Two-Point Boundary Optimal Control Systems

Vasanth Reddy, Hoda Eldardiry, Almuatazbellah Boker

摘要:

这项工作提出了一种学习系统的技术,其中的学习过程是由系统的物理知识指导的。特别地,我们利用强化学习解决了具有未知模型动态的线性时变系统的两点边界最优控制问题。借用奇异摄动理论的技巧,我们将时变最优控制问题转化为一对时不变的子问题。这允许利用偏离策略的迭代方法来学习控制器增益。我们表明,基于学习的控制器的性能近似的基于模型的最优控制器和近似的精度提高的时间范围的控制问题的增加。最后,通过仿真实例验证了本文的结论.

英文摘要:

This work presents a technique for learning systems, where the learning process is guided by knowledge of the physics of the system. In particular, we solve the problem of the two-point boundary optimal control problem of linear time-varying systems with unknown model dynamics using reinforcement learning. Borrowing techniques from singular perturbation theory, we transform the time-varying optimal control problem into a couple of time-invariant subproblems. This allows the utilization of an off-policy iteration method to learn the controller gains. We show that the performance of the learning-based controller approximates that of the model-based optimal controller and the accuracy of the approximation improves as the time horizon of the control problem increases. Finally, we provide a simulation example to verify the results of the paper.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑