未知线性离散系统的鲁棒输出调节和基于强化学习的输出跟踪设计
Robust Output Regulation and Reinforcement Learning-based Output Tracking Design for Unknown Linear Discrete-Time Systems
摘要:
本文利用强化学习和鲁棒输出调节理论研究了动态未知的线性离散系统的最优输出跟踪问题。这种输出跟踪问题只允许利用参考系统和受控系统的输出,而不是它们的状态,并且不同于大多数现有的依赖于系统状态的跟踪结果。最优跟踪问题被制定成一个线性二次调节问题,提出了一个家庭的动态离散时间控制器。然后,它表明,解决输出跟踪问题是等价于解决输出调节方程,其解决方案,但是,需要完整和准确的系统动力学的知识。为了消除这种要求,提出了一种只使用沿系统轨迹的测量输出数据和参考输出的离线强化学习算法。通过引入重表示误差和分析参数化矩阵的秩条件,保证了基于RL的输出反馈最优控制的唯一性.
英文摘要:
In this paper, we investigate the optimal output tracking problem for linear discrete-time systems with unknown dynamics using reinforcement learning and robust output regulation theory. This output tracking problem only allows to utilize the outputs of the reference system and the controlled system, rather than their states, and differs from most existing tracking results that depend on the state of the system. The optimal tracking problem is formulated into a linear quadratic regulation problem by proposing a family of dynamic discrete-time controllers. Then, it is shown that solving the output tracking problem is equivalent to solving output regulation equations, whose solution, however, requires the knowledge of the complete and accurate system dynamics. To remove such a requirement, an off-policy reinforcement learning algorithm is proposed using only the measured output data along the trajectories of the system and the reference output. By introducing re-expression error and analyzing the rank condition of the parameterization matrix, we ensure the uniqueness of the proposed RL based optimal control via output feedback.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。