arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.03451eess.SYcs.SY
收藏

一种用于线性系统最优输出反馈控制的高效基于数据的离策略Q学习算法

An efficient data-based off-policy Q-learning algorithm for optimal output feedback control of linear systems

Mohammad Alsalti, Victor G. Lopez, Matthias A. Müller

AI总结:

针对离散时间LTI系统最优输出调节问题,提出一种仅需离线持续激励输入输出数据、无需模型或状态测量的高效离策略Q学习算法,给出收敛条件并与现有算法对比性能。

摘要:

本文提出一种Q学习算法,用于求解离散时间LTI(线性时不变)系统的最优输出调节问题。该离策略算法仅依赖离线测量的持续激励输入输出数据,无需模型知识或状态测量,且所得最优策略仅使用历史输入输出信息。此外,我们对该算法的公式化设计使其计算高效。我们给出了保证算法收敛到最优解的条件。最后,将本文方法的性能与文献中现有算法进行了比较。

英文摘要:

In this paper, we present a Q-learning algorithm to solve the optimal output regulation problem for discrete-time LTI systems. This off-policy algorithm only relies on using persistently exciting input-output data, measured offline. No model knowledge or state measurements are needed and the obtained optimal policy only uses past input-output information. Moreover, our formulation of the proposed algorithm renders it computationally efficient. We provide conditions that guarantee the convergence of the algorithm to the optimal solution. Finally, the performance of our method is compared to existing algorithms in the literature.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑