基于多变量样条的近似动态规划在自适应控制中的应用
On Approximate Dynamic Programming with Multivariate Splines for Adaptive Control
AI总结:
本文提出基于RLSTD算法和多变量简单样条的SDP框架,引入局部遗忘因子以保持样条连续性,通过实验展示SDP在跟踪时变系统和提升控制性能方面的优势。
摘要:
我们定义了一个基于RLSTD算法和多变量简单样条的SDP框架。我们引入了一个局部遗忘因子,能够保持简单样条的连续性。该局部遗忘因子与RLSTD算法结合,产生了一种能够跟踪时变系统的修改RLSTD算法。我们进行了两个数值实验,一个验证了SDP并将其与NDP进行比较,另一个展示了修改后的RLSTD算法在系统参数改变时的恢复速度优势。尽管SDP每时间步需要更多的计算,但实验表明,在相同的功能近似器参数量下,SDP在稳定性和学习率方面优于NDP。第二个实验表明,SDP结合修改后的RLSTD算法在系统参数改变时比原始RLSTD算法恢复得更快,为自适应高性能非线性控制方法铺平了道路。
英文摘要:
We define a SDP framework based on the RLSTD algorithm and multivariate simplex B-splines. We introduce a local forget factor capable of preserving the continuity of the simplex splines. This local forget factor is integrated with the RLSTD algorithm, resulting in a modified RLSTD algorithm that is capable of tracking time-varying systems. We present the results of two numerical experiments, one validating SDP and comparing it with NDP and another to show the advantages of the modified RLSTD algorithm over the original. While SDP requires more computations per time-step, the experiment shows that for the same amount of function approximator parameters, there is an increase in performance in terms of stability and learning rate compared to NDP. The second experiment shows that SDP in combination with the modified RLSTD algorithm allows for faster recovery compared to the original RLSTD algorithm when system parameters are altered, paving the way for an adaptive high-performance non-linear control method.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。