arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.12489eess.SYcs.SY
收藏

基于自适应最优输出调节的自主卫星对接:一种强化学习方法

Autonomous Satellite Docking via Adaptive Optimal Output Regulation: A Reinforcement Learning Approach

Omar Qasem, Madhur Tiwari, Hector Gutierrez

AI总结:

提出一种基于强化学习的在线离策略数据驱动算法,在自适应最优输出调节框架下解决自主卫星对接问题,无需系统动力学先验知识即可实现从星相对位置和速度的最优控制及安全对接。

摘要:

本文描述了一种基于强化学习的在线离策略数据驱动算法,用于调节和控制自主卫星对接问题中从星(deputy satellite)的相对位置。通过考虑卫星的连续时间线性化模型,在输出调节问题和自适应动态规划(ADP)的框架下学习最优控制策略。采用相对运动的线性化模型描述卫星间的运动,将卫星对接问题表述为线性最优输出调节问题,其中反馈-前馈最优控制器用于跟踪一类参考并抑制一类干扰,同时保持整个系统的闭环稳定性。采用基于数据驱动的强化学习方法提出最优控制问题,以调节从星的相对位置和速度,从而安全地与主星(chief)对接。使用自适应最优输出调节框架,学习到的最优反馈-前馈增益保证了最优的瞬态和稳态性能,而无需任何所研究系统动力学的先验知识。相反,底层动力学系统的状态/输入信息被用于计算近似的最优反馈-前馈控制增益矩阵。在不使用任何卫星物理建模信息的情况下,以最优意义实现了参考跟踪和干扰抑制。仿真结果证明所提方法的有效性。

英文摘要:

This paper describes an online off-policy data-driven reinforcement learning based-algorithm to regulate and control the relative position of a deputy satellite in an autonomous satellite docking problem. The optimal control policy is learned under the framework of output regulation problem and adaptive dynamic programming (ADP) by considering the continuous-time linearized model of the satellite. The linearized model of relative motion is used to describe the motion between satellites, and the satellite docking problem is formulated as a linear optimal output regulation problem, in which the feedback-forward optimal controller is used to track a class of references and rejecting a class of disturbances while maintaining the overall system's closed-loop stability. The optimal control problem is presented using a data-driven reinforcement learning based method to regulate the relative position and velocity of the deputy to safely dock with the chief. Using the adaptive optimal output regulation framework, the learned optimal feedback-feedforward gains guarantee optimal transient and steady state performances without any prior knowledge of the dynamics of the studied system. {The states/input information of the underlying dynamical system are instead used to compute the approximated optimal feedback-feedforward control gain matrices.} Reference tracking and disturbance rejection are achieved in an optimal sense without using any modelling information of the physics of the satellites. {Simulation results are presented and demonstrate the efficacy of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑