arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.04180cs.ROcs.AIcs.LGmath.OC
收藏

用自动绳网系统学习广义碎片捕获的鲁棒策略

Learning Robust Policies for Generalized Debris Capture with an Automated Tether-Net System

University at Buffalo(布法罗大学)

Chen Zeng, Grant Hecht, Prajit KrisshnaKumar, Raj K. Shah, Souma Chowdhury, Eleonora M. Botta

摘要:

从追踪航天器发射的绳网为捕获和处置在轨大型空间碎片提供了一种很有前途的方法。该绳网系统在感测和致动方面受到影响其网发射和关闭控制的性能的若干不确定性来源。然而,早期的基于可靠性的优化方法来设计控制行动仍然具有挑战性和计算禁止概括不同的发射方案和目标(碎片)状态相对于追逐。为了寻找一个通用的和可靠的控制策略,本文提出了一种强化学习框架,集成了近端策略优化(PPO 2)的方法与网络动态模拟。后者允许评估基于网络的目标捕获的情节,并估计捕获质量指数,作为对PPO 2的奖励反馈。在这里,学习策略被设计为在任何给定的发射场景下,基于移动网和目标的状态来对收网动作的时机进行建模。为了在状态估计和发射激励中考虑合成不确定性,考虑了一种随机状态转换模型。除了在训练过程中显著的奖励改进外,经过训练的策略还展示了捕获性能(在广泛的发射/目标场景中),该性能接近于在单个场景中运行的基于可靠性的优化所获得的性能。

英文摘要:

Tether-net launched from a chaser spacecraft provides a promising method to capture and dispose of large space debris in orbit. This tether-net system is subject to several sources of uncertainty in sensing and actuation that affect the performance of its net launch and closing control. Earlier reliability-based optimization approaches to design control actions however remain challenging and computationally prohibitive to generalize over varying launch scenarios and target (debris) state relative to the chaser. To search for a general and reliable control policy, this paper presents a reinforcement learning framework that integrates a proximal policy optimization (PPO2) approach with net dynamics simulations. The latter allows evaluating the episodes of net-based target capture, and estimate the capture quality index that serves as the reward feedback to PPO2. Here, the learned policy is designed to model the timing of the net closing action based on the state of the moving net and the target, under any given launch scenario. A stochastic state transition model is considered in order to incorporate synthetic uncertainties in state estimation and launch actuation. Along with notable reward improvement during training, the trained policy demonstrates capture performance (over a wide range of launch/target scenarios) that is close to that obtained with reliability-based optimization run over an individual scenario.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑