基于深度强化学习的短时高空气球季节性驻留控制
Seasonal Station-Keeping of Short Duration High Altitude Balloons using Deep Reinforcement Learning
AI总结:
本文提出用深度Q学习解决短时高空气球在动态风场中的驻留控制问题,基于历史探空数据生成合成风预报训练智能体,并引入预报评分算法分析不同季节风况下驻留成功率的变化趋势。
摘要:
在感兴趣区域内对短时高空气球(HAB)进行驻留控制是一个具有挑战性的路径规划问题,原因在于风场是部分可观测、复杂且动态变化的。深度强化学习是解决驻留控制问题的一种常用策略。本研究开发了一个自定义仿真环境,用于在仿真中训练和评估面向短时高空气球智能体的深度Q学习(DQN)方法。为了使智能体在真实风况下训练,我们基于聚合的历史无线电探空数据生成了合成风预报,并将水平运动学应用于仿真智能体。合成预报与ECWMF ERA5再分析预报高度相关,从而提供了真实的仿真风场以及不同风模型之间的季节性和高度差异。随后,DQN高空气球智能体在不同季节月份中进行了训练和评估。为了突出风场差异很大的月份之间的差异和趋势,我们引入了一种预报评分算法,根据风的多样性对预报进行独立分类,并评估了所有季节中驻留控制成功率与预报评分之间的趋势。
英文摘要:
Station-Keeping short-duration high-altitude balloons (HABs) in a region of interest is a challenging path-planning problem due to partially observable, complex, and dynamic wind flows. Deep reinforcement learning is a popular strategy for solving the station-keeping problem. A custom simulation environment was developed to train and evaluate Deep Q-Learning (DQN) for short-duration HAB agents in the simulation. To train the agents on realistic winds, synthetic wind forecasts were generated from aggregated historical radiosonde data to apply horizontal kinematics to simulated agents. The synthetic forecasts were closely correlated with ECWMF ERA5 Reanalysis forecasts, providing a realistic simulated wind field and seasonal and altitudinal variances between the wind models. DQN HAB agents were then trained and evaluated across different seasonal months. To highlight differences and trends in months with vastly different wind fields, a Forecast Score algorithm was introduced to independently classify forecasts based on wind diversity, and trends between station-keeping success and the Forecast Score were evaluated across all seasons.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。