arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.10784cs.RO
收藏

利用贝叶斯优化识别高空气球最优发射点以实现驻留任务

Identifying Optimal Launch Sites of High-Altitude Latex-Balloons using Bayesian Optimisation for the Task of Station-Keeping

University of Bath(巴斯大学);Toronto Metropolitan University(多伦多都会大学);University of Toronto(多伦多大学)

Jack Saunders, Sajad Saeedi, Adam Hartshorne, Binbin Xu, Özgur Şimşek, Alan Hunter, Wenbin Li

AI总结:

针对高空气球驻留任务,提出用贝叶斯优化寻找最优发射点,并修正强化学习控制器对环境的利用,实验表明BO更高效且最优发射点常在目标区域外。

摘要:

高空气球的驻留任务在生态调查、大气分析和通信中继等领域展现出应用前景。然而,确定发射乳胶高空气球的最佳时间和位置仍是一个具有挑战性的多层面问题。例如,森林火灾追踪等任务对气球的发射位置施加了几何约束。此外,确定最优位置还严重依赖于大气条件。我们首先展示了常用于驻留任务的基于强化学习的控制器如何利用环境。这种利用会在未见过的天气模式下降低性能,并在识别最优发射配置时影响驻留性能。在区域内对所有状态一视同仁的情况下,智能体通过靠近边缘飞行来利用区域几何特性,导致危险行为。我们提出了一种修正方法以补偿这种利用,并发现该方法在未见数据上平均能增加目标区域内的步数。然后,我们展示了贝叶斯优化(BO)如何识别执行驻留任务的最优发射位置,最大化给定轨迹的期望无折扣回报。我们表明,与其他优化方法相比,BO能在更少的步骤内找到该发射位置。结果表明,令人惊讶的是,最优发射位置通常不在目标区域内。更多项目信息请访问 https://sites.google.com/view/bo-lauch-balloon/。

英文摘要:

Station-keeping tasks for high-altitude balloons show promise in areas such as ecological surveys, atmospheric analysis, and communication relays. However, identifying the optimal time and position to launch a latex high-altitude balloon is still a challenging and multifaceted problem. For example, tasks such as forest fire tracking place geometric constraints on the launch location of the balloon. Furthermore, identifying the most optimal location also heavily depends on atmospheric conditions. We first illustrate how reinforcement learning-based controllers, frequently used for station-keeping tasks, can exploit the environment. This exploitation can degrade performance on unseen weather patterns and affect station-keeping performance when identifying an optimal launch configuration. Valuing all states equally in the region, the agent exploits the region's geometry by flying near the edge, leading to risky behaviours. We propose a modification which compensates for this exploitation and finds this leads to, on average, higher steps within the target region on unseen data. Then, we illustrate how Bayesian Optimisation (BO) can identify the optimal launch location to perform station-keeping tasks, maximising the expected undiscounted return from a given rollout. We show BO can find this launch location in fewer steps compared to other optimisation methods. Results indicate that, surprisingly, the most optimal location to launch from is not commonly within the target region. Please find further information about our project at https://sites.google.com/view/bo-lauch-balloon/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑