保证收敛的自主搜索中的多步探测和开采双重控制
Multi-step dual control for exploration and exploitation in autonomous search with convergence guarantee
摘要:
受最近提出的勘探和开采双重控制(DCEE)概念的启发,本文提出了一种多步DCEE(MS-DCEE)框架,保证收敛的机载分散源的自主搜索。不同于现有的随机模型预测控制(SMPC)算法和信息路径规划(IPP)的方法,建议MS-DCEE方法使用当前和未来的输入,不仅驱动代理对估计源位置(开采),但也减少其估计的不确定性(勘探)通过主动学习的操作环境。未知的源目标位置,加上未知的环境,建立递归的可行性和所提出的算法的收敛性提出了重大的挑战。为了解决这些问题,我们利用贝叶斯估计的性质,提出了一种两步估计方法,首先假设均值估计的无偏性,然后考虑每个信息序列下均值估计的随机性。在此基础上,我们开发了一个MS-DCEE计划与适当的终端成分,递归的可行性和收敛性得到保证。仿真结果表明,该算法在搜索成功率和搜索效率方面均优于SMPC、IPP和单步DCEE算法。
英文摘要:
Motivated by the recently proposed dual control for exploration and exploitation (DCEE) concept, this paper presents a Multi-Step DCEE (MS-DCEE) framework with guaranteed convergence for autonomous search of a source of airborne dispersion. Different from the existing stochastic model predictive control (SMPC) algorithm and informative path planning (IPP) approaches, the proposed MS-DCEE approach uses the current and future input to not only drive the agent towards the estimated source location (exploitation) but also reduce its estimation uncertainty (exploration) by actively learning the operational environment. Unknown source target position, together with unknown environment, impose significant challenges in establishing the recursive feasibility and the convergence of the proposed algorithm. To address them, with the help of the property of Bayesian estimation, we develop a two-step approach where the unbiasedness of the mean estimation is assumed first and then the randomness of the mean estimate under each collected information sequence is accounted. Based on that, we develop a MS-DCEE scheme with suitable terminal ingredients where recursive feasibility and convergence are guaranteed. Two simulation scenarios are conducted, which show that the proposed MS-DCEE algorithm outperforms the SMPC, the IPP and the single-step DCEE approaches in terms of searching successful rates and efficiency.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。