arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.11984eess.SYcs.SY
收藏

基于主动学习的自动优化控制中探索与利用的双重控制

Dual Control of Exploration and Exploitation for Auto-Optimisation Control with Active Learning

Zhongguo Li, Wen-Hua Chen, Jun Yang, Yunda Yan

AI总结:

本文提出DCEE双重控制框架,利用基于集成的多估计器和无需额外扰动的主动探索机制,同时实现最优运行条件跟踪、参数辨识与不确定性降低,并通过数值算例和最大功率点跟踪仿真验证其有效性。

摘要:

在存在未知因素和不确定性的环境中追求最优运行,在众多领域都极具价值,但也极具挑战性。本文开发了一种用于探索与利用的双重控制框架(DCEE),以解决此类复杂场景下的自动优化问题。一般而言,在跟踪未知最优运行条件与参数辨识之间存在根本性冲突。DCEE框架的突出之处在于无需额外的扰动信号,而这是现有自适应控制方法的常见要求。相反,它内在地融合了探索机制,主动探测不确定环境以降低信念不确定性。文中提出了一种基于集成的多估计器方法,用于学习环境参数,并同时实时量化估计不确定性。所设计的控制动作具有双重效应:不仅最小化当前状态与所认为的未知最优运行条件之间的跟踪误差,还通过主动探索环境来降低信念不确定性。本文建立了所提出DCEE框架的收敛性等形式化性质。通过一个数值算例验证了DCEE的有效性,并提供了最大功率点跟踪的仿真结果,进一步展示了这一新框架在现实世界应用中的潜力。

英文摘要:

The quest for optimal operation in environments with unknowns and uncertainties is highly desirable but critically challenging across numerous fields. This paper develops a dual control framework for exploration and exploitation (DCEE) to solve an auto-optimisation problem in such complex settings. In general, there is a fundamental conflict between tracking an unknown optimal operational condition and parameter identification. The DCEE framework stands out by eliminating the need for additional perturbation signals, a common requirement in existing adaptive control methods. Instead, it inherently incorporates an exploration mechanism, actively probing the uncertain environment to diminish belief uncertainty. An ensemble based multi-estimator approach is developed to learn the environmental parameters and in the meanwhile quantify the estimation uncertainty in real time. The control action is devised with dual effects, which not only minimises the tracking error between the current state and the believed unknown optimal operational condition but also reduces belief uncertainty by proactively exploring the environment. Formal properties of the proposed DCEE framework like convergence are established. A numerical example is used to validate the effectiveness of the proposed DCEE. Simulation results for maximum power point tracking are provided to further demonstrate the potential of this new framework in real world applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑