arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1907.04006math.OCphysics.app-ph
收藏

Infinite Dimensional随机系统基于变分Optimization的强化学习

Variational Optimization Based Reinforcement Learning for Infinite Dimensional Stochastic Systems

Ethan N. Evans, Marcus A. Pereira, George I. Boutselis, Evangelos A. Theodorou

摘要:

涉及偏微分方程(PDE)的系统最近在机器学习界变得越来越流行。然而,现有的方法通常处理无限维问题的有限维降阶模型。这导致了对特定的近似方案和随后的控制律推导的承诺。此外,以前的工作不考虑噪声的时空描述,现实地表示物理系统的随机性。在本文中,我们提出了一个新的强化学习框架,主要是无模型的随机偏微分方程加性时空噪声,基于变分优化在无限维。此外,我们的算法采用了稀疏表示,允许在高维反馈策略的有效学习。我们证明了所提出的方法的有效性与几个模拟实验上的各种SPDE。

英文摘要:

Systems involving Partial Differential Equations (PDEs) have recently become more popular among the machine learning community. However prior methods usually treat infinite dimensional problems in finite dimensions with Reduced Order Models. This leads to committing to specific approximation schemes and subsequent derivation of control laws. Additionally, prior work does not consider spatio-temporal descriptions of noise that realistically represent the stochastic nature of physical systems. In this paper we suggest a new reinforcement learning framework that is mostly model-free for Stochastic PDEs with additive spacetime noise, based on variational optimization in infinite dimensions. In addition, our algorithm incorporates sparse representations that allow for efficient learning of feedback policies in high dimensions. We demonstrate the efficacy of the proposed approach with several simulated experiments on a variety of SPDEs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑