基于核的最优控制:一种无穷小生成元方法
Kernel-Based Optimal Control: An Infinitesimal Generator Approach
AI总结:
本文提出一种基于再生核希尔伯特空间的算子理论方法,通过学习受控随机扩散的无穷小生成元,结合凸哈密顿-雅可比-贝尔曼递推,实现数据驱动的非线性随机系统最优控制,并在数值实验中验证其优于现有方法。
摘要:
本文提出了一种新颖的算子理论方法,用于在再生核希尔伯特空间中实现非线性随机系统的最优控制。我们的学习框架利用系统动力学和阶段成本函数的数据样本,仅需提供控制惩罚和约束。所提出的方法直接在无限维假设空间中学习受控随机扩散的无穷小生成元。我们证明了该方法能够与现代凸算子理论的哈密顿-雅可比-贝尔曼递推无缝集成,从而实现最优控制问题的数据驱动求解。此外,我们的学习框架将无控制无穷小生成元的非参数估计器作为特例包含在内。数值实验涵盖了从合成微分方程到模拟机器人系统的多种场景,展示了我们的方法相较于现代数据驱动方法和经典非线性规划方法在最优控制中的优势。
英文摘要:
This paper presents a novel operator-theoretic approach for optimal control of nonlinear stochastic systems within reproducing kernel Hilbert spaces. Our learning framework leverages data samples of system dynamics and stage cost functions, with only control penalties and constraints provided. The proposed method directly learns the infinitesimal generator of a controlled stochastic diffusion in an infinite-dimensional hypothesis space. We demonstrate that our approach seamlessly integrates with modern convex operator-theoretic Hamilton-Jacobi-Bellman recursions, enabling a data-driven solution to the optimal control problems. Furthermore, our learning framework includes nonparametric estimators for uncontrolled infinitesimal generators as a special case. Numerical experiments, ranging from synthetic differential equations to simulated robotic systems, showcase the advantages of our approach compared to both modern data-driven and classical nonlinear programming methods for optimal control.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。