This paper addresses a class of robust stochastic optimal control problems. Its main contribution lies in the introduction of a general optimization model with variance penalization and an associated solution algorithm that improves out-of-sample robustness while preserving numerical complexity. The proposed variance-penalized model is inspired by a well-established machine learning practice that aims to limit overfitting and extends this idea to stochastic optimal control. Using the Douglas--Rachford splitting method, the authors develop a Variance-Penalized Progressive Hedging Algorithm (VPPHA) that retains the computational complexity of the standard PHA while achieving superior out-of-sample performance. In addition, the authors propose a three-step control framework comprising (i) a random scenario generation method, (ii) a scenario reduction algorithm, and (iii) a scenario-based optimal control computation using the VPPHA. Finally, the proposed method is validated through simulations of a stationary battery Energy Management System (EMS) using ground-truth electricity consumption and production measurements from a predominantly commercial building in Solaize, France. The results demonstrate that the proposed approach outperforms a classical Model Predictive Control (MPC) strategy, which itself performs better than the standard PHA.
Optimal management of pumped hydroelectric production with state constrained optimal control
我们提出了一种新的技术来解决最佳管理抽水蓄能系统的问题。该技术依赖于将系统表示为具有状态约束的随机最优控制问题,这些状态约束对应于储层的有限体积。在O. Bokanowski,A. Picarelli,H. Zidani,“状态约束随机最优控制问题的可达性方法”,SIAM J. Control and Optim. 54(5)(2016),我们将原始约束问题转化为增广状态和控制空间中的辅助无约束问题,通过引入原始状态约束的精确惩罚来获得。后一个问题是完全可以处理的经典动态规划参数。
Independent policy gradient-based reinforcement learning for economic and reliable energy management of multi-microgrid systems
School of Mechanical and Electrical Engineering, Shenzhen Polytechnic University(机械与电气工程学院,深圳职业技术大学);School of Business, Sun Yat-Sen University(商学院,中山大学)
Policy Optimization and Multi-agent Reinforcement Learning for Mean-variance Team Stochastic Games
School of Mechanical and Electrical Engineering, Shenzhen Polytechnic University(机械与电气工程学院,深圳职业技术大学);School of Business, Sun Yat-Sen University(商学院,中山大学)