arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1807.05947math.OC
收藏

对偶动态规划的矩和平方和推广及其在非线性储能问题中的应用

A Moment and Sum-of-Squares Extension of Dual Dynamic Programming with Application to Nonlinear Energy Storage Problems

Marc Hohmann, Joseph Warrington, John Lygeros

摘要:

我们提出了一个有限的时间范围内的优化算法,扩展了既定的概念,双动态规划(DDP)在两个方面。首先,与标准DDP的线性成本、动态和约束相比,我们考虑所有这些都可以是多项式函数的问题。其次,我们允许状态轨迹由概率分布而不是点值来描述,并返回拟合到这些的近似值函数。该算法部分地是在近似动态规划文献中使用的平方和技术的适应。它交替之间的前向模拟通过地平线,其中的时刻的状态分布是通过一系列的单阶段的问题,和向后递归,其中一个新的多项式函数推导出每个阶段使用的时刻的状态作为固定的数据。为给定阶段返回的值函数近似值是为该阶段导出的所有多项式的逐点最大值。这与在传统DDP中得到的分段仿射函数形成对比。我们证明了新算法的关键收敛特性,并在模拟中验证了两个案例研究与非线性特性的储能设备的最佳操作。第一个是一个小的钻孔存储问题,其中多值函数近似可以比较。第二个是一个更大的问题,传统的离散化动态规划是棘手的。

英文摘要:

We present a finite-horizon optimization algorithm that extends the established concept of Dual Dynamic Programming (DDP) in two ways. First, in contrast to the linear costs, dynamics, and constraints of standard DDP, we consider problems in which all of these can be polynomial functions. Second, we allow the state trajectory to be described by probability distributions rather than point values, and return approximate value functions fitted to these. The algorithm is in part an adaptation of sum-of-squares techniques used in the approximate dynamic programming literature. It alternates between a forward simulation through the horizon, in which the moments of the state distribution are propagated through a succession of single-stage problems, and a backward recursion, in which a new polynomial function is derived for each stage using the moments of the state as fixed data. The value function approximation returned for a given stage is the point-wise maximum of all polynomials derived for that stage. This contrasts with the piecewise affine functions derived in conventional DDP. We prove key convergence properties of the new algorithm, and validate it in simulation on two case studies related to the optimal operation of energy storage devices with nonlinear characteristics. The first is a small borehole storage problem, for which multiple value function approximations can be compared. The second is a larger problem, for which conventional discretized dynamic programming is intractable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑