arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2204.01410math.OC
收藏

异质总体的遍历控制及其在电力定价中的应用

Ergodic control of a heterogeneous population and application to electricity pricing

Quentin Jacquet, Wim van Ackooij, Clémence Alasseur, Stéphane Gaubert

AI总结:

针对可在选项间切换的无限异质智能体总体,研究平均场Markov决策过程的遍历控制,证明特征问题解的存在性与非唯一性,并提出适配可分解模型的即时转移策略迭代算法,应用于电力定价并发现循环促销策略。

摘要:

我们考虑一个由智能体组成的异质总体的控制问题,这些智能体能够随时在不同选项之间切换。控制者的目标是在假定总体规模无限大的情况下,最大化每单位时间的平均收益。这引出了一个“平均场”Markov决策过程的遍历控制问题,其中状态空间是单纯形的乘积,而总体按照受控线性动力学演化。通过利用该动力学在Hilbert投影度量中的收缩性质,我们证明了无限维遍历特征问题存在解,并表明该解通常是非唯一的。这使我们能够获得最优策略,并量化稳态策略与最优策略之间的差距。特别地,我们在一维情形中证明,存在循环策略——在折扣阶段和获利阶段之间交替——其确保获得比恒定价格策略更高的收益。在数值方面,我们开发了一种带有“即时”生成转移的策略迭代算法,专门适配可分解模型,从而带来显著的内存节省。最后,我们将结果应用于来自零售市场中遇到的电力定价问题的现实实例,并在数值上观察到,当客户行为具有足够惯性时,会出现循环促销。

英文摘要:

We consider a control problem for a heterogeneous population composed of agents able to switch at any time between different options. The controller aims to maximize an average gain per time unit, supposing that the population is of infinite size. This leads to an ergodic control problem for a "mean-field" Markov Decision Process in which the state space is a product of simplices, and the population evolves according to controlled linear dynamics. By exploiting contraction properties of the dynamics in Hilbert's projective metric, we prove that the infinite-dimensional ergodic eigenproblem admits a solution and show that the latter is in general non unique. This allows us to obtain optimal strategies, and to quantify the gap between steady-state strategies and optimal ones. In particular, we prove in the one-dimensional case that there exist cyclic policies -- alternating between discount and profit taking stages -- which secure a greater gain than constant-price policies. On numerical aspects, we develop a policy iteration algorithm with "on-the-fly" generated transitions, specifically adapted to decomposable models, leading to substantial memory savings. We finally apply our results on realistic instances coming from an electricity pricing problem encountered in the retail markets, and numerically observe the emergence of cyclic promotions for sufficient inertia in the customer behavior.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑