值函数的形状约束估计
Shape-constrained Estimation of Value Functions
摘要:
我们提出了一个完全非参数的方法来估计的价值函数,通过模拟,在预期的无限时域贴现报酬的马尔可夫链的背景下。在近似动态规划和一般应用概率中,估计这样的值函数起着重要的作用。我们将“软信息”的估计算法,如知识的凸性,单调性,或Lipchitz常数。在存在这样的信息的情况下,可以计算出值函数的非参数估计,当模拟的时间范围趋于无穷大时,该非参数估计是可证明一致的。作为一个应用,我们实现了我们的方法在价格收费协议合同在能源市场。
英文摘要:
We present a fully nonparametric method to estimate the value function, via simulation, in the context of expected infinite-horizon discounted rewards for Markov chains. Estimating such value functions plays an important role in approximate dynamic programming and applied probability in general. We incorporate "soft information" into the estimation algorithm, such as knowledge of convexity, monotonicity, or Lipchitz constants. In the presence of such information, a nonparametric estimator for the value function can be computed that is provably consistent as the simulated time horizon tends to infinity. As an application, we implement our method on price tolling agreement contracts in energy markets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。