arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.01640eess.SYcs.AIcs.SY
收藏

风险感知的随机最短路径

Risk-aware Stochastic Shortest Path

IST Austria(奥地利科学技术研究所)

Tobias Meggendorfer

摘要:

研究了马尔可夫决策过程(MDP)上随机最短路(SSP)的风险感知控制问题。通常情况下,预期被认为是SSP,但忽视了所发生的风险。我们提出了另一种观点,而不是优化条件风险价值(CVaR),一个既定的风险度量。我们对待马尔可夫链以及MDP和介绍,通过新的见解,两个算法,分别基于线性规划和值迭代。这两种算法都提供了精确和可证明正确的解决方案。我们的原型实现的评估表明,风险意识控制是可行的几个中等规模的模型。

英文摘要:

We treat the problem of risk-aware control for stochastic shortest path (SSP) on Markov decision processes (MDP). Typically, expectation is considered for SSP, which however is oblivious to the incurred risk. We present an alternative view, instead optimizing conditional value-at-risk (CVaR), an established risk measure. We treat both Markov chains as well as MDP and introduce, through novel insights, two algorithms, based on linear programming and value iteration, respectively. Both algorithms offer precise and provably correct solutions. Evaluation of our prototype implementation shows that risk-aware control is feasible on several moderately sized models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑