arXivDaily arXiv每日学术速递 周一至周五更新
arXiv math/0501035math.PR
收藏

大偏差区域网络控制问题的显式解

Explicit solution for a network control problem in the large deviation regime

Rami Atar, Paul Dupuis, Adam Shwartz

摘要:

我们考虑随机网络的最优控制,其中服务被控制以防止缓冲区溢出。我们使用一个风险敏感的逃逸时间标准,这在普通的逃逸时间标准相比,严重惩罚出口发生在短的时间间隔。考虑了缓冲区大小趋于无穷大时的限制。在[2]中,我们证明了,对于一个大类的网络,标准化成本的限制符合微分对策的价值函数。博弈的价值在[2]中被描述为Hamilton-Jacobi-Bellman偏微分方程(PDE)的唯一解。在本文中,我们将这一一般理论的重要情况下,网络的队列串联。我们的主要结果是:(i)构造相应偏微分方程的显式解,(ii)引出对网络的最优风险敏感和鲁棒监管的影响。具体而言,可以提取以下一般原则。为了避免缓冲区溢出,两种趋势之间存在自然的竞争。可以选择为特定的队列提供服务,因为这将有助于防止其自己的缓冲区溢出,或者可以选择停止服务,目的是防止缓冲区进一步溢出。PDE的解指明了这两者之间的最优选择,指定了状态空间中必须为每个队列提供服务的部分(以免失去最优性),以及它可以空闲的部分。

英文摘要:

We consider optimal control of a stochastic network,where service is controlled to prevent buffer overflow. We use a risk-sensitive escape time criterion, which in comparison to the ordinary escape time criteria heavily penalizes exits which occur on short time intervals. A limit as the buffer sizes tend to infinity is considered. In [2] we showed that, for a large class of networks, the limit of the normalized cost agrees with the value function of a differential game. The game's value is characterized in [2] as the unique solution to a Hamilton-Jacobi-Bellman Partial Differential Equation (PDE). In the current paper we apply this general theory to the important case of a network of queues in tandem. Our main results are: (i) the construction of an explicit solution to the corresponding PDE, and (ii) drawing out the implications for optimal risk-sensitive and robust regulation of the network. In particular, the following general principle can be extracted. To avoid buffer overflow there is a natural competition between two tendencies. One may choose to serve a particular queue, since that will help prevent its own buffer from overflowing, or one may prefer to stop service, with the goal of preventing overflow of buffers further down the line. The solution to the PDE indicates the optimal choice between these two, specifying the parts of the state space where each queue must be served (so as not to lose optimality), and where it can idle.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑