arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.07933math.OC
收藏

随机资源消耗下的在线资源分配

Online Resource Allocation with Stochastic Resource Consumption

Jiashuo Jiang, Jiawei Zhang

摘要:

我们考虑一个在线资源分配问题,其中多个资源,每个具有单独的初始容量,可用于服务随机请求在多个离散的时间段内顺序到达。在每个时间段,一个请求到达,其相关的奖励和大小独立于可能依赖于资源的已知分布。在它到达并显示自己时,必须在线决定是否接受请求。如果被接受,还应该做出另一个在线决策,指定分配哪个资源来服务请求,然后将消耗等于请求大小的一定量的资源,并将获得奖励。决策者的目标是在能力约束下最大化所收集的总奖励。我们分别在两个设置下为我们的问题开发近最优的政策。当奖励分布有一个有限的支持,我们假设,每个奖励实现,不同的资源的大小分布是完全正相关的,我们提出了一个自适应阈值政策。我们发现,在一定的规则性条件下的大小分布,我们的政策享有最佳的$O(\log T)$遗憾界,其中$T$表示的总时间段。当奖励分布的支持度不一定是有限的时,当每个请求的奖励和大小都与资源无关且大小分布满足相同的条件时,我们提出了另一种具有$O(\log T)$遗憾界的自适应阈值策略.

英文摘要:

We consider an online resource allocation problem where multiple resources, each with an individual initial capacity, are available to serve random requests arriving sequentially over multiple discrete time periods. At each time period, one request arrives and its associated reward and size are drawn independently from a known distribution that could be resource-dependent. Upon its arrival and revealing itself, an online decision has to be made on whether or not to accept the request. If accepted, another online decision should also be made to specify on assigning which resource to serve the request, then a certain amount of the resource equal to the size of the request will be consumed and a reward will be collected. The objective of the decision maker is to maximize the total collected reward subject to the capacity constraints. We develop near-optimal policies for our problem under two settings separately. When the reward distribution has a finite support, we assume that given each reward realization, the size distributions for different resources are perfectly positive correlated and we propose an adaptive threshold policy. We show that with certain regularity conditions on the size distribution, our policy enjoys an optimal $O(\log T)$ regret bound, where $T$ denotes the total time periods. When the support of the reward distribution is not necessarily finite, we develop another adaptive threshold policy with a $O(\log T)$ regret bound when both the reward and the size of each request are resource-independent and the size distribution satisfies the same conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑