arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1205.5375eess.SYcs.GTcs.SY
收藏

非独立同分布臂和不完美检测下多臂赌博机问题中近视策略的最优性

On Optimality of Myopic Policy for Restless Multi-armed Bandit Problem with Non i.i.d. Arms and Imperfect Detection

Laboratoire de Recherche en Informatique (LRI), Department of Computer Science, the University of Paris-Sud XI(巴黎南第十一大学计算机科学与信息研究实验室);school of Information Engineering, Wuhan University of Technology(武汉理工大学信息工程学院)

Kehao Wang, Lin Chen, Quan Liu, Khaldoun Al Agha

AI总结:

针对非独立同分布信道和不完美检测的多信道机会通信系统,提出一类g-正则函数并建立闭式结构条件,证明近视策略的最优性。

摘要:

我们考虑具有不完美信道感知的多信道机会通信系统中的信道接入问题,其中每个信道的状态演化为非独立同分布的马尔可夫过程。该问题可转化为一个计算复杂度呈指数增长的难解多臂赌博机问题。一个自然的替代方案是考虑易于实现的近视策略,该策略最大化即时奖励但忽略当前策略对未来奖励的影响。特别地,我们提出了三个公理来刻画一类称为g-正则函数的通用且实际重要的函数族,该函数族包含工程中广泛的效用函数。通过基于这些公理的数学分析,我们建立了一组闭式结构条件,用于近视策略的最优性。

英文摘要:

We consider the channel access problem in a multi-channel opportunistic communication system with imperfect channel sensing, where the state of each channel evolves as a non independent and identically distributed Markov process. This problem can be cast into a restless multi-armed bandit (RMAB) problem that is intractable for its exponential computation complexity. A natural alternative is to consider the easily implementable myopic policy that maximizes the immediate reward but ignores the impact of the current strategy on the future reward. In particular, we develop three axioms characterizing a family of generic and practically important functions termed as $g$-regular functions which includes a wide spectrum of utility functions in engineering. By pursuing a mathematical analysis based on the axioms, we establish a set of closed-form structural conditions for the optimality of myopic policy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑