具有噪声观测的启发式接入中近视策略的结构和最优性
Structure and Optimality of Myopic Policy in Opportunistic Access with Noisy Observations
摘要:
考虑了多信道机会通信中出现的多臂强盗问题,信道被建模为独立和相同的Gilbert-Elliot信道,信道状态观测值存在误差.在信道状态检测器虚警概率满足一定条件的情况下,建立了一种简单的近视策略结构。结果表明,近视的政策有一个半通用的结构,减少了一个简单的循环过程中的信道选择,并避免了需要知道潜在的马尔可夫转移概率。文中给出了两通道情况下近视策略的最优性证明和一般情况下近视策略的最优性证明。
英文摘要:
A restless multi-armed bandit problem that arises in multichannel opportunistic communications is considered, where channels are modeled as independent and identical Gilbert-Elliot channels and channel state observations are subject to errors. A simple structure of the myopic policy is established under a certain condition on the false alarm probability of the channel state detector. It is shown that the myopic policy has a semi-universal structure that reduces channel selection to a simple round-robin procedure and obviates the need to know the underlying Markov transition probabilities. The optimality of the myopic policy is proved for the case of two channels and conjectured for the general case based on numerical examples.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。