arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1102.5400cs.ITmath.IT
收藏

基于多智能体Q学习的认知无线Mesh网络功率分配

Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach

Xianfu Chen, Zhifeng Zhao, Honggang Zhang

摘要:

随着频谱资源的日益拥挤,认知无线电(CR)通过机会性地接入授权频段来提高频谱效率,表现出极大的灵活性。在网络中操作这种无线电的关键挑战之一是如何在满足主用户(PU)的服务质量(QoS)约束的同时在次用户(SU)之间有效地分配传输功率和频率资源。在本文中,我们专注于非合作的认知无线网状网络(CogMesh)的功率分配问题,形成了一些集群的能源效率的考虑。由于SU的自私性和自发性,该问题被建模为一个随机学习过程。首先将单智能体Q-learning算法扩展到多用户环境,然后提出一种基于猜想的多智能体Q-learning算法,以实现仅具有私有和不完全信息的最优传输策略。智能SU根据对其他SU随机行为的推测进行Q函数更新。这种学习算法可证明收敛给定的某些限制,在学习过程中出现。通过仿真实验验证了算法的性能,并证明了其提高能量效率的有效性。

英文摘要:

As the scarce spectrum resource is becoming over-crowded, cognitive radios (CRs) indicate great flexibility to improve the spectrum efficiency by opportunistically accessing the authorized frequency bands. One of the critical challenges for operating such radios in a network is how to efficiently allocate transmission powers and frequency resource among the secondary users (SUs) while satisfying the quality-of-service (QoS) constraints of the primary users (PUs). In this paper, we focus on the non-cooperative power allocation problem in cognitive wireless mesh networks (CogMesh) formed by a number of clusters with the consideration of energy efficiency. Due to the SUs' selfish and spontaneous properties, the problem is modeled as a stochastic learning process. We first extend the single-agent Q-learning to a multi-user context, and then propose a conjecture based multi-agent Qlearning algorithm to achieve the optimal transmission strategies with only private and incomplete information. An intelligent SU performs Q-function updates based on the conjecture over the other SUs' stochastic behaviors. This learning algorithm provably converges given certain restrictions that arise during learning procedure. Simulation experiments are used to verify the performance of our algorithm and demonstrate its effectiveness of improving the energy efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑