基于强化学习的卷积神经网络频谱感知超参数选择
RL-Based Hyperparameter Selection for Spectrum Sensing With CNNs
AI总结:
针对频谱感知CNN超参数选择难题,提出基于强化学习与Q-learning的架构搜索方法及多臂老虎机感知时间选择方法,可提升检测准确率与网络奖励,优化认知无线电网络性能。
摘要:
深度神经网络的超参数选择因搜索空间广阔、各类具备特定超参数的层不断涌现而成为一项具有挑战性的问题。目前针对频谱感知任务的卷积神经网络(CNNs)神经架构选择问题尚缺乏相关研究。本文提出一种结合强化学习与Q-learning的方法,针对频谱感知问题中包含不同信号与信道的生成数据集,系统性地搜索并评估多种架构。大量仿真实验表明,本文方法生成的基于CNN的检测器性能优于现有文献中的多种检测器。在最复杂的数据集上,所提方法以更高的计算复杂度为代价,将准确率提升了9%。此外,本文提出一种基于多臂老虎机模型的感知时间选择新方法,可在最小化能耗的同时实现更高的吞吐量与准确率。该方法无需先验信息,可在信道时变条件下动态调整感知时间。通过仿真场景验证,与传统策略相比,所提方法将获得的奖励提升了约20%。综上,本研究有效解决了基于CNN的检测器的关键超参数选择问题,可提升认知无线电网络的性能。
英文摘要:
Selection of hyperparameters in deep neural networks is a challenging problem due to the wide search space and emergence of various layers with specific hyperparameters. There exists an absence of consideration for the neural architecture selection of convolutional neural networks (CNNs) for spectrum sensing. Here, we develop a method using reinforcement learning and Q-learning to systematically search and evaluate various architectures for generated datasets including different signals and channels in the spectrum sensing problem. We show by extensive simulations that CNN-based detectors proposed by our developed method outperform several detectors in the literature. For the most complex dataset, the proposed approach provides 9% enhancement in accuracy at the cost of higher computational complexity. Furthermore, a novel method using multi-armed bandit model for selection of the sensing time is proposed to achieve higher throughput and accuracy while minimizing the consumed energy. The method dynamically adjusts the sensing time under the time-varying condition of the channel without prior information. We demonstrate through a simulated scenario that the proposed method improves the achieved reward by about 20% compared to the conventional policies. Consequently, this study effectively manages the selection of important hyperparameters for CNN-based detectors offering superior performance of cognitive radio network.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。