arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.04585cs.NI
收藏

利用摄像机图像和深度强化学习进行主动性能预测的mmWave网络切换管理

Handover Management for mmWave Networks with Proactive Performance Prediction Using Camera Images and Deep Reinforcement Learning

Yusuke Koda, Kota Nakashima, Koji Yamamoto, Takayuki Nishio, Masahiro Morikura

摘要:

对于毫米波网络,本文提出了一种范式转变,利用时间连续的相机图像切换决策问题。在做出切换决策时,重要的是预测未来的长期性能-例如,时变数据率的累积和-主动避免做出短视的决定。然而,这项研究实验注意到,在接收功率的时间变化不一定是信息主动预测移动障碍物引起的数据率的快速退化。为了克服这一挑战,本研究提出了一种主动的框架,其中切换时序进行了优化,而障碍物引起的数据率退化发生之前预测的退化。关键思想是扩展状态空间以涉及时间连续的相机图像,其包括用于预测这种数据率劣化的信息特征。为了克服在处理扩展状态空间的大维度的困难,我们使用深度强化学习来决定切换定时。基于实验获得的相机图像和接收功率执行的评估表明,扩展的状态空间便于(i)从劣化发生之前的500 ms预测障碍物引起的数据率劣化,以及(ii)优于没有状态空间扩展的切换框架的性能

英文摘要:

For millimeter-wave networks, this paper presents a paradigm shift for leveraging time-consecutive camera images in handover decision problems. While making handover decisions, it is important to predict future long-term performance---e.g., the cumulative sum of time-varying data rates---proactively to avoid making myopic decisions. However, this study experimentally notices that a time-variation in the received powers is not necessarily informative for proactively predicting the rapid degradation of data rates caused by moving obstacles. To overcome this challenge, this study proposes a proactive framework wherein handover timings are optimized while obstacle-caused data rate degradations are predicted before the degradations occur. The key idea is to expand a state space to involve time consecutive camera images, which comprises informative features for predicting such data rate degradations. To overcome the difficulty in handling the large dimensionality of the expanded state space, we use a deep reinforcement learning for deciding the handover timings. The evaluations performed based on the experimentally obtained camera images and received powers demonstrate that the expanded state space facilitates (i) the prediction of obstacle-caused data rate degradations from 500 ms before the degradations occur and (ii) superior performance to a handover framework without the state space expansion

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑