arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.02889eess.SPcs.GTcs.LG
收藏

用于具有使用深度强化学习的无线功率传输的IoT的RIS辅助的UAV通信

RIS-assisted UAV Communications for IoT with Wireless Power Transfer Using Deep Reinforcement Learning

Queen’s University Belfast(贝尔法斯特女王大学);HoChiMinh City University of Technology and Education(胡志明市工业与教育大学);Princeton University(普林斯顿大学)

Khoi Khac Nguyen, Antonino Masaracchia, Tan Do-Duy, H. Vincent Poor, Trung Q. Duong

摘要:

物联网(IoT)应用中使用的许多设备都是能量有限的,因此在为IoT设备提供能量的同时保持无缝连接是非常重要的。在这种情况下,我们提出了一种同时无线电力传输和信息传输方案的物联网设备的支持下,从可重构智能表面(RIS)辅助无人机(UAV)通信。具体地,在第一阶段中,IoT设备通过无线电力传输从UAV获取能量;然后在第二阶段中,UAV通过信息传输从IoT设备收集数据。为了提高无人机的敏捷性,我们考虑了两种情况:悬停无人机和移动无人机。以最大化网络总速率为目标,我们联合优化了无人机的轨迹、物联网设备的能量收集调度以及RIS的相移矩阵。我们制定了一个马尔可夫决策过程,并提出了两个深度强化学习算法来解决最大化总网络和率的优化问题。数值结果表明,与其他基准计划相比,我们提出的技术的无人机的飞行路径优化和网络的吞吐量的有效性。考虑到RIS和UAV的严格要求,处理时间和吞吐量性能的显着改善表明,我们提出的方案非常适用于实际的物联网应用。

英文摘要:

Many of the devices used in Internet-of-Things (IoT) applications are energy-limited, and thus supplying energy while maintaining seamless connectivity for IoT devices is of considerable importance. In this context, we propose a simultaneous wireless power transfer and information transmission scheme for IoT devices with support from reconfigurable intelligent surface (RIS)-aided unmanned aerial vehicle (UAV) communications. In particular, in a first phase, IoT devices harvest energy from the UAV through wireless power transfer; and then in a second phase, the UAV collects data from the IoT devices through information transmission. To characterise the agility of the UAV, we consider two scenarios: a hovering UAV and a mobile UAV. Aiming at maximizing the total network sum-rate, we jointly optimize the trajectory of the UAV, the energy harvesting scheduling of IoT devices, and the phaseshift matrix of the RIS. We formulate a Markov decision process and propose two deep reinforcement learning algorithms to solve the optimization problem of maximizing the total network sum-rate. Numerical results illustrate the effectiveness of the UAV's flying path optimization and the network's throughput of our proposed techniques compared with other benchmark schemes. Given the strict requirements of the RIS and UAV, the significant improvement in processing time and throughput performance demonstrates that our proposed scheme is well applicable for practical IoT applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑