arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.10368eess.SP
收藏

基于AUV、SWIPT和强化学习的可持续水下物联网

Towards a Sustainable Internet-of-Underwater-Things based on AUVs, SWIPT, and Reinforcement Learning

Kenechi G. Omeke, Michael Mollel, Syed T. Shah, Lei Zhang, Qammer H. Abbasi, Muhammad Ali Imran

摘要:

地球上的生命依赖于健康的海洋,海洋提供了地球上很大一部分的氧气、食物和能量。然而,海洋正受到气候变化的威胁,气候变化正在破坏海洋生态系统以及依赖海洋生态系统的经济和社会系统。水下物联网(IoUT)是一种全球水下物体互联,可以对海洋进行全天候监测。它为训练机器学习(ML)算法提供高分辨率数据,以快速评估潜在的气候变化解决方案并加快决策。传统IoT中的传感器是电池供电的,这限制了它们的寿命,并且在它们死亡时构成环境危害。在本文中,我们提出了一个可持续的计划,以提高水下网络的吞吐量和生命周期,使他们能够无限期地运行。该方案是基于同时无线信息和功率传输(SWIPT)从一个自主水下航行器(AUV)用于数据收集。我们将联合最大化吞吐量和收获功率的问题建模为马尔可夫决策过程(MDP),并开发了无模型强化学习(RL)算法作为解决方案。该模型的奖励函数激励AUV找到最佳轨迹,最大限度地提高吞吐量和功率传输到水下节点,同时最大限度地减少能源消耗。据我们所知,这是第一次尝试通过SWIPT使用RL来确保可持续的水下网络。该方案是在一个开放的3D RL环境中专门开发的MATLAB为这项研究。性能测试结果表明,与随机轨迹方案相比,作为基线模型的能量效率提高了207%。

英文摘要:

Life on earth depends on healthy oceans, which supply a large percentage of the planet's oxygen, food, and energy. However, the oceans are under threat from climate change, which is devastating the marine ecosystem and the economic and social systems that depend on it. The Internet-of-underwater-things (IoUTs), a global interconnection of underwater objects, enables round-the-clock monitoring of the oceans. It provides high-resolution data for training machine learning (ML) algorithms for rapidly evaluating potential climate change solutions and speeding up decision-making. The sensors in conventional IoUTs are battery-powered, which limits their lifetime, and constitutes environmental hazards when they die. In this paper, we propose a sustainable scheme to improve the throughput and lifetime of underwater networks, enabling them to potentially operate indefinitely. The scheme is based on simultaneous wireless information and power transfer (SWIPT) from an autonomous underwater vehicle (AUV) used for data collection. We model the problem of jointly maximising throughput and harvested power as a Markov Decision Process (MDP), and develop a model-free reinforcement learning (RL) algorithm as a solution. The model's reward function incentivises the AUV to find optimal trajectories that maximise throughput and power transfer to the underwater nodes while minimising energy consumption. To the best of our knowledge, this is the first attempt at using RL to ensure sustainable underwater networks via SWIPT. The scheme is implemented in an open 3D RL environment specifically developed in MATLAB for this study. The performance results show up 207% improvement in energy efficiency compared to those of a random trajectory scheme used as a baseline model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑