arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.02033cs.DCcs.LG
收藏

边缘计算中基于Meta强化学习的快速自适应任务分流

Fast Adaptive Task Offloading in Edge Computing based on Meta Reinforcement Learning

University of Exeter(埃克塞特大学);The University of Sydney(悉尼大学);British Telecom(英国电信)

Jin Wang, Jia Hu, Geyong Min, Albert Y. Zomaya, Nektarios Georgalas

摘要:

多访问边缘计算(MEC)旨在将云服务扩展到网络边缘,以减少网络流量和服务延迟。MEC中的一个基本问题是如何有效地将移动应用的异构任务从用户设备(UE)卸载到MEC主机。最近,人们提出了许多基于深度强化学习(DRL)的方法,通过与由UE、无线信道和MEC主机组成的MEC环境交互来学习卸载策略。然而,这些方法对新环境的适应性较弱,因为它们具有低的样本效率,并且需要完全重新训练来学习针对新环境的更新策略。为了克服这一弱点,提出了一种基于Meta强化学习的任务卸载方法,该方法能够以少量的梯度更新和样本快速适应新的环境。我们将移动应用程序建模为有向无环图(DAG),并通过自定义序列到序列(seq2seq)神经网络来实现卸载策略。为了有效地训练seq2seq网络,我们提出了一种方法,协同一阶近似和裁剪代理目标。实验结果表明,这种新的卸载方法可以减少高达25%的延迟相比,三个基线,同时能够快速适应新的环境。

英文摘要:

Multi-access edge computing (MEC) aims to extend cloud service to the network edge to reduce network traffic and service latency. A fundamental problem in MEC is how to efficiently offload heterogeneous tasks of mobile applications from user equipment (UE) to MEC hosts. Recently, many deep reinforcement learning (DRL) based methods have been proposed to learn offloading policies through interacting with the MEC environment that consists of UE, wireless channels, and MEC hosts. However, these methods have weak adaptability to new environments because they have low sample efficiency and need full retraining to learn updated policies for new environments. To overcome this weakness, we propose a task offloading method based on meta reinforcement learning, which can adapt fast to new environments with a small number of gradient updates and samples. We model mobile applications as Directed Acyclic Graphs (DAGs) and the offloading policy by a custom sequence-to-sequence (seq2seq) neural network. To efficiently train the seq2seq network, we propose a method that synergizes the first order approximation and clipped surrogate objective. The experimental results demonstrate that this new offloading method can reduce the latency by up to 25% compared to three baselines while being able to adapt fast to new environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑