Multi-access edge computing (MEC) aims to extend cloud service to the network edge to reduce network traffic and service latency. A fundamental problem in MEC is how to efficiently offload heterogeneous tasks of mobile applications from user equipment (UE) to MEC hosts. Recently, many deep reinforcement learning (DRL) based methods have been proposed to learn offloading policies through interacting with the MEC environment that consists of UE, wireless channels, and MEC hosts. However, these methods have weak adaptability to new environments because they have low sample efficiency and need full retraining to learn updated policies for new environments. To overcome this weakness, we propose a task offloading method based on meta reinforcement learning, which can adapt fast to new environments with a small number of gradient updates and samples. We model mobile applications as Directed Acyclic Graphs (DAGs) and the offloading policy by a custom sequence-to-sequence (seq2seq) neural network. To efficiently train the seq2seq network, we propose a method that synergizes the first order approximation and clipped surrogate objective. The experimental results demonstrate that this new offloading method can reduce the latency by up to 25% compared to three baselines while being able to adapt fast to new environments.
QECO: A QoE-Oriented Computation Offloading Algorithm based on Deep Reinforcement Learning for Mobile Edge Computing
Department of Computer Engineering, Sharif University of Technology(计算机工程系,谢赫拉特夫大学);Department of Electrical Engineering, Sharif University of Technology(电气工程系,谢赫拉特夫大学)
Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks
University of Electronic Science and Technology of China(电子科技大学);University of Oslo(奥斯陆大学);Simula Metropolitan Center for Digital Engineering(Simula大都会数字工程中心)
Differentiated Federated Reinforcement Learning Based Traffic Offloading on Space-Air-Ground Integrated Networks
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Graduate School of Information Sciences (GSIS), Tohoku University(东北大学信息科学研究生院)
Carbon-aware decentralized dynamic task offloading in MIMO-MEC networks via multi-agent reinforcement learning
School of Computer Science and Artificial Intelligence(计算机科学与人工智能学院);Wuhan University of Technology(武汉理工大学);School of Computer Science and Information Engineering(计算机科学与信息工程学院);Qilu Institute of Technology(齐鲁工业大学);Department of Computer Science(计算机科学系);Prince Sultan University(普天大学)
Intelligent Task Offloading in VANETs: A Hybrid AI-Driven Approach for Low-Latency and Energy Efficiency
College of Information Technology, United Arab Emirates University(阿联酋大学信息科技学院);Department of Computer Science, SCIT, Beaconhouse National University(贝鲁特国家大学计算机科学系);College of Computing and Informatics, University of Sharjah(沙迦大学计算科学学院);Department of Mathematics, University of Barcelona(巴塞罗那大学数学系)
Computation Offloading in Beyond 5G Networks: A Distributed Learning Framework and Applications
VTT Technical Research Centre of Finland(芬兰VTT技术研究中心);University of Electro-Communications(电气通信大学);Shizuoka University(静冈大学);University of Windsor(温莎大学);National Institute of Informatics(国立信息学研究所)
Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
VTT Technical Research Centre of Finland(芬兰VTT技术研究中心);College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息与电子工程学院);Graduate School of Informatics and Engineering, University of Electro-Communications(电气通信大学信息与工程研究生院);Auburn University(奥本大学);National Institute of Informatics(国立信息学研究所);Centre for Wireless Communications, University of Oulu(奥卢大学无线通信中心)
A Novel Deep Reinforcement Learning Method for Computation Offloading in Multi-User Mobile Edge Computing with Decentralization
School of Information and Communications Technology, Hanoi University of Science and Technology, Vietnam(河内科学技术大学信息与通信学院);Faculty of Electrical and Electronic Engineering, Hanoi Open University, Vietnam(河内开放大学电子与电气工程学院);Posts and Telecommunications Institute of Technology Hanoi, Vietnam(河内邮电技术研究所);Faculty of Informatics, University of Debrecen, Hungary(德布勒恩大学信息学院)
Revenue and Energy Efficiency-Driven Delay Constrained Computing Task Offloading and Resource Allocation in a Vehicular Edge Computing Network: A Deep Reinforcement Learning Approach
AoI-Aware Task Offloading and Transmission Optimization for Industrial IoT Networks: A Branching Deep Reinforcement Learning Approach
Laboratory of Future Networks, University of Science and Technology of China(未来网络实验室,中国科学技术大学);Deep Space Exploration Laboratory(深空探测实验室);Department of Computing, The Hong Kong Polytechnic University(computing系,香港理工大学)
Reconfigurable Intelligent Surface Assisted VEC Based on Multi-Agent Reinforcement Learning
School of Internet of Things Engineering, Jiangnan University(江南大学物联网工程学院);Department of Electronic Engineering, Beijing National Research Center for Information Science and Technology, Tsinghua University(清华大学电子工程系、北京信息科学与技术国家研究中心);State Key Lab. of ISN and School of Telecommunications Engineering, Xidian University(西安电子科技大学信息与通信工程学院);Qualcomm(高通);School of Engineering, University of Kent(肯特大学工程学院)
Maximizing the Promptness of Metaverse Systems using Edge Computing by Deep Reinforcement Learning
Faculty of Information and Communication Technology National Academy of Education Management(信息与通信技术学院国家教育管理 academy);School of Information and Communication Technology(信息与通信技术学院);Faculty of Information Technology(信息技术学院)
Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond
University of Electronic Science and Technology of China(电子科技大学);University of Oslo(奥斯陆大学);Simula Metropolitan Center for Digital Engineering(Simula大都会数字工程中心)
Deep Reinforcement Learning for Delay-Oriented IoT Task Scheduling in Space-Air-Ground Integrated Network
University of Waterloo(滑铁卢大学);Zhejiang University(浙江大学);Huazhong University of Science and Technology(华中科技大学);Central South University(中南大学);Xidian University(西安电子科技大学)
Stacked Auto Encoder Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks
Hunan Normal University(湖南师范大学);Northumbria University(诺森比亚大学);Hunan University of Technology and Business(湖南工商大学);Queen Mary University of London(伦敦玛丽女王大学);Changchun Institute of Technology(长春工程学院);University of Essex(埃塞克斯大学)
TimeGNN-Augmented Hybrid-Action MARL for Fine-Grained Task Partitioning and Energy-Aware Offloading in MEC
College of Computer and Mathematics(计算机与数学学院);Central South University of Forestry and Technology(林业与技术中央南大学);Department of Computer Science(计算机科学系);State University of New York(纽约州立大学)