We develop a novel framework for fully decentralized offloading policy design in multi-access edge computing (MEC) systems. The system comprises $N$ power-constrained user equipments (UEs) assisted by an edge server (ES) to process incoming tasks. Tasks are labeled with urgency flags, and in this paper, we classify them under three urgency levels, namely, high, moderate, and low urgency. We formulate the problem of designing computation decisions for the UEs within a large population noncooperative game framework, where each UE selfishly decides on how to split task execution between its local onboard processor and the ES. We employ the weighted average age of information (AoI) metric to quantify information freshness at the UEs. Increased onboard processing consumes more local power, while increased offloading may potentially incur a higher average AoI due to other UEs' packets being offloaded to the same ES. Thus, we use the mean-field game (MFG) formulation to compute approximate decentralized Nash equilibrium offloading and local computation policies for the UEs to balance between the information freshness and local power consumption. Finally, we provide a projected gradient descent-based algorithm to numerically assess the merits of our approach.
Learning-based decentralized offloading decision making in an adversarial environment
Aalto University(阿尔托大学)
VFC(Vehicular Fog Computing)将云计算能力推送到互联网边缘的分布式雾节点,通过任务卸载为车辆提供计算密集型和延迟敏感型计算服务。然而,异构的移动环境中引入的资源供应和需求方面的不确定性,这是不可避免的最佳卸载决策的瓶颈。此外,这些不确定性给在不经意的对手攻击和数据隐私风险下的任务卸载带来了额外的挑战。在这篇文章中,我们开发了一个新的对抗性在线学习算法与强盗反馈的基础上的对抗性多臂强盗理论,使可扩展的和低复杂度的卸载决策。具体来说,我们专注于优化雾节点的选择,目的是最大限度地减少卸载服务成本的延迟和能源。关键是在选择过程中隐式地调整探索奖金和所设计算法的评估规则,同时考虑到波动的资源供应和需求。我们从理论上证明,输入大小相关的选择规则允许选择一个合适的雾节点,而不探索次优的行动,也是一个适当的分数修补规则允许快速适应不断变化的情况下,减少方差和偏见,同时,从而实现更好的开发探索平衡。仿真结果验证了该算法的有效性和鲁棒性。
A Novel Deep Reinforcement Learning Method for Computation Offloading in Multi-User Mobile Edge Computing with Decentralization
School of Information and Communications Technology, Hanoi University of Science and Technology, Vietnam(河内科学技术大学信息与通信学院);Faculty of Electrical and Electronic Engineering, Hanoi Open University, Vietnam(河内开放大学电子与电气工程学院);Posts and Telecommunications Institute of Technology Hanoi, Vietnam(河内邮电技术研究所);Faculty of Informatics, University of Debrecen, Hungary(德布勒恩大学信息学院)