arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2007.10129eess.SPcs.LGstat.ML
收藏

空地一体化边缘计算系统中的信息新鲜度感知任务卸载

Information Freshness-Aware Task Offloading in Air-Ground Integrated Edge Computing Systems

VTT Technical Research Centre of Finland(芬兰VTT技术研究中心);University of Electro-Communications(电气通信大学);Shizuoka University(静冈大学);Zhejiang University(浙江大学);University of Oulu(奥卢大学);Catholic University of America(美国天主教大学);National Institute of Informatics(国立信息学研究所)

Xianfu Chen, Celimuge Wu, Tao Chen, Zhi Liu, Honggang Zhang, Mehdi Bennis, Hang Liu, Yusheng Ji

摘要:

研究了由基础设施提供商(InP)部署的空地一体化多访问边缘计算系统中的信息新鲜度感知任务卸载问题。第三方实时应用服务提供商基于长期业务协议利用来自InP的有限通信和计算资源向订阅的移动用户(MU)提供计算服务。由于动态特性,MU之间的相互作用建模的非合作的随机博弈,其中的控制策略是耦合的,每个MU的目标是自私地最大化自己的预期的长期回报。为了解决纳什均衡的解决方案,我们建议,每个MU的行为按照当地的系统状态和结构,基于此随机博弈转化为一个单代理马尔可夫决策过程。此外,我们推导出一种新的在线深度强化学习(RL)方案,该方案为每个MU采用两个单独的双深度Q网络来近似Q因子和决策后Q因子。使用所提出的深度RL方案,系统中的每个MU能够在没有动态的先验统计知识的情况下做出决策。数值实验研究了该方案在平衡信息年龄和能量消耗方面的潜力。

英文摘要:

This paper studies the problem of information freshness-aware task offloading in an air-ground integrated multi-access edge computing system, which is deployed by an infrastructure provider (InP). A third-party real-time application service provider provides computing services to the subscribed mobile users (MUs) with the limited communication and computation resources from the InP based on a long-term business agreement. Due to the dynamic characteristics, the interactions among the MUs are modelled by a non-cooperative stochastic game, in which the control policies are coupled and each MU aims to selfishly maximize its own expected long-term payoff. To address the Nash equilibrium solutions, we propose that each MU behaves in accordance with the local system states and conjectures, based on which the stochastic game is transformed into a single-agent Markov decision process. Moreover, we derive a novel online deep reinforcement learning (RL) scheme that adopts two separate double deep Q-networks for each MU to approximate the Q-factor and the post-decision Q-factor. Using the proposed deep RL scheme, each MU in the system is able to make decisions without a priori statistical knowledge of dynamics. Numerical experiments examine the potentials of the proposed scheme in balancing the age of information and the energy consumption.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑