在线学习，用于可再生能源驱动的移动边缘计算中的卸载和自动扩展
Online Learning for Offloading and Autoscaling in Renewable-Powered Mobile Edge Computing
摘要：
移动边缘计算（也称为雾计算）最近已经出现，以使得能够在移动网络的边缘处对延迟敏感的应用进行\emph{in-situ}处理。然而，提供支持移动边缘计算的电网供电成本高昂，甚至不可行（在某些崎岖或欠发达地区），因此在越来越多的情况下，要求现场可再生能源作为主要甚至唯一的电源。尽管如此，可再生能源的高不稳定性和不可预测性使得在可再生能源驱动的移动边缘计算系统中向用户提供高服务质量非常具有挑战性。在本文中，我们解决了将可再生能源纳入移动边缘计算的挑战，并提出了一种有效的基于强化学习的资源管理算法，该算法实时学习动态工作负载卸载（到集中式云）和边缘服务器配置的最佳策略，以最大限度地降低长期系统成本（包括服务延迟和运营成本）。我们的在线学习算法使用（离线）值迭代和（在线）强化学习的分解，从而实现了学习率和运行时性能的显着改善相比，标准的强化学习算法，如Q学习。
英文摘要：
Mobile edge computing (a.k.a. fog computing) has recently emerged to enable \emph{in-situ} processing of delay-sensitive applications at the edge of mobile networks. Providing grid power supply in support of mobile edge computing, however, is costly and even infeasible (in certain rugged or under-developed areas), thus mandating on-site renewable energy as a major or even sole power supply in increasingly many scenarios. Nonetheless, the high intermittency and unpredictability of renewable energy make it very challenging to deliver a high quality of service to users in renewable-powered mobile edge computing systems. In this paper, we address the challenge of incorporating renewables into mobile edge computing and propose an efficient reinforcement learning-based resource management algorithm, which learns on-the-fly the optimal policy of dynamic workload offloading (to centralized cloud) and edge server provisioning to minimize the long-term system cost (including both service delay and operational cost). Our online learning algorithm uses a decomposition of the (offline) value iteration and (online) reinforcement learning, thus achieving a significant improvement of learning rate and run-time performance when compared to standard reinforcement learning algorithms such as Q-learning.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
