NEPTUNE:边缘无服务器功能的网络和GPU感知管理
NEPTUNE: Network- and GPU-aware Management of Serverless Functions at the Edge
摘要:
如今,各种应用程序都受到云基础设施无法满足的低延迟要求的限制。多访问边缘计算(MEC)已经被提出作为用于执行更靠近用户的应用并减少延迟的参考架构,但是新的挑战出现了:边缘节点是资源受限的,由于用户是游牧的,工作负载可能会显著变化,并且任务复杂性正在增加(例如,机器学习推理)。为了克服这些问题,本文提出了NEPTUNE,一个基于服务器的框架,用于管理复杂的MEC解决方案。NEPTUNE i)根据用户位置将功能放置在边缘节点上,ii)避免单个节点的饱和,iii)在可用时利用GPU,以及iv)动态分配资源(CPU核心)以满足可预见的执行时间。一个原型,建立在K3S的顶部,被用来评估NEPTUNE的一组实验,证明了显着减少的响应时间,网络开销和资源消耗相比,三个国家的最先进的方法。
英文摘要:
Nowadays a wide range of applications is constrained by low-latency requirements that cloud infrastructures cannot meet. Multi-access Edge Computing (MEC) has been proposed as the reference architecture for executing applications closer to users and reduce latency, but new challenges arise: edge nodes are resource-constrained, the workload can vary significantly since users are nomadic, and task complexity is increasing (e.g., machine learning inference). To overcome these problems, the paper presents NEPTUNE, a serverless-based framework for managing complex MEC solutions. NEPTUNE i) places functions on edge nodes according to user locations, ii) avoids the saturation of single nodes, iii) exploits GPUs when available, and iv) allocates resources (CPU cores) dynamically to meet foreseen execution times. A prototype, built on top of K3S, was used to evaluate NEPTUNE on a set of experiments that demonstrate a significant reduction in terms of response time, network overhead, and resource consumption compared to three state-of-the-art approaches.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。