AVEC:面向深度学习库的云边缘计算加速器虚拟化
AVEC: Accelerator Virtualization in Cloud-Edge Computing for Deep Learning Libraries
摘要:
边缘计算提供了一个独特的优势,即利用位于网络边缘的资源上的计算能力来运行相对较弱的用户设备的工作负载。这是通过将计算密集型工作负载(例如深度学习)从用户设备卸载到边缘来实现的。使用边缘减少了应用程序的整体通信延迟,因为工作负载可以在更靠近用户设备上生成数据的地方进行处理,而不是将它们发送到地理上遥远的云。专用硬件加速器,如云边缘网络中可用的图形处理单元(GPU),可以增强从设备卸载到边缘的计算密集型工作负载的性能。促进这一点所需的底层方法是GPU的虚拟化。因此,本文着手研究GPU加速器虚拟化在云边缘环境中提高深度学习工作负载性能的潜力。AVEC加速器虚拟化框架的建议,招致最小的开销,不需要源代码修改的工作负载。AVEC拦截对设备上GPU的本地调用,并将其无缝转发到边缘资源。AVEC的可行性在现实世界的应用程序上得到了证明,即使用Caffe深度学习库的OpenPose。据观察,在基于实验室的实验测试台上,AVEC提供了高达7.48倍的加速,尽管由于数据传输而产生的通信开销。
英文摘要:
Edge computing offers the distinct advantage of harnessing compute capabilities on resources located at the edge of the network to run workloads of relatively weak user devices. This is achieved by offloading computationally intensive workloads, such as deep learning from user devices to the edge. Using the edge reduces the overall communication latency of applications as workloads can be processed closer to where data is generated on user devices rather than sending them to geographically distant clouds. Specialised hardware accelerators, such as Graphics Processing Units (GPUs) available in the cloud-edge network can enhance the performance of computationally intensive workloads that are offloaded from devices on to the edge. The underlying approach required to facilitate this is virtualization of GPUs. This paper therefore sets out to investigate the potential of GPU accelerator virtualization to improve the performance of deep learning workloads in a cloud-edge environment. The AVEC accelerator virtualization framework is proposed that incurs minimum overheads and requires no source-code modification of the workload. AVEC intercepts local calls to a GPU on a device and forwards them to an edge resource seamlessly. The feasibility of AVEC is demonstrated on a real-world application, namely OpenPose using the Caffe deep learning library. It is observed that on a lab-based experimental test-bed AVEC delivers up to 7.48x speedup despite communication overheads incurred due to data transfers.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。