arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.13041cs.LGcs.AI
收藏

Auto-Split:一种通用的边缘云协同框架AI

Auto-Split: A General Framework of Collaborative Edge-Cloud AI

Huawei Technologies Canada Co. Ltd.(华为技术加拿大有限公司);School of Computing Science Simon Fraser University(西蒙弗雷泽大学计算科学学院);Huawei Technologies(华为技术有限公司)

Amin Banitalebi-Dehkordi, Naveen Vedula, Jian Pei, Fei Xia, Lanjun Wang, Yong Zhang

摘要:

在许多工业规模的应用中,大型且消耗资源的机器学习模型驻留在功能强大的云服务器中。同时,大量的输入数据被收集在云的边缘。推理结果也会传达给用户或传递给边缘的下游任务。边缘通常由大量低功耗设备组成。设计行业产品以支持复杂的深度模型部署并以有效的方式进行模型推理,从而保持高模型准确性和低端到端延迟,这是一个巨大的挑战。本文介绍了华为云的边缘云协同原型Auto-Split背后的技术和工程实践。这项专利技术已经在选定的应用程序上得到验证,正在进行更广泛的系统化边缘云应用程序集成,并作为端到端云边缘协作智能部署的自动化管道服务供公众使用。据我们所知,没有现有的工业产品提供深度神经网络(DNN)分裂的能力。

英文摘要:

In many industry scale applications, large and resource consuming machine learning models reside in powerful cloud servers. At the same time, large amounts of input data are collected at the edge of cloud. The inference results are also communicated to users or passed to downstream tasks at the edge. The edge often consists of a large number of low-power devices. It is a big challenge to design industry products to support sophisticated deep model deployment and conduct model inference in an efficient manner so that the model accuracy remains high and the end-to-end latency is kept low. This paper describes the techniques and engineering practice behind Auto-Split, an edge-cloud collaborative prototype of Huawei Cloud. This patented technology is already validated on selected applications, is on its way for broader systematic edge-cloud application integration, and is being made available for public use as an automated pipeline service for end-to-end cloud-edge collaborative intelligence deployment. To the best of our knowledge, there is no existing industry product that provides the capability of Deep Neural Network (DNN) splitting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑