arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.03012cs.DCcs.AI
收藏

一个无服务器的云雾平台,用于基于DNN的视频分析和增量学习

A Serverless Cloud-Fog Platform for DNN-Based Video Analytics with Incremental Learning

Nanyang Technological University(南洋理工大学);Wuhan University(武汉大学);Nanjing University of Science and Technology(南京理工大学);K&C Technologies Solutions(K&C技术解决方案公司)

Huaizheng Zhang, Meng Shen, Yizheng Huang, Yonggang Wen, Yong Luo, Guanyu Gao, Kyle Guan

摘要:

基于DNN的视频分析已经授权了许多新的应用(例如,自动零售)。同时,雾设备的激增为开发人员提供了更多的设计选择,以提高性能并节省成本。据我们所知,本文提出了第一个无服务器系统,该系统充分利用了客户端-雾-云协同作用,以更好地服务于基于DNN的视频分析。具体而言,该系统旨在实现两个目标:1)通过明智地管理部署在客户端、雾和云环境中的计算和带宽资源,在较低带宽使用和较短往返时间(RTT)的约束下提供最佳分析结果。2)将开发人员从繁琐的管理和操作任务中解放出来,包括DNN部署,云和雾的资源管理。为此,我们实现了一个整体的云雾系统,称为VPaaS(视频平台即服务)。VPaaS采用无服务器计算,使开发人员能够通过简单地编程一组功能(例如,模型推理),然后通过精心设计的模块协调这些模块来处理视频。为了节省带宽并减少RTT,VPaaS提供了一种新的视频流协议,该协议仅将低质量视频发送到云。部署在云端的最先进(SOTA)DNN可以识别需要在雾端进一步处理的视频帧区域。在雾端,这些区域中的错误识别标签可以使用轻量级DNN模型进行校正。为了解决数据漂移问题,我们将有限的人类反馈纳入系统中以验证结果,并采用增量学习来不断改进我们的系统。评估表明,VPaaS优于几种SOTA系统:它保持了高准确性,同时将带宽使用量减少了21%,RTT减少了62.5%,云货币成本减少了50%。

英文摘要:

DNN-based video analytics have empowered many new applications (e.g., automated retail). Meanwhile, the proliferation of fog devices provides developers with more design options to improve performance and save cost. To the best of our knowledge, this paper presents the first serverless system that takes full advantage of the client-fog-cloud synergy to better serve the DNN-based video analytics. Specifically, the system aims to achieve two goals: 1) Provide the optimal analytics results under the constraints of lower bandwidth usage and shorter round-trip time (RTT) by judiciously managing the computational and bandwidth resources deployed in the client, fog, and cloud environment. 2) Free developers from tedious administration and operation tasks, including DNN deployment, cloud and fog's resource management. To this end, we implement a holistic cloud-fog system referred to as VPaaS (Video-Platform-as-a-Service). VPaaS adopts serverless computing to enable developers to build a video analytics pipeline by simply programming a set of functions (e.g., model inference), which are then orchestrated to process videos through carefully designed modules. To save bandwidth and reduce RTT, VPaaS provides a new video streaming protocol that only sends low-quality video to the cloud. The state-of-the-art (SOTA) DNNs deployed at the cloud can identify regions of video frames that need further processing at the fog ends. At the fog ends, misidentified labels in these regions can be corrected using a light-weight DNN model. To address the data drift issues, we incorporate limited human feedback into the system to verify the results and adopt incremental learning to improve our system continuously. The evaluation demonstrates that VPaaS is superior to several SOTA systems: it maintains high accuracy while reducing bandwidth usage by up to 21%, RTT by up to 62.5%, and cloud monetary cost by up to 50%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑