Hysia:在云中服务基于DNN的视频到零售应用
Hysia: Serving DNN-Based Video-to-Retail Applications in Cloud
摘要:
结合\underline{v}视频流和在线\underline{r}电子邮件(V2 R)最近已经成为一种增长的趋势。在本文中,我们为多媒体领域的从业者和研究人员提供了一个名为Hysia的基于云的平台,用于轻松开发和部署V2 R应用程序。该系统包括:1)后端基础设施,提供优化的V2 R相关服务,包括数据引擎、模型存储库、模型服务和内容匹配;以及2)应用层,实现快速V2 R应用原型。Hysia通过以下方式满足大规模多媒体的行业和学术需求:1)无缝集成最先进的库,包括NVIDIA视频SDK、Facebook faiss和gRPC; 2)有效利用GPU计算; 3)允许开发人员轻松绑定新模型,以满足快速变化的深度学习(DL)技术。在此基础上,我们实现了一个协调器,以进一步优化DL模型服务性能。Hysia已在GitHub上作为开源项目发布,并引起了相当大的关注。我们已经将Hysia作为官方镜像发布到DockerHub,以便在当前云环境中进行无缝集成和部署。
英文摘要:
Combining \underline{v}ideo streaming and online \underline{r}etailing (V2R) has been a growing trend recently. In this paper, we provide practitioners and researchers in multimedia with a cloud-based platform named Hysia for easy development and deployment of V2R applications. The system consists of: 1) a back-end infrastructure providing optimized V2R related services including data engine, model repository, model serving and content matching; and 2) an application layer which enables rapid V2R application prototyping. Hysia addresses industry and academic needs in large-scale multimedia by: 1) seamlessly integrating state-of-the-art libraries including NVIDIA video SDK, Facebook faiss, and gRPC; 2) efficiently utilizing GPU computation; and 3) allowing developers to bind new models easily to meet the rapidly changing deep learning (DL) techniques. On top of that, we implement an orchestrator for further optimizing DL model serving performance. Hysia has been released as an open source project on GitHub, and attracted considerable attention. We have published Hysia to DockerHub as an official image for seamless integration and deployment in current cloud environments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。