arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.06026cs.LGcs.AIcs.SE
收藏

通过流管道从设备上AI到设备间AI

Toward Among-Device AI from On-Device AI with Stream Pipelines

Samsung Research, Samsung Electronics(三星电子三星研究院)

MyungJoo Ham, Sangjung Woo, Jaeyun Jung, Wook Song, Gichan Jang, Yongjoo Ahn, Hyoung Joo Ahn

摘要:

现代消费者电子设备通常提供具有深度神经网络的智能服务。我们已经开始将智能服务的计算位置从云服务器(传统AI系统)迁移到相应的设备(设备上AI系统)。设备上的AI系统通常具有保护隐私、消除网络延迟和节省云成本的优势。随着计算能力相对较低的设备上AI系统的出现,不一致和变化的硬件资源和能力带来了困难。Authors的联盟已经开始将流管道框架NNStreamer应用于设备上的AI系统,节省了开发成本和硬件资源,并提高了性能。我们希望通过附属公司和第二/第三方的设备上AI服务产品来扩展设备和应用程序的类型。我们还希望每个AI服务都是原子的,可重新部署的,并在任意供应商的连接设备之间共享;我们现在又引入了另一个要求。“智能设备AI”的新要求包括AI管道之间的连接,以便它们可以在各种设备上共享计算资源和硬件功能,而不管供应商和制造商如何。我们提出了扩展的流管道框架,NNStreamer,在设备上的AI,使NNStreamer可以提供在设备上的AI能力。这项工作是Linux基金会(LF AI和数据)的开源项目,接受公众的贡献。

英文摘要:

Modern consumer electronic devices often provide intelligence services with deep neural networks. We have started migrating the computing locations of intelligence services from cloud servers (traditional AI systems) to the corresponding devices (on-device AI systems). On-device AI systems generally have the advantages of preserving privacy, removing network latency, and saving cloud costs. With the emergent of on-device AI systems having relatively low computing power, the inconsistent and varying hardware resources and capabilities pose difficulties. Authors' affiliation has started applying a stream pipeline framework, NNStreamer, for on-device AI systems, saving developmental costs and hardware resources and improving performance. We want to expand the types of devices and applications with on-device AI services products of both the affiliation and second/third parties. We also want to make each AI service atomic, re-deployable, and shared among connected devices of arbitrary vendors; we now have yet another requirement introduced as it always has been. The new requirement of "among-device AI" includes connectivity between AI pipelines so that they may share computing resources and hardware capabilities across a wide range of devices regardless of vendors and manufacturers. We propose extensions of the stream pipeline framework, NNStreamer, for on-device AI so that NNStreamer may provide among-device AI capability. This work is a Linux Foundation (LF AI and Data) open source project accepting contributions from the general public.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑