arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1901.04985cs.DCcs.AI
收藏

NNStreamer:神经网络的流处理范例,实现设备上AI应用程序的高效开发和执行

NNStreamer: Stream Processing Paradigm for Neural Networks, Toward Efficient Development and Execution of On-Device AI Applications

Samsung Research, Samsung Electronics(三星电子三星研究院);Biotech Academy, Samsung BioLogics(三星生物制剂生物技术学院)

MyungJoo Ham, Ji Joong Moon, Geunsik Lim, Wook Song, Jaeyun Jung, Hyoungjoo Ahn, Sangjung Woo, Youngchul Cho, Jinhyuck Park, Sewon Oh, Hong-Seok Kim

摘要:

我们提出了nnstreamer,一个软件系统,处理神经网络作为过滤器的流管道,应用流处理范式的神经网络应用。随着深度神经网络应用的广泛传播,一个新的趋势是设备上的AI;即,直接在移动设备或边缘/物联网设备上处理神经网络,而不是云服务器。新出现的隐私问题、数据传输成本和运营成本意味着需要设备上的人工智能,特别是当部署了大量具有实时数据处理功能的设备时。Nnstreamer有效地处理设备上具有复杂数据流管道的神经网络,以最小的努力显着提高整体性能。此外,nnstreamer简化了神经网络流水线的实现,并允许重用现成的多媒体流过滤器直接,从而大大降低了开发成本。Nnstreamer已经部署在即将发布的产品中,它是一款开源软件,适用于各种硬件架构和软件平台。

英文摘要:

We propose nnstreamer, a software system that handles neural networks as filters of stream pipelines, applying the stream processing paradigm to neural network applications. A new trend with the wide-spread of deep neural network applications is on-device AI; i.e., processing neural networks directly on mobile devices or edge/IoT devices instead of cloud servers. Emerging privacy issues, data transmission costs, and operational costs signifies the need for on-device AI especially when a huge number of devices with real-time data processing are deployed. Nnstreamer efficiently handles neural networks with complex data stream pipelines on devices, improving the overall performance significantly with minimal efforts. Besides, nnstreamer simplifies the neural network pipeline implementations and allows reusing off-shelf multimedia stream filters directly; thus it reduces the developmental costs significantly. Nnstreamer is already being deployed with a product releasing soon and is open source software applicable to a wide range of hardware architectures and software platforms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑