arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1704.03751cs.LG
收藏

利用ARM计算库实现嵌入式推理引擎:案例研究

Enabling Embedded Inference Engine with ARM Compute Library: A Case Study

Dawei Sun, Shaoshan Liu, Jean-Luc Gaudiot

摘要:

当您需要在低成本嵌入式SoC上启用深度学习时,是移植现有的深度学习框架更好,还是应该从头开始构建一个?在本文中,我们分享了我们的实际经验,建立一个嵌入式推理机使用ARM计算库(ACL)。结果表明,与传统的智慧,简单的模型,它需要更少的开发时间从头开始构建一个推理引擎相比,移植现有的框架。此外,通过利用ACL,我们成功构建了一个推理引擎,其性能比TensorFlow高出25%。我们的结论是,在嵌入式设备上,我们很可能会使用非常简单的深度学习模型进行推理,并且使用开发良好的构建块(如ACL),从头开始构建引擎可能在性能和开发时间方面都更好。

英文摘要:

When you need to enable deep learning on low-cost embedded SoCs, is it better to port an existing deep learning framework or should you build one from scratch? In this paper, we share our practical experiences of building an embedded inference engine using ARM Compute Library (ACL). The results show that, contradictory to conventional wisdoms, for simple models, it takes much less development time to build an inference engine from scratch compared to porting existing frameworks. In addition, by utilizing ACL, we managed to build an inference engine that outperforms TensorFlow by 25%. Our conclusion is that, on embedded devices, we most likely will use very simple deep learning models for inference, and with well-developed building blocks such as ACL, it may be better in both performance and development time to build the engine from scratch.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑