arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1806.00875cs.LGstat.ML
收藏

在机器学习应用中部署定制数据表示和近似计算

Deploying Customized Data Representation and Approximate Computing in Machine Learning Applications

University of Southern California(南加州大学)

Mahdi Nazemi, Massoud Pedram

摘要:

构建通用和定制硬件方面的重大进步是机器学习模型(如深度神经网络)多功能性和普及性的关键推动因素之一。为了维持机器学习模型的这种无处不在的部署并应对其计算和存储复杂性,已经采用了若干解决方案,例如使用定点表示和部署近似算术运算的模型参数的低精度表示。研究这些解决方案在不同应用中的潜力需要将它们集成到现有的机器学习框架中进行高级仿真,并在硬件中实现它们,以分析它们对功率/能耗,吞吐量和芯片面积的影响。Lop是一个用于设计空间探索的库,它弥合了机器学习和高效硬件实现之间的差距。它包括一个Python模块,可以与现有的一些机器学习框架集成,并实现各种可定制的数据表示,包括定点和浮点以及近似算术运算。此外,它还包括一个高度参数化的Scala模块,允许基于所述数据表示和算术运算合成硬件。Lop允许研究人员和设计人员使用Python中的各种数据表示和算术运算来快速比较他们的模型的质量,并通过在他们的目标平台上合成它们来对比可行表示的硬件成本(例如,FPGA或ASIC)。据我们所知,Lop是第一个允许使用定制数据表示和近似计算技术进行软件仿真和硬件实现的库。

英文摘要:

Major advancements in building general-purpose and customized hardware have been one of the key enablers of versatility and pervasiveness of machine learning models such as deep neural networks. To sustain this ubiquitous deployment of machine learning models and cope with their computational and storage complexity, several solutions such as low-precision representation of model parameters using fixed-point representation and deploying approximate arithmetic operations have been employed. Studying the potency of such solutions in different applications requires integrating them into existing machine learning frameworks for high-level simulations as well as implementing them in hardware to analyze their effects on power/energy dissipation, throughput, and chip area. Lop is a library for design space exploration that bridges the gap between machine learning and efficient hardware realization. It comprises a Python module, which can be integrated with some of the existing machine learning frameworks and implements various customizable data representations including fixed-point and floating-point as well as approximate arithmetic operations.Furthermore, it includes a highly-parameterized Scala module, which allows synthesizing hardware based on the said data representations and arithmetic operations. Lop allows researchers and designers to quickly compare quality of their models using various data representations and arithmetic operations in Python and contrast the hardware cost of viable representations by synthesizing them on their target platforms (e.g., FPGA or ASIC). To the best of our knowledge, Lop is the first library that allows both software simulation and hardware realization using customized data representations and approximate computing techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑