机器学习加速器综述与基准测试
Survey and Benchmarking of Machine Learning Accelerators
摘要:
多核处理器和加速器的进步为机器学习技术在各种应用中的更大探索和应用打开了闸门。这些进步,以及包括摩尔定律在内的几个趋势的崩溃,促使处理器和加速器的爆炸式增长,这些处理器和加速器有望提供更强大的计算和机器学习能力。这些处理器和加速器有多种形式,从CPU和GPU到ASIC、FPGA和FPGA加速器。本文调查了这些处理器和加速器的现状,这些处理器和加速器已经公开宣布了性能和功耗数据。性能和功率值绘制在散点图上,并讨论和分析了该图上趋势的多个维度和观察结果。例如,在功耗、数值精度和推理与训练的关系图中有一些有趣的趋势。然后,我们选择和基准测试两个商用的低尺寸,重量和功率(SWaP)加速器,因为这些处理器是最有趣的嵌入式和移动机器学习推理应用程序,最适用于国防部和其他SWaP约束的用户。我们确定它们在真实图像和神经网络模型上的实际性能,将这些结果与报告的性能和功耗值进行比较,并与某些嵌入式应用中使用的英特尔CPU进行比较。
英文摘要:
Advances in multicore processors and accelerators have opened the flood gates to greater exploration and application of machine learning techniques to a variety of applications. These advances, along with breakdowns of several trends including Moore's Law, have prompted an explosion of processors and accelerators that promise even greater computational and machine learning capabilities. These processors and accelerators are coming in many forms, from CPUs and GPUs to ASICs, FPGAs, and dataflow accelerators. This paper surveys the current state of these processors and accelerators that have been publicly announced with performance and power consumption numbers. The performance and power values are plotted on a scatter graph and a number of dimensions and observations from the trends on this plot are discussed and analyzed. For instance, there are interesting trends in the plot regarding power consumption, numerical precision, and inference versus training. We then select and benchmark two commercially-available low size, weight, and power (SWaP) accelerators as these processors are the most interesting for embedded and mobile machine learning inference applications that are most applicable to the DoD and other SWaP constrained users. We determine how they actually perform with real-world images and neural network models, compare those results to the reported performance and power consumption values and evaluate them against an Intel CPU that is used in some embedded applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。