arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.14008cs.ARcs.LG
收藏

深度神经网络处理器阵列设计的难点

On the Difficulty of Designing Processor Arrays for Deep Neural Networks

Heidelberg University(海德堡大学)

Kevin Stehle, Günther Schindler, Holger Fröning

摘要:

SYSTEMS阵列是一种有前途的计算概念,它特别符合CMOS技术趋势和人工神经网络处理中发现的线性代数运算。这种深度学习方法最近在广泛的应用中取得了成功,产生了各种模型,尽管这些模型在概念上类似于基于卷积和全连接层,但由于设计空间很大,因此详细显示了操作的巨大多样性:操作数的尺寸变化很大,因为它取决于设计原则,如感受野大小,特征数量,步幅,特征的扩展和分组。最后,最近的网络通过各种连接扩展了以前简单的前馈模型,例如ResNet或DenseNet。选择最佳脉动阵列配置的问题不能通过分析来解决,因此需要方法和工具来促进关于总周期、利用率和数据移动量方面的最优性的快速和准确的推理。在这项工作中,我们介绍Camuy,一个轻量级模型的重量固定脉动阵列的线性代数运算,允许快速探索不同的配置,如脉动阵列的尺寸和输入/输出位宽。Camuy帮助加速器设计人员为特定的网络架构找到最佳配置,或者在各种网络架构中实现强大的性能。它通过自定义运算符提供了与现有机器学习工具栈(例如TensorFlow)的简单集成。我们对流行的DNN模型进行了分析,以说明它如何估计所需的周期、数据移动成本以及脉动阵列利用率,并展示了网络架构设计的进展如何影响基于脉动阵列的加速器的推理效率。

英文摘要:

Systolic arrays are a promising computing concept which is in particular inline with CMOS technology trends and linear algebra operations found in the processing of artificial neural networks. The recent success of such deep learning methods in a wide set of applications has led to a variety of models, which albeit conceptual similar as based on convolutions and fully-connected layers, in detail show a huge diversity in operations due to a large design space: An operand's dimension varies substantially since it depends on design principles such as receptive field size, number of features, striding, dilating and grouping of features. Last, recent networks extent previously plain feedforward models by various connectivity, such as in ResNet or DenseNet. The problem of choosing an optimal systolic array configuration cannot be solved analytically, thus instead methods and tools are required that facilitate a fast and accurate reasoning about optimality in terms of total cycles, utilization, and amount of data movements. In this work we introduce Camuy, a lightweight model of a weight-stationary systolic array for linear algebra operations that allows quick explorations of different configurations, such as systolic array dimensions and input/output bitwidths. Camuy aids accelerator designers in either finding optimal configurations for a particular network architecture or for robust performance across a variety of network architectures. It offers simple integration into existing machine learning tool stacks (e.g TensorFlow) through custom operators. We present an analysis of popular DNN models to illustrate how it can estimate required cycles, data movement costs, as well as systolic array utilization, and show how the progress in network architecture design impacts the efficiency of inference on accelerators based on systolic arrays.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑