ArrayFlex:一种具有可配置透明流水线的脉动阵列架构
ArrayFlex: A Systolic Array Architecture with Configurable Transparent Pipelining
AI总结:
本文提出可配置透明流水线的脉动阵列ArrayFlex,可按CNN层在正常与浅流水线模式间切换,平均降低11%推理延迟、13%-23%功耗,并实现1.4至1.8倍能量延迟积效率。
摘要:
卷积神经网络(CNNs)是许多深度学习应用的最先进解决方案。为实现最大可扩展性,其计算应兼具高性能与高能效。在实践中,每个CNN层的卷积被映射为一个矩阵乘法,该矩阵乘法包含每层的所有输入特征和卷积核,并使用脉动阵列进行计算。在本工作中,我们专注于设计一种具有可配置流水线的脉动阵列,目标是为每个CNN层选择最优的流水线配置。所提出的脉动阵列名为ArrayFlex,可在正常模式或浅流水线模式下运行,从而在以周期计的执行时间与工作时钟频率之间取得平衡。通过为每个CNN层选择适当的流水线配置,与传统固定流水线脉动阵列相比,ArrayFlex将最先进CNNs的推理延迟平均降低11%。最重要的是,在相同应用中实现这一结果的同时功耗还降低13%-23%,从而提供1.4倍至1.8倍的综合能量延迟积效率。
英文摘要:
Convolutional Neural Networks (CNNs) are the state-of-the-art solution for many deep learning applications. For maximum scalability, their computation should combine high performance and energy efficiency. In practice, the convolutions of each CNN layer are mapped to a matrix multiplication that includes all input features and kernels of each layer and is computed using a systolic array. In this work, we focus on the design of a systolic array with configurable pipeline with the goal to select an optimal pipeline configuration for each CNN layer. The proposed systolic array, called ArrayFlex, can operate in normal, or in shallow pipeline mode, thus balancing the execution time in cycles and the operating clock frequency. By selecting the appropriate pipeline configuration per CNN layer, ArrayFlex reduces the inference latency of state-of-the-art CNNs by 11%, on average, as compared to a traditional fixed-pipeline systolic array. Most importantly, this result is achieved while using 13%-23% less power, for the same applications, thus offering a combined energy-delay-product efficiency between 1.4x and 1.8x.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。