arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2110.01103cs.AR
收藏

用于轻量级CNN的异构双核覆盖处理器

Heterogeneous Dual-Core Overlay Processor for Light-Weight CNNs

Tiandong Zhao, Yunxuan Yu, Kun Wang, Lei He

摘要:

轻量级卷积神经网络(CNN)具有小的复杂度,并且是低功耗、高吞吐量推理的良好候选者。这样的网络在计算通信(CTC)比率和层之间的计算模式方面是异构的,特别是对于不同的层类型。然而,现有的AI处理器要么使用同构处理元件(PE),导致低运行时PE效率,要么顺序地在异构PE上运行不同的层,引入资源冗余。本文提出了一种异构双核架构(dual-OPU),其中一个内核针对常规卷积层进行了优化,另一个内核针对深度卷积层进行了优化。PE与每个核心是同质的。为了充分利用双核的并行性,我们开发了一种调度算法,在双核上并行执行不同输入图像的层,并平衡并行工作负载。同时,我们自动调整核心的PE数量,并调整每个PE的输入大小,以最大限度地提高吞吐量。与单个网络相同面积的单核处理器相比,异构双OPU平均可将运行时PE效率和吞吐量分别提高11%和31%。对于多个网络的工作负载,与扩展到相同区域的最先进的处理器相比,双OPU的平均吞吐量提高了11%。据我们所知,这是第一次深入研究轻量级CNN的异构双核处理器。

英文摘要:

Light-weight convolutional neural networks (CNNs) have small complexity and are good candidates for low-power, high-throughput inference. Such networks are heterogeneous in terms of computation-to-communication (CTC) ratios and computation patterns between layers, especially for different layer types. Yet, existing AI processors either use homogeneous processing elements (PEs), resulting in low runtime PE efficiency, or run different layers on heterogeneous PEs in sequential, introducing resource redundancy. This paper proposes a heterogeneous dual-core architecture (dual-OPU), where one core is optimized for regular convolution layers and the other for depthwise convolution layers. PEs are homogeneous with each core. To make full use of dual-core parallelism, we develop a scheduling algorithm to concurrently execute layers for different input images on dual-core and balance parallel workload. Meanwhile, we automatically tune the PE number for a core and tune the input size for each PE to maximize throughput. Compared with a single-core processor with the same area for a single network, heterogeneous dual-OPU on average improves runtime PE efficiency and throughput by 11% and 31%, respectively. For a workload of multiple networks, dual-OPU improves average throughput by 11% compared with the state-of-the-art processors scaled to the same area. To the best of our knowledge, it is the first in-depth study on the heterogeneous dual-core processor for light-weight CNNs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑