arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.00207cs.AR
收藏

CIS:面向数据流应用的可组合指令集

CIS: Composable Instruction Set for Data Streaming Applications

Yu Yang, Jordi Altayó González, Paul Delestrac, Ahmed Hemani

AI总结:

针对传统指令集架构缺乏可组合性导致难以扩展且控制开销大的问题,提出兼具空间与时间可组合性的CIS架构,高效实现多级循环并支持异构扩展,在数据流应用中显著提升性能并实现近乎最优的PE利用率。

摘要:

包括单指令多数据(SIMD)架构和粗粒度可重构架构(CGRAs)在内的硬件加速器效率的提升,正在推动人工智能与机器学习(AI/ML)应用的重大进展。这些应用通常涉及由许多本质上适合并行化的向量计算组成的数据流操作。然而,尽管硬件加速器设计取得了相当大的进展,但其潜力仍受到传统指令集架构(ISAs)的制约。主要为微处理器和加速器设计的传统ISAs强调计算,而往往忽视了指令的可组合性和指令间的协作。这一局限性导致ISAs僵化、难以扩展,并在其硬件实现中存在较大的控制开销。为了解决这一问题,我们提出了一种新颖的可组合指令集(CIS)架构,该架构在设计上兼具空间和时间可组合性,使其非常适用于数据流应用。所提出的CIS利用一个小型指令集,却高效地实现了加速数据流工作负载所必需的复杂、多级循环结构。此外,CIS采用以资源为中心的方法,通过集成新的硬件资源促进了直接的扩展,从而能够创建定制的异构计算平台。我们比较所提出的CIS与其他最先进ISAs性能的结果表明,基于CIS的架构显著优于现有解决方案,实现了近乎最优的处理单元(PE)利用率。

英文摘要:

The enhanced efficiency of hardware accelerators, including Single Instruction Multiple Data (SIMD) architectures and Coarse-Grained Reconfigurable Architectures (CGRAs), is driving significant advancements in Artificial Intelligence and Machine Learning (AI/ML) applications. These applications frequently involve data streaming operations comprised of numerous vector calculations inherently amenable to parallelization. However, despite considerable progress in hardware accelerator design, their potential remains constrained by conventional instruction set architectures (ISAs). Traditional ISAs, primarily designed for microprocessors and accelerators, emphasize computation while often neglecting instruction composability and inter-instruction cooperation. This limitation results in rigid ISAs that are difficult to extend and suffer from large control overhead in their hardware implementations. To address this, we present a novel composable instruction set (CIS) architecture, designed with both spatial and temporal composability, making it well-suited for data streaming applications. The proposed CIS utilizes a small instruction set, yet efficiently implements complex, multi-level loop structures essential for accelerating data streaming workloads. Furthermore, CIS adopts a resource-centric approach, facilitating straightforward extension through the integration of new hardware resources, enabling the creation of custom, heterogeneous computing platforms. Our results comparing performance between the proposed CIS and other state-of-the-art ISAs demonstrate that a CIS-based architecture significantly outperforms existing solutions, achieving near-optimal processing element (PE) utilization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑