一种高性能非相干片上通信的开源平台
An Open-Source Platform for High-Performance Non-Coherent On-Chip Communication
摘要:
片上通信基础设施是现代片上系统(SoC)的核心组件,并且随着核的数量、组件的异构性以及片上和片外带宽的持续增长,其继续获得重要性。对片上网络的数十年研究使高速缓存一致性共享内存多处理器成为可能。然而,满足异构多核和加速器丰富的SoC的需求的通信结构是一个不太成熟的研究领域,这些SoC不是或只是部分一致的。在这项工作中,我们提出了一个模块化的,拓扑不可知的,高性能的片上通信平台。该平台包括用于构建和链接具有可定制带宽和并发属性的子网的组件,并遵循最先进的行业标准协议。我们讨论了我们的模块的微架构权衡和时序/面积特性,并表明它们可以组成以构建高带宽(例如,2.5 GHz和1024位数据宽度)端到端片上通信结构(不仅是网络交换机,而且还有DMA引擎和内存控制器),具有高度并发性。我们设计并实现了一个最先进的ML训练加速器,其中我们的通信结构可扩展到一个芯片上的1024个核心,提供32 TB/s的横截面带宽,任何两个核心之间的往返延迟仅为24 ns。
英文摘要:
On-chip communication infrastructure is a central component of modern systems-on-chip (SoCs), and it continues to gain importance as the number of cores, the heterogeneity of components, and the on-chip and off-chip bandwidth continue to grow. Decades of research on on-chip networks enabled cache-coherent shared-memory multiprocessors. However, communication fabrics that meet the needs of heterogeneous many-cores and accelerator-rich SoCs, which are not, or only partially, coherent, are a much less mature research area. In this work, we present a modular, topology-agnostic, high-performance on-chip communication platform. The platform includes components to build and link subnetworks with customizable bandwidth and concurrency properties and adheres to a state-of-the-art, industry-standard protocol. We discuss microarchitectural trade-offs and timing/area characteristics of our modules and show that they can be composed to build high-bandwidth (e.g., 2.5 GHz and 1024 bit data width) end-to-end on-chip communication fabrics (not only network switches but also DMA engines and memory controllers) with high degrees of concurrency. We design and implement a state-of-the-art ML training accelerator, where our communication fabric scales to 1024 cores on a die, providing 32 TB/s cross-sectional bandwidth at only 24 ns round-trip latency between any two cores.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。