多线程可重构粗粒度阵列中的线程间通信
Inter-thread Communication in Multithreaded, Reconfigurable Coarse-grain Arrays
摘要:
传统的冯·诺依曼GPGPU只允许线程通过内存进行组对组的通信。在此模型中,一组生产者线程将中间值写入内存,这些中间值在屏障同步后由一组消费者线程读取。为了减轻这种通信方法所带来的内存带宽,GPGPU提供了一种小型暂存器,可以防止中间值使DRAM带宽过载。在本文中,我们介绍了直接线程间通信的大规模多线程CGRA,中间值直接通过计算结构上的点对点的基础上进行通信。此方法避免了将值写入内存的需要,消除了对专用暂存器的需要,并避免了工作组全局屏障。本文介绍了编程模型(CUDA)和执行模型的扩展,以及硬件原语,促进通信。我们对在新系统上运行的Rodinia基准测试的模拟表明,与同等的Nvidia GPGPU相比,直接线程间通信提供了4.5倍的平均加速比(最大13.5倍),并将系统功耗平均降低了7倍(最大33倍)。
英文摘要:
Traditional von Neumann GPGPUs only allow threads to communicate through memory on a group-to-group basis. In this model, a group of producer threads writes intermediate values to memory, which are read by a group of consumer threads after a barrier synchronization. To alleviate the memory bandwidth imposed by this method of communication, GPGPUs provide a small scratchpad memory that prevents intermediate values from overloading DRAM bandwidth. In this paper we introduce direct inter-thread communications for massively multithreaded CGRAs, where intermediate values are communicated directly through the compute fabric on a point-to-point basis. This method avoids the need to write values to memory, eliminates the need for a dedicated scratchpad, and avoids workgroup-global barriers. The paper introduces the programming model (CUDA) and execution model extensions, as well as the hardware primitives that facilitate the communication. Our simulations of Rodinia benchmarks running on the new system show that direct inter-thread communication provides an average speedup of 4.5x (13.5x max) and reduces system power by an average of 7x (33x max), when compared to an equivalent Nvidia GPGPU.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。