arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1911.03364cs.AR
收藏

AMOEBA:一种粗粒度可重构的动态GPU伸缩结构

AMOEBA: A Coarse Grained Reconfigurable Architecture for Dynamic GPU Scaling

Xianwei Cheng, Hui Zhao, Mahmut Kandemir, Beilei Jiang, Gayatri Mehta

摘要:

不同的GPU应用程序表现出不同的可扩展性模式,包括片上网络(NoC)、合并、内存和控制发散以及L1缓存行为。GPU由若干流式多处理器(SM)组成,这些SM共同决定如何分区和访问共享资源。近年来,SM的扩展出现了不同的路径,朝着规模扩大(更少,更大的SM)和向外扩展(更多,更小的SM)。然而,无论是向上扩展还是向外扩展都不能满足在给定GPU系统上运行的所有应用程序的可扩展性要求,这不可避免地导致某些应用程序的性能下降和资源利用不足。在这项工作中,我们调查的主要设计参数,影响GPU的缩放。然后,我们提出了AMOEBA,通过可重构的SM内核的GPU扩展的解决方案。AMOEBA在运行时监控和预测应用程序的可伸缩性,并调整SM配置以满足程序需求。AMOEBA还支持通过独立融合或拆分动态创建异构SM。AMOEBA是一个基于微架构的解决方案,不需要额外的编程工作或自定义编译器支持。我们的实验评估与应用程序从各种基准套件表明,AMOEBA能够实现最大的性能增益4.3倍,并产生47%的平均性能提高时,考虑到所有的基准测试。

英文摘要:

Different GPU applications exhibit varying scalability patterns with network-on-chip (NoC), coalescing, memory and control divergence, and L1 cache behavior. A GPU consists of several StreamingMulti-processors (SMs) that collectively determine how shared resources are partitioned and accessed. Recent years have seen divergent paths in SM scaling towards scale-up (fewer, larger SMs) vs. scale-out (more, smaller SMs). However, neither scaling up nor scaling out can meet the scalability requirement of all applications running on a given GPU system, which inevitably results in performance degradation and resource under-utilization for some applications. In this work, we investigate major design parameters that influence GPU scaling. We then propose AMOEBA, a solution to GPU scaling through reconfigurable SM cores. AMOEBA monitors and predicts application scalability at run-time and adjusts the SM configuration to meet program requirements. AMOEBA also enables dynamic creation of heterogeneous SMs through independent fusing or splitting. AMOEBA is a microarchitecture-based solution and requires no additional programming effort or custom compiler support. Our experimental evaluations with application programs from various benchmark suites indicate that AMOEBA is able to achieve a maximum performance gain of 4.3x, and generates an average performance improvement of 47% when considering all benchmarks tested.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑