arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.09232cs.DC
收藏

全GPU核算的时代错误

The anachronism of whole-GPU accounting

Igor Sfiligoi, David Schultz, Frank Würthwein, Benedikt Riedel, Dmitry Y. Mishin

摘要:

NVIDIA在提高其GPU的计算性能方面取得了稳步进展,多年来计算吞吐量得到了数量级的改善。由于多种型号的GPU在许多部署中共存,将所有GPU视为平等的传统核算方法不再反映计算输出。此外,对于需要大量基于CPU的计算来补充基于GPU的计算的应用程序,充分利用新的GPU变得越来越困难,需要在多个应用程序之间共享这些GPU,以最大限度地提高可实现的科学输出。这进一步降低了整个GPU核算的价值,特别是在基础设施级别进行共享时。因此,我们认为,面向吞吐量的基础设施的GPU核算应该以GPU核心小时数表示,就像通常对CPU所做的那样。虽然GPU核心计算吞吐量在GPU代之间确实会发生变化,但这种变化与我们期望在CPU核心中看到的变化类似。为了验证我们的立场,我们提出了一个广泛的运行时间测量的两个IceCube光子传播工作流程的14个GPU模型,使用本地和云资源。测量还概述了GPU共享在HTCondor和Kubernetes基础设施级别的影响。

英文摘要:

NVIDIA has been making steady progress in increasing the compute performance of its GPUs, resulting in order of magnitude compute throughput improvements over the years. With several models of GPUs coexisting in many deployments, the traditional accounting method of treating all GPUs as being equal is not reflecting compute output anymore. Moreover, for applications that require significant CPU-based compute to complement the GPU-based compute, it is becoming harder and harder to make full use of the newer GPUs, requiring sharing of those GPUs between multiple applications in order to maximize the achievable science output. This further reduces the value of whole-GPU accounting, especially when the sharing is done at the infrastructure level. We thus argue that GPU accounting for throughput-oriented infrastructures should be expressed in GPU core hours, much like it is normally done for the CPUs. While GPU core compute throughput does change between GPU generations, the variability is similar to what we expect to see among CPU cores. To validate our position, we present an extensive set of run time measurements of two IceCube photon propagation workflows on 14 GPU models, using both on-prem and Cloud resources. The measurements also outline the influence of GPU sharing at both HTCondor and Kubernetes infrastructure level.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑