使用硬件性能计数器搜索CUDA代码自动调优空间:来自在各种GPU架构上运行的基准测试的数据
Searching CUDA code autotuning spaces with hardware performance counters: data from benchmarks running on various GPU architectures
摘要:
我们已经在CUDA中开发了几个自动调优基准,这些基准考虑了与性能相关的源代码参数,并在各种GPU架构上达到接近峰值的性能。我们在[1]中提出的调谐空间的新搜索方法的开发和评估过程中使用了它们。使用我们的框架Kernel Tuning Toolkit(在Github上免费提供),我们在几个GPU上测量了五个基准测试的完整调优空间的计算时间和硬件性能计数器。本文提供的这些数据对于GPU代码优化空间搜索算法的研究,以及应用代码优化、硬件性能计数器和GPU内核性能之间关系的研究都有一定的参考价值。此外,我们还详细描述了我们用于对我们的系统进行稳健评估并与其他系统进行比较的脚本。特别地,模拟调谐的脚本,即,通过从我们的测量数据中快速读取计算时间来代替耗时的编译和执行调优内核,使得可以通过大量实验来检查调优搜索的收敛性。这些脚本与我们的其他代码一起免费提供,使实验搜索算法更容易,并以健壮的方式进行比较。在我们的研究过程中,我们生成了模型,用于从基准测试的调优参数值预测性能计数器的值。在这里,我们提供了模型本身,并描述了我们为训练它们而实现的脚本。这些数据可能有利于那些想要复制或建立在我们研究基础上的研究人员。
英文摘要:
We have developed several autotuning benchmarks in CUDA that take into account performance-relevant source-code parameters and reach near peak-performance on various GPU architectures. We have used them during the development and evaluation of a novel search method for tuning space proposed in [1]. With our framework Kernel Tuning Toolkit, freely available at Github, we measured computation times and hardware performance counters on several GPUs for the complete tuning spaces of five benchmarks. These data, which we provide here, might benefit research of search algorithms for the tuning spaces of GPU codes or research of relation between applied code optimization, hardware performance counters, and GPU kernels' performance. Moreover, we describe the scripts we used for robust evaluation of our searcher and comparison to others in detail. In particular, the script that simulates the tuning, i.e., replaces time-demanding compiling and executing the tuned kernels with a quick reading of the computation time from our measured data, makes it possible to inspect the convergence of tuning search over a large number of experiments. These scripts, freely available with our other codes, make it easier to experiment with search algorithms and compare them in a robust way. During our research, we generated models for predicting values of performance counters from values of tuning parameters of our benchmarks. Here, we provide the models themselves and describe the scripts we implemented for their training. These data might benefit researchers who want to reproduce or build on our research.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。