arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.05297cs.DCcs.LGcs.PF
收藏

使用硬件性能计数器加速GPU上的自动调整收敛

Using hardware performance counters to speed up autotuning convergence on GPUs

Institute of Computer Science, Masaryk University(马萨里克大学计算机科学研究所)

Jiří Filipovič, Jana Hozzová, Amin Nezarat, Jaroslav Oľha, Filip Petrovič

摘要:

如今,GPU加速器通常用于加速各种硬件上的通用计算任务。然而,由于GPU架构和处理数据的多样性,针对特定类型的硬件和特定数据特征的代码优化可能极具挑战性。与性能相关的源代码参数的自动调优允许应用程序的自动优化,并保持其性能的可移植性。虽然自动调优过程通常会导致代码加速,但如果(i)调优空间很大并且充满了性能不佳的实现,或者(ii)由于处理的数据发生变化或迁移到不同的硬件,因此必须频繁重复自动调优过程,则搜索调优空间可能会带来不可接受的开销。在本文中,我们介绍了一种新的方法来搜索调谐空间。该方法利用在经验调优期间收集硬件性能计数器(也称为分析计数器)的优势。这些计数器用于将搜索过程导航到更快的实现。该方法需要在任何GPU上对调谐空间进行采样。它构建了一个特定于问题的模型,可以在各种甚至以前看不见的输入或GPU上进行自动调整时使用。使用一组五个基准测试,我们实验证明,我们的方法可以加快自动调整时,应用程序需要被移植到不同的硬件,或者当它需要处理具有不同特性的数据。我们还比较了我们的方法的最先进的,并表明,我们的方法是优越的搜索步骤的数量方面,通常优于其他搜索的收敛时间。

英文摘要:

Nowadays, GPU accelerators are commonly used to speed up general-purpose computing tasks on a variety of hardware. However, due to the diversity of GPU architectures and processed data, optimization of codes for a particular type of hardware and specific data characteristics can be extremely challenging. The autotuning of performance-relevant source-code parameters allows for automatic optimization of applications and keeps their performance portable. Although the autotuning process typically results in code speed-up, searching the tuning space can bring unacceptable overhead if (i) the tuning space is vast and full of poorly-performing implementations, or (ii) the autotuning process has to be repeated frequently because of changes in processed data or migration to different hardware. In this paper, we introduce a novel method for searching tuning spaces. The method takes advantage of collecting hardware performance counters (also known as profiling counters) during empirical tuning. Those counters are used to navigate the searching process towards faster implementations. The method requires the tuning space to be sampled on any GPU. It builds a problem-specific model, which can be used during autotuning on various, even previously unseen inputs or GPUs. Using a set of five benchmarks, we experimentally demonstrate that our method can speed up autotuning when an application needs to be ported to different hardware or when it needs to process data with different characteristics. We also compared our method to state of the art and show that our method is superior in terms of the number of searching steps and typically outperforms other searches in terms of convergence time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑