使用自适应CUDA流的快速直方图
Fast Histograms using Adaptive CUDA Streams
摘要:
直方图在医学成像、网络入侵检测、数据包分析等基于流的高吞吐量应用中有着广泛的应用。然而,在将此类软件栈移植到GPU时,直方图的计算是一个典型的瓶颈,主要是由于原子操作对内核速度产生很大影响。在这项工作中,我们提出了一个基于流的模型,在CUDA中实现,使用一个新的自适应内核,可以根据延迟隐藏的CPU计算进行优化。我们还探讨了使用新内核与股票NVIDIA SDK内核的权衡,并讨论了智能内核切换方法的流的基础上退化标准,自适应地计算从输入流。
英文摘要:
Histograms are widely used in medical imaging, network intrusion detection, packet analysis and other stream-based high throughput applications. However, while porting such software stacks to the GPU, the computation of the histogram is a typical bottleneck primarily due to the large impact on kernel speed by atomic operations. In this work, we propose a stream-based model implemented in CUDA, using a new adaptive kernel that can be optimized based on latency hidden CPU compute. We also explore the tradeoffs of using the new kernel vis-à-vis the stock NVIDIA SDK kernel, and discuss an intelligent kernel switching method for the stream based on a degeneracy criterion that is adaptively computed from the input stream.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。