DeepProf:通过挖掘GPU执行模式进行深度学习应用的性能分析
DeepProf: Performance Analysis for Deep Learning Applications via Mining GPU Execution Patterns
摘要:
深度学习应用是计算密集型的,并且通常采用GPU作为底层计算设备。深度学习框架提供了强大的编程接口,但源代码和实际GPU操作之间的差距使分析深度学习应用的性能变得困难。本文通过分析GPU轨迹的特点和深度学习的应用,采用后缀树结构来提取GPU轨迹中的重复模式。性能分析图可以从预处理的GPU轨迹生成。我们进一步介绍了\texttt{DeepProf},一种自动处理GPU轨迹并为深度学习应用生成性能分析报告的新工具。实证研究验证了\texttt{DeepProf}在性能分析和诊断中的有效性。我们还发现了Tensorflow的一些有趣属性,这些属性可用于指导深度学习系统设置。
英文摘要:
Deep learning applications are computation-intensive and often employ GPU as the underlying computing devices. Deep learning frameworks provide powerful programming interfaces, but the gap between source codes and practical GPU operations make it difficult to analyze the performance of deep learning applications. In this paper, through examing the features of GPU traces and deep learning applications, we use the suffix tree structure to extract the repeated patten in GPU traces. Performance analysis graphs can be generated from the preprocessed GPU traces. We further present \texttt{DeepProf}, a novel tool to automatically process GPU traces and generate performance analysis reports for deep learning applications. Empirical study verifies the effectiveness of \texttt{DeepProf} in performance analysis and diagnosis. We also find out some interesting properties of Tensorflow, which can be used to guide the deep learning system setup.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。