TritonForge:基于剖析的自动Triton内核优化框架
TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization
AI总结:
TritonForge通过结合剖析反馈实现自动化的Triton内核优化,显著提升性能并推动GPU性能优化研究的发展。
摘要:
高性能GPU内核优化仍然是现代机器学习工作负载中关键但劳动密集型的任务。尽管Triton是一种专为GPU编程设计的领域特定语言,使开发人员能够用简洁的代码编写高效的内核,但要达到专家级别的性能仍需要深入理解GPU架构和低级性能权衡。我们提出了TritonForge,一种基于剖析的自动Triton内核优化框架。TritonForge集成了内核分析、运行时剖析和迭代代码转换,以简化优化过程。通过结合剖析结果的反馈,系统识别性能瓶颈,提出针对性的代码修改,并自动评估其影响。在多样化的内核类型中,TritonForge在基准实现上实现了高达5倍的性能提升,并且在平均1.76倍的案例中成功,为未来自动化GPU性能优化研究奠定了基础。
英文摘要:
High-performance GPU kernel optimization remains a critical yet labor-intensive task in modern machine learning workloads. Although Triton, a domain-specific language for GPU programming, enables developers to write efficient kernels with concise code, achieving expert-level performance still requires deep understanding of GPU architectures and low-level performance trade-offs. We present TritonForge, a profiling-guided framework for automated Triton kernel optimization. TritonForge integrates kernel analysis, runtime profiling, and iterative code transformation to streamline the optimization process. By incorporating feedback from profiling results, the system identifies performance bottlenecks, proposes targeted code modifications, and evaluates their impact automatically. Across diverse kernel types, TritonForge achieves up to 5x performance improvement over baseline implementations and on average 1.76x of the cases are successful, providing a foundation for future research in automated GPU performance optimization.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。