arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.11200cs.DCcs.LGcs.PL
收藏

GPU原生编译的理论基础:为快速代码迭代提供支持

Theoretical Foundations of GPU-Native Compilation for Rapid Code Iteration

Institute of Information Technology(信息技术学院);Kyrgyz State Technical University named after I. Razzakov(伊·拉扎科夫命名的吉尔吉斯斯坦技术大学)

Adilet Metinov, Gulida M. Kudakeeva, Gulnara D. Kabaeva

AI总结:

本文提出三种GPU原生编译方法,通过消除CPU-GPU数据传输,提升代码迭代效率,并探讨其对AI系统和模拟计算的影响。

摘要:

当前的AI代码生成系统在编译、执行和测试阶段由于CPU和GPU之间的数据传输导致显著的延迟瓶颈。我们为三种互补的GPU原生编译方法建立了理论基础,这些方法消除了这些传输:(1)为GPU执行适应的并行传统编译;(2)使用学习的序列到序列翻译与概率验证的神经编译;(3)结合两种策略的混合架构。我们推导了延迟和能量界限,证明了代码迭代周期可能的加速幅度为10-100倍。我们的分析显示,传统的GPU编译通过消除传输提供2-5倍的改进,神经编译通过大规模并行性实现10-100倍的加速,混合方法则提供了具有保证正确性的实际部署路径。我们正式化了概率验证框架,该框架使编译准确性可以与并行探索进行权衡,并讨论了对自我改进的AI系统和未来模拟计算子系统的意义。

英文摘要:

Current AI code generation systems suffer from significant latency bottlenecks due to CPU-GPU data transfers during compilation, execution, and testing phases. We establish theoretical foundations for three complementary approaches to GPU-native compilation that eliminate these transfers: (1) parallel traditional compilation adapted for GPU execution, (2) neural compilation using learned sequence-to-sequence translation with probabilistic verification, and (3) hybrid architectures combining both strategies. We derive latency and energy bounds demonstrating potential speedups of 10-100x for code iteration cycles. Our analysis shows that traditional GPU compilation provides 2-5x improvements through transfer elimination, neural compilation achieves 10-100x speedups via massive parallelism, and hybrid approaches offer practical deployment paths with guaranteed correctness. We formalize the probabilistic verification framework that enables trading compilation accuracy for parallel exploration, and discuss implications for self-improving AI systems and future analog computing substrates.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑