Current AI code generation systems suffer from significant latency bottlenecks due to CPU-GPU data transfers during compilation, execution, and testing phases. We establish theoretical foundations for three complementary approaches to GPU-native compilation that eliminate these transfers: (1) parallel traditional compilation adapted for GPU execution, (2) neural compilation using learned sequence-to-sequence translation with probabilistic verification, and (3) hybrid architectures combining both strategies. We derive latency and energy bounds demonstrating potential speedups of 10-100x for code iteration cycles. Our analysis shows that traditional GPU compilation provides 2-5x improvements through transfer elimination, neural compilation achieves 10-100x speedups via massive parallelism, and hybrid approaches offer practical deployment paths with guaranteed correctness. We formalize the probabilistic verification framework that enables trading compilation accuracy for parallel exploration, and discuss implications for self-improving AI systems and future analog computing substrates.
ElegantRL-Podracer: Scalable and Elastic Library for Cloud-Native Deep Reinforcement Learning
Columbia University(哥伦比亚大学);University of California, Berkeley(加州大学伯克利分校);Shenzhen Inst. of Advanced Tech.(深圳先进技术研究院);Northwestern University(西北大学);Bell labs(贝尔实验室);Amazon(亚马逊);IDEA Research(IDEA研究院)
Thousand-GPU Large-Scale Training and Optimization Recipe for AI-Native Cloud Embodied Intelligence Infrastructure
AI Infra Team at JDT(JDT人工智能基础设施团队);Tsinghua University(清华大学);Peking University(北京大学);Tianjin University(天津大学);Beihang University(北洋大学);University of Science and Technology of China(中国科学技术大学)
Evaluating OpenMP Offloading for Intra-node Multi-GPU Programming across NVIDIA, AMD, and Intel Architectures: A 3D Heat Transfer Case Study
Rudolfovo-Science and Technology Centre Novo mesto(鲁多尔沃夫诺沃梅斯托科学与技术中心);Faculty of Mechanical Engineering, University of Ljubljana(卢布尔雅那大学机械工程学院);Department of Computer Science, FSTM, University of Luxembourg(卢森堡大学科学技术学院计算机科学系)
DCC: Data-Centric Compilation of Machine Learning Kernels for Processing-In-Memory Architectures
University of Toronto(多伦多大学);Vector Institute(向量研究所);Barcelona Supercomputing Center(巴塞罗那超级计算中心);ETH Zürich(苏黎世联邦理工学院);Nvidia(英伟达);Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所)
SIVF: GPU-Resident IVF Index for Streaming Vector Search
Tacoma School of Engineering and Computing(塔科马工程与计算学院);Paul G. Allen School of Computer Science & Engineering(保罗·G·艾伦计算机科学与工程学系);University of Washington(华盛顿大学)
Massively parallel numerical simulations with Julia
University of Augsburg(奥格斯堡大学);University of Cologne(科隆大学);Johannes Gutenberg University Mainz(约翰内斯·古腾堡美因茨大学);RWTH Aachen University(亚琛工业大学);Universidad Politécnica de Madrid(马德里理工大学)
研究用 Julia 开发大规模并行 HPC 应用程序的适用性,通过分析 Julia 代码 Trixi.jl 的并行性能并与 Fortran 代码 FLUXO 比较,展示挑战与解决方案,最终演示其在多达 61440 个 CPU 核心上的并行扩展性。