TileCas:跨编程抽象的级联内核开发
TileCas: Cascading Kernel Development Across Programming Abstractions
AI总结:
本文提出跨编程抽象的级联内核开发接口TileCas,将其与AKO、KDA集成后在50个KernelBench工作负载上分别实现29.0%、69.2%的加速比提升,可改进机器驱动软件开发且能跨工作流复用。
摘要:
编程抽象传统上是为人类设计的,但代码生成越来越多地由模型和自主智能体执行。我们研究面向机器驱动编程的抽象,聚焦GPU与AI加速器内核生成。高级领域特定语言(DSL)通过将实现细节委托给编译器来简化搜索,而低级表示则以更大、更复杂的搜索空间为代价提供更细粒度的控制。本文提出TileCas,一个统一的可插拔接口,使编码智能体能够跨多个可编辑抽象级别开发内核。TileCas不局限于单一表示,而是允许智能体通过跨级别诊断、抽象调度和异构搜索树在不同级别间转移并优化候选方案:跨级别诊断将正确性与性能反馈映射到不同抽象级别的可操作控制;抽象调度选择后续优化应采用的候选方案和表示;异构搜索树保留并重新审视跨多种表示的替代搜索轨迹。我们将TileCas与两个代码智能体AKO和KDA集成,在两个加速器平台和两个语言模型上的50个端到端KernelBench Level 3工作负载上评估这两种集成。对四个加速器-模型配置赋予相同权重,集成TileCas的AKO实现了4.84倍的算术平均加速比,而评估中最强的无TileCas基线的加速比为3.75倍,提升了29.0%;将同一接口与KDA集成使其平均加速比提升了69.2%,且在每个配置中均有增益。这些结果表明,允许编码智能体在编程抽象间导航可改进机器驱动软件开发,且该接口可在不同基础工作流中复用。
英文摘要:
Programming abstractions have traditionally been designed for humans, but code generation is increasingly performed by models and autonomous agents. We investigate abstractions for machine-driven programming through GPU and AI-accelerator kernel generation. High-level domain-specific languages (DSLs) simplify search by delegating implementation details to compilers, while lower-level representations provide finer-grained control at the cost of a larger and more complex search space. In this paper, we present TileCas, a unified, pluggable interface that enables coding agents to develop kernels across multiple editable abstraction levels. Rather than committing to a single representation, TileCas allows an agent to transfer and refine candidates across levels through Cross-Level Diagnosis, which maps correctness and performance feedback to actionable controls at different abstraction levels; Abstraction Scheduling, which selects both the candidate and representation from which subsequent refinement should proceed; and a Heterogeneous Search Tree, which preserves and revisits alternative search trajectories spanning multiple representations. We integrate TileCas with two code agents AKO and KDA, and evaluate both integrations on 50 end-to-end KernelBench Level 3 workloads across two accelerator platforms and two language models. Giving equal weight to the four accelerator-model configurations, AKO with TileCas achieves an arithmetic-mean speedup of $4.84\times$, compared with $3.75\times$ for the strongest evaluated baseline without TileCas, an improvement of 29.0%. Integrating the same interface with KDA improves its mean speedup by 69.2%, with gains in every configuration. These results show that allowing coding agents to navigate across programming abstractions can improve machine-driven software development and can be reused across different base workflows.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。