arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.01877cs.DBcs.AIcs.LG
收藏

张量计算运行时的查询处理

Query Processing on Tensor Computation Runtimes

University of Washington(华盛顿大学);University of California, San Diego(加州大学圣地亚哥分校);Microsoft(微软);Meta

Dong He, Supun Nakandala, Dalitso Banda, Rathijit Sen, Karla Saur, Kwanghyun Park, Carlo Curino, Jesús Camacho-Rodríguez, Konstantinos Karanasos, Matteo Interlandi

摘要:

人工智能(AI)对计算的巨大需求正在推动对AI硬件和软件系统的空前投资。这导致了专业硬件设备数量的爆炸式增长,这些设备现在由主要的云供应商提供。通过基于张量的接口隐藏低级别的复杂性,PyTorch等张量计算运行时(TCR)允许数据科学家有效地利用新硬件提供的令人兴奋的功能。在本文中,我们将探讨数据库管理系统如何能够驾驭人工智能领域的创新浪潮。我们设计,构建和评估张量查询处理器(TQP):TQP将SQL查询转换为张量程序并在TCR上执行它们。TQP能够通过在张量例程上实现关系运算符的新算法来运行完整的TPC-H基准测试。同时,TQP可以支持各种硬件,而只需要通常开发工作的一小部分。实验表明,TQP可以提高查询执行时间高达10 $\times$在专门的CPU和GPU的唯一系统。最后,TQP可以加速混合ML预测和SQL端到端的查询,并在CPU基线上提供高达9 $\times$的加速。

英文摘要:

The huge demand for computation in artificial intelligence (AI) is driving unparalleled investments in hardware and software systems for AI. This leads to an explosion in the number of specialized hardware devices, which are now offered by major cloud vendors. By hiding the low-level complexity through a tensor-based interface, tensor computation runtimes (TCRs) such as PyTorch allow data scientists to efficiently exploit the exciting capabilities offered by the new hardware. In this paper, we explore how database management systems can ride the wave of innovation happening in the AI space. We design, build, and evaluate Tensor Query Processor (TQP): TQP transforms SQL queries into tensor programs and executes them on TCRs. TQP is able to run the full TPC-H benchmark by implementing novel algorithms for relational operators on the tensor routines. At the same time, TQP can support various hardware while only requiring a fraction of the usual development effort. Experiments show that TQP can improve query execution time by up to 10$\times$ over specialized CPU- and GPU-only systems. Finally, TQP can accelerate queries mixing ML predictions and SQL end-to-end, and deliver up to 9$\times$ speedup over CPU baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑