arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.12295cs.DBcs.LG
收藏

一个从数据和数据中学习的统一深度模型,用于基数估计

A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation

School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院)

Peizhi Wu, Gao Cong

摘要:

基数估计是数据库系统中的一个基本问题。为了捕获关系表中丰富的联合数据分布,大多数现有的工作要么使用数据作为无监督信息,要么使用查询工作负载作为监督信息。很少有工作已经完成使用这两种类型的信息,不能充分利用这两种类型的信息来学习联合数据分布。在这项工作中,我们的目标是通过提出一个新的统一的深度自回归模型UAE来缩小数据驱动和查询驱动方法之间的差距,该模型可以从数据和查询工作负载中学习联合数据分布。首先,为了能够在深度自回归模型中使用监督查询信息,我们使用Gumbel-Softmax技巧开发了可微渐进采样。其次,UAE能够利用这两种类型的信息来学习单个模型中的联合数据分布。综合实验结果表明,UAE实现了个位数的乘法错误在尾部,更好的精度比国家的最先进的方法,是空间和时间效率。

英文摘要:

Cardinality estimation is a fundamental problem in database systems. To capture the rich joint data distributions of a relational table, most of the existing work either uses data as unsupervised information or uses query workload as supervised information. Very little work has been done to use both types of information, and cannot fully make use of both types of information to learn the joint data distribution. In this work, we aim to close the gap between data-driven and query-driven methods by proposing a new unified deep autoregressive model, UAE, that learns the joint data distribution from both the data and query workload. First, to enable using the supervised query information in the deep autoregressive model, we develop differentiable progressive sampling using the Gumbel-Softmax trick. Second, UAE is able to utilize both types of information to learn the joint data distribution in a single model. Comprehensive experimental results demonstrate that UAE achieves single-digit multiplicative error at tail, better accuracies over state-of-the-art methods, and is both space and time efficient.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑