arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1910.10063cs.DB
收藏

利用数据不对称提高查询性能

Exploiting Data Skew for Improved Query Performance

Wangda Zhang, Kenneth A. Ross

摘要:

分析查询使当今许多商业、科学和医疗领域中复杂的大规模数据分析成为可能。数据倾斜是这些现实世界领域的普遍特征。在零售数据库中,某些产品通常比其他产品更受欢迎。在文本数据库中,词频遵循Zipf分布,具有少量非常常见的单词和长尾的不频繁单词。在地理数据库中,某些地区的人口(和数据测量)比其他地区高得多。当前的系统没有充分利用高速缓存来利用偏斜。特别地,整个高速缓存行可以保持高速缓存驻留,即使仅高速缓存行的一小部分对应于流行数据项。在本文中,我们提出了一种新的索引结构重新定位数据项集中流行的项目到相同的缓存线。最终结果是更好的空间局部性,以及更好地利用有限的缓存资源。我们开发了一个理论模型来分析缓存的行为,并实现了数据库运营商是有效的存在偏斜。我们在真实数据和合成数据上的实验表明,利用偏斜可以显着提高内存查询性能。在某些情况下,我们的技术可以加快查询速度超过一个数量级。

英文摘要:

Analytic queries enable sophisticated large-scale data analysis within many commercial, scientific and medical domains today. Data skew is a ubiquitous feature of these real-world domains. In a retail database, some products are typically much more popular than others. In a text database, word frequencies follow a Zipf distribution with a small number of very common words, and a long tail of infrequent words. In a geographic database, some regions have much higher populations (and data measurements) than others. Current systems do not make the most of caches for exploiting skew. In particular, a whole cache line may remain cache resident even though only a small part of the cache line corresponds to a popular data item. In this paper, we propose a novel index structure for repositioning data items to concentrate popular items into the same cache lines. The net result is better spatial locality, and better utilization of limited cache resources. We develop a theoretical model for analyzing the cache behavior, and implement database operators that are efficient in the presence of skew. Our experiments on real and synthetic data show that exploiting skew can significantly improve in-memory query performance. In some cases, our techniques can speed up queries by over an order of magnitude.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑