arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1203.2574cs.DB
收藏

面向RDBMS内分析的统一体系结构

Towards a Unified Architecture for in-RDBMS Analytics

Xixuan Feng, Arun Kumar, Ben Recht, Christopher Ré

摘要:

在企业应用程序中越来越多地使用统计数据分析,这在数据库供应商之间引发了一场军备竞赛,以提供更复杂的数据库内分析。这场竞赛中的一个挑战是,每一种新的统计技术都必须在RDBMS中从头开始实现,这导致了漫长而复杂的开发过程。我们认为,这种开销的根本原因是缺乏统一的数据库内分析架构。我们在这项工作中的主要贡献是朝着这样一个统一的架构迈出了一步。我们的统一架构的一个关键好处是,可以对分析技术的性能优化进行一般性研究,而不是以特定的方式进行研究。特别是,我们的技术贡献是理论和实证研究的两个关键因素,我们发现影响性能:顺序数据存储,并在单节点多核RDBMS的计算并行化。我们通过将几种流行的分析技术集成到两个商业和一个开源的RDBMS中来证明我们的架构的可行性。我们的架构只需要更改几十行代码就可以集成新的统计技术。然后,我们将我们的方法与商业RDBMS在各种分析任务上提供的本地分析工具进行比较,并验证我们的方法是否具有竞争力或更高的性能,同时仍然达到相同的质量。

英文摘要:

The increasing use of statistical data analysis in enterprise applications has created an arms race among database vendors to offer ever more sophisticated in-database analytics. One challenge in this race is that each new statistical technique must be implemented from scratch in the RDBMS, which leads to a lengthy and complex development process. We argue that the root cause for this overhead is the lack of a unified architecture for in-database analytics. Our main contribution in this work is to take a step towards such a unified architecture. A key benefit of our unified architecture is that performance optimizations for analytics techniques can be studied generically instead of an ad hoc, per-technique fashion. In particular, our technical contributions are theoretical and empirical studies of two key factors that we found impact performance: the order data is stored, and parallelization of computations on a single-node multicore RDBMS. We demonstrate the feasibility of our architecture by integrating several popular analytics techniques into two commercial and one open-source RDBMS. Our architecture requires changes to only a few dozen lines of code to integrate a new statistical technique. We then compare our approach with the native analytics tools offered by the commercial RDBMSes on various analytics tasks, and validate that our approach achieves competitive or higher performance, while still achieving the same quality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑