arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1503.01143cs.DB
收藏

S-Store:流处理满足事务处理

S-Store: Streaming Meets Transaction Processing

John Meehan, Nesime Tatbul, Stan Zdonik, Cansu Aslantas, Ugur Cetintemel, Jiang Du, Tim Kraska, Samuel Madden, David Maier, Andrew Pavlo, Michael Stonebraker, K… 展开作者

John Meehan, Nesime Tatbul, Stan Zdonik, Cansu Aslantas, Ugur Cetintemel, Jiang Du, Tim Kraska, Samuel Madden, David Maier, Andrew Pavlo, Michael Stonebraker, Kristin Tufte, Hao Wang

摘要:

流处理解决了实时应用的需求。事务处理解决短原子计算的协调和安全问题。因此,这两种运作模式存在于单独的、烟囱式的系统中。在这项工作中,我们试图融合两个计算范式在一个单一的系统称为S-商店。通过这种方式,S-Store可以同时适应OLTP和流应用程序。我们提出了一个简单的事务模型的流,无缝集成与传统的OLTP系统。我们选择构建S-Store作为H-Store的扩展,H-Store是一个开源的、内存中的分布式OLTP数据库系统。通过以这种方式实现S-Store,我们可以利用H-Store已经支持的事务处理功能,并且我们可以专注于支持流所需的其他实现特性。类似的实现可以使用其他主存OLTP平台来完成。我们表明,我们实际上可以实现更高的吞吐量流工作负载在S-Store比同等的部署在H-Store单独。我们还展示了如何在H-Store中添加适量的新功能来实现这一目标。此外,我们将S-Store与两个最先进的流媒体系统Spark Streaming和Storm进行了比较,并展示了S-Store如何匹配,有时甚至超过它们的性能,同时提供更强的事务保证。

英文摘要:

Stream processing addresses the needs of real-time applications. Transaction processing addresses the coordination and safety of short atomic computations. Heretofore, these two modes of operation existed in separate, stove-piped systems. In this work, we attempt to fuse the two computational paradigms in a single system called S-Store. In this way, S-Store can simultaneously accommodate OLTP and streaming applications. We present a simple transaction model for streams that integrates seamlessly with a traditional OLTP system. We chose to build S-Store as an extension of H-Store, an open-source, in-memory, distributed OLTP database system. By implementing S-Store in this way, we can make use of the transaction processing facilities that H-Store already supports, and we can concentrate on the additional implementation features that are needed to support streaming. Similar implementations could be done using other main-memory OLTP platforms. We show that we can actually achieve higher throughput for streaming workloads in S-Store than an equivalent deployment in H-Store alone. We also show how this can be achieved within H-Store with the addition of a modest amount of new functionality. Furthermore, we compare S-Store to two state-of-the-art streaming systems, Spark Streaming and Storm, and show how S-Store matches and sometimes exceeds their performance while providing stronger transactional guarantees.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑