arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1801.05064cs.DCcs.DBcs.SE
收藏

DKVF:一个分布式键值存储的快速原型和评估框架

DKVF: A Framework for Rapid Prototyping and Evaluating Distributed Key-value Stores

Mohammad Roohitavaf, Sandeep Kulkarni

摘要:

我们提出了我们的框架DKVF,使一个快速原型和评估新的协议的键值存储和比较它们与现有的协议的基础上选定的基准。由于CAP定理的局限性,必须开发新的协议,以实现所需的一致性和可用性之间的权衡,为给定的应用程序。因此,学术界和工业界都专注于开发新的协议,以确定此权衡曲线上的不同(并且希望在一个或多个方面更好)点。虽然这些协议通常基于简单的直觉,但评估它们以确保它们确实提供了更高的可用性、一致性或性能是一项繁琐的任务。我们的框架,DKVF,使人们能够快速原型化一个新的协议,以及确定它是如何执行相比,现有的协议预先指定的基准。我们的框架依赖于YCSB(Yahoo!Cloud Servicing Benchmark)进行基准测试。我们通过实现四个现有的协议-最终一致性,COPS,GentleRain和CauseSpartan-来演示DKVF。我们比较了这些协议在不同负载条件下的性能。我们发现,性能是类似于我们从头开始实现这些协议。并且,这些协议的比较与文献中报道的一致。此外,这些协议的实现更加自然,因为我们只需要将伪代码转换为Java(并添加必要的错误处理)。因此,每个方案仅需1-2天即可实现这一目标。最后,我们的框架是可扩展的。可以替换框架中的单个组件(例如,存储组件)。

英文摘要:

We present our framework DKVF that enables one to quickly prototype and evaluate new protocols for key-value stores and compare them with existing protocols based on selected benchmarks. Due to limitations of CAP theorem, new protocols must be developed that achieve the desired trade-off between consistency and availability for the given application at hand. Hence, both academic and industrial communities focus on developing new protocols that identify a different (and hopefully better in one or more aspect) point on this trade-off curve. While these protocols are often based on a simple intuition, evaluating them to ensure that they indeed provide increased availability, consistency, or performance is a tedious task. Our framework, DKVF, enables one to quickly prototype a new protocol as well as identify how it performs compared to existing protocols for pre-specified benchmarks. Our framework relies on YCSB (Yahoo! Cloud Servicing Benchmark) for benchmarking. We demonstrate DKVF by implementing four existing protocols --eventual consistency, COPS, GentleRain and CausalSpartan-- with it. We compare the performance of these protocols against different loading conditions. We find that the performance is similar to our implementation of these protocols from scratch. And, the comparison of these protocols is consistent with what has been reported in the literature. Moreover, implementation of these protocols was much more natural as we only needed to translate the pseudocode into Java (and add the necessary error handling). Hence, it was possible to achieve this in just 1-2 days per protocol. Finally, our framework is extensible. It is possible to replace individual components in the framework (e.g., the storage component).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑