arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.13292cs.DC
收藏

分段ARES:大对象的动态存储

Fragmented ARES: Dynamic Storage for Large Objects

Chryssis Georgiou, Nicolas Nicolaou, Andria Trigeorgi

摘要:

数据可用性是分布式存储系统中最重要的功能之一,通过数据复制成为可能。在数据快速生成的今天,开发高效、可扩展、可靠的存储系统已成为高性能计算面临的主要挑战之一。在这项工作中,我们开发了一个动态的,强大的和强一致的分布式存储实现适合处理大型对象(如文件)。我们这样做是通过集成一个自适应,可重新配置,原子存储框架,称为ARES,与分布式文件系统,称为COBFS,它依赖于块碎片技术来处理大型对象。随着ARES的加入,我们还可以使用擦除编码算法来进一步分割数据,并可能提高副本服务器的存储效率和操作延迟。为了测试我们成果的实用性,我们对Emulab和AWS EC2测试平台进行了深入的实验评估,说明了我们方法的好处以及其他有趣的权衡。

英文摘要:

Data availability is one of the most important features in distributed storage systems, made possible by data replication. Nowadays data are generated rapidly and the goal to develop efficient, scalable and reliable storage systems has become one of the major challenges for high performance computing. In this work, we develop a dynamic, robust and strongly consistent distributed storage implementation suitable for handling large objects (such as files). We do so by integrating an Adaptive, Reconfigurable, Atomic Storage framework, called ARES, with a distributed file system, called COBFS, which relies on a block fragmentation technique to handle large objects. With the addition of ARES, we also enable the use of an erasure-coded algorithm to further split our data and to potentially improve storage efficiency at the replica servers and operation latency. To put the practicality of our outcomes at test, we conduct an in-depth experimental evaluation on the Emulab and AWS EC2 testbeds, illustrating the benefits of our approaches, as well as other interesting tradeoffs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑