arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2105.09894cs.DC
收藏

面向Arrow-Native存储系统

Towards an Arrow-native Storage System

Jayjeet Chakraborty, Ivo Jimenez, Sebastiaan Alvarez Rodriguez, Alexandru Uta, Jeff LeFevre, Carlos Maltzahn

摘要:

随着数据集大小的不断增加,已经开发了几种文件格式,如Parquet,ORC和Avro,以有效地存储数据并以额外的CPU利用率为代价节省网络和互连带宽。然而,随着网络支持25-100 Gb/s和存储设备提供1,000,000 reqs/s的出现,CPU已经成为瓶颈,试图保持数据进出这些快速设备。其结果是,在单个客户端上执行的数据访问库通常受到CPU的限制,无法利用分布式存储系统的横向扩展优势。对于这个问题,一个有吸引力的解决方案是将数据减少处理和过滤任务卸载到存储层。然而,修改传统存储系统以支持计算卸载通常是繁琐的,并且需要对内部结构有广泛的了解。以前的方法为特定的存储系统重新实现了数据处理框架和访问库的功能,这是可能必须为不同的存储系统重复的重复工作。在本文中,我们介绍了一种新的设计模式,允许扩展可编程对象存储系统嵌入现有的,广泛使用的数据处理框架和访问库到存储层,以最小的修改。在这种方法中,数据处理框架和访问库可以独立于存储系统发展,同时利用分布式存储系统的横向扩展和可用性属性。我们使用Ceph、Apache Arrow和Parquet来实现我们的设计范例。我们提供了一个简短的性能评估,我们的实施和讨论的关键结果。

英文摘要:

With the ever-increasing dataset sizes, several file formats like Parquet, ORC, and Avro have been developed to store data efficiently and to save network and interconnect bandwidth at the price of additional CPU utilization. However, with the advent of networks supporting 25-100 Gb/s and storage devices delivering 1, 000, 000 reqs/sec the CPU has become the bottleneck, trying to keep up feeding data in and out of these fast devices. The result is that data access libraries executed on single clients are often CPU-bound and cannot utilize the scale-out benefits of distributed storage systems. One attractive solution to this problem is to offload data-reducing processing and filtering tasks to the storage layer. However, modifying legacy storage systems to support compute offloading is often tedious and requires extensive understanding of the internals. Previous approaches re-implemented functionality of data processing frameworks and access library for a particular storage system, a duplication of effort that might have to be repeated for different storage systems. In this paper, we introduce a new design paradigm that allows extending programmable object storage systems to embed existing, widely used data processing frameworks and access libraries into the storage layer with minimal modifications. In this approach data processing frameworks and access libraries can evolve independently from storage systems while leveraging the scale-out and availability properties of distributed storage systems. We present one example implementation of our design paradigm using Ceph, Apache Arrow, and Parquet. We provide a brief performance evaluation of our implementation and discuss key results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑