arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.10836cs.DCcs.DB
收藏

分布式数据密集型系统的模型与综述

A Model and Survey of Distributed Data-Intensive Systems

Alessandro Margara, Gianpaolo Cugola, Nicolò Felicioni, Stefano Cilloni

AI总结:

本文提出统一模型剖析分布式数据密集型系统的核心功能与设计权衡,并据此分类数十个系统,以比较异构方案、识别趋势并指出开放研究方向。

摘要:

数据是当今社会的宝贵资源,其产生速度前所未有且持续增长。存储、分析数据并使众多用户能够及时获取数据的需求,给现代软件平台带来了巨大挑战。这些挑战从根本上改变了围绕数据管理和处理的所有研究领域,分布式数据密集型系统由此引入,它们提供新的编程模型和实现策略,以处理数据的各类特征,例如数据量、数据产生速率、异构性和分布性。每个数据密集型系统都会在数据模型、使用假设、同步、处理策略、部署、一致性保证、容错和排序等方面作出自身特定选择。然而,数据密集型系统面临的问题及其提出的解决方案经常相互重叠。本文提出一个统一模型,剖析数据密集型系统的核心功能,并精确讨论替代性的设计与实现策略,指出其假设和影响。该模型为理解和比较高度异构的解决方案提供共同基础,有望促进研究社区之间的交叉融合并推动该领域发展。我们通过对数十个系统进行分类来应用该模型:这一工作带来了关于数据密集型系统领域当前趋势的有趣观察,并指出了开放的研究方向。

英文摘要:

Data is a precious resource in today's society, and is generated at an unprecedented and constantly growing pace. The need to store, analyze, and make data promptly available to a multitude of users introduces formidable challenges in modern software platforms. These challenges radically transformed all research fields that gravitate around data management and processing, with the introduction of distributed data-intensive systems that offer new programming models and implementation strategies to handle data characteristics such as its volume, the rate at which it is produced, its heterogeneity, and its distribution. Each data-intensive system brings its specific choices in terms of data model, usage assumptions, synchronization, processing strategy, deployment, guarantees in terms of consistency, fault tolerance, ordering. Yet, the problems data-intensive systems face and the solutions they propose are frequently overlapping. This paper proposes a unifying model that dissects the core functionalities of data-intensive systems, and precisely discusses alternative design and implementation strategies, pointing out their assumptions and implications. The model offers a common ground to understand and compare highly heterogeneous solutions, with the potential of fostering cross-fertilization across research communities and advancing the field. We apply our model by classifying tens of systems: an exercise that brings to interesting observations on the current trends in the domain of data-intensive systems and suggests open research directions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑