arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.04284cs.DB
收藏

一种处理大数据仓库演化的方法

An Approach to Handle Big Data Warehouse Evolution

Darja Solodovnikova, Laila Niedrite

摘要:

大数据系统的目的之一是支持从异构数据源收集的数据的分析。由于数据仓库已经被用于实现相同的目标几十年,它们也可以被利用来提供对存储在大数据系统中的数据的分析。如何使数据仓库的数据和模式适应这些需求和数据源的变化,这一问题已经被世界范围内的许多研究人员所研究。然而,还必须开发创新方法来支持用于分析存储在大数据系统中的数据的数据仓库的发展。在本文中,我们提出了一个数据仓库架构,允许执行不同类型的分析任务,包括OLAP类分析,从多个异构数据源加载的大数据具有不同的延迟,并能够处理数据源的变化,以及不断变化的分析需求。该体系结构的操作高度依赖于本文中概述的元数据。

英文摘要:

One of the purposes of Big Data systems is to support analysis of data gathered from heterogeneous data sources. Since data warehouses have been used for several decades to achieve the same goal, they could be leveraged also to provide analysis of data stored in Big Data systems. The problem of adapting data warehouse data and schemata to changes in these requirements as well as data sources has been studied by many researchers worldwide. However, innovative methods must be developed also to support evolution of data warehouses that are used to analyze data stored in Big Data systems. In this paper, we propose a data warehouse architecture that allows to perform different kinds of analytical tasks, including OLAP-like analysis, on big data loaded from multiple heterogeneous data sources with different latency and is capable of processing changes in data sources as well as evolving analysis requirements. The operation of the architecture is highly based on the metadata that are outlined in the paper.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑