语义数据仓库的高层ETL——完整版
High-Level ETL for Semantic Data Warehouses -- Full Version
AI总结:
本文提出基于RDF的高层ETL构造及层式集成过程,实现语义数据仓库的自动化ETL,原型SETLCONSTRUCT相比SETLPROG大幅减少键入字符和开发时间,并保持可扩展性和性能。
摘要:
语义网(SW)的普及鼓励组织使用RDF模型来组织和发布语义数据。这种增长对商业智能(BI)技术提出了新的要求,以便能够对语义数据进行类似联机分析处理(OLAP)的分析。传统的数据抽取-转换-加载(ETL)工具不支持将语义数据纳入数据仓库(DW),因为它们在集成过程中不考虑语义问题。在本文中,我们提出了一种基于层的集成过程,以及一组基于RDF的高层ETL构造,用于定义、映射、抽取、处理、转换、集成、更新和加载(多维)语义数据。与其他ETL工具不同,我们通过在模式级别创建元数据来自动化ETL数据流。因此,它减轻了ETL开发人员在ETL操作级别进行手动映射的负担。我们基于这里提出的创新ETL构造创建了一个原型,名为语义ETL构造(SETLCONSTRUCT)。为了评估SETLCONSTRUCT,我们通过集成丹麦商业数据集和欧盟补贴数据集创建了一个多维语义数据仓库,并将其与之前的可编程框架SETLPROG在生产率、开发时间和性能方面进行比较。评估表明:1)SETLCONSTRUCT使用的键入字符数(NOTC)比SETLPROG少92%,而SETLAUTO(SETLCONSTRUCT的扩展,用于自动生成ETL执行流)进一步将使用的概念数(NOUC)减少了25%;2)使用SETLCONSTRUCT,开发时间比SETLPROG几乎减少一半,使用SETLAUTO又减少了27%;3)SETLCONSTRUCT具有可扩展性,并且与SETLPROG相比具有相似的性能。
英文摘要:
The popularity of the Semantic Web (SW) encourages organizations to organize and publish semantic data using the RDF model. This growth poses new requirements to Business Intelligence (BI) technologies to enable On-Line Analytical Processing (OLAP)-like analysis over semantic data. The incorporation of semantic data into a Data Warehouse (DW) is not supported by the traditional Extract-Transform-Load (ETL) tools because they do not consider semantic issues in the integration process. In this paper, we propose a layer-based integration process and a set of high-level RDF-based ETL constructs required to define, map, extract, process, transform, integrate, update, and load (multidimensional) semantic data. Different to other ETL tools, we automate the ETL data flows by creating metadata at the schema level. Therefore, it relieves ETL developers from the burden of manual mapping at the ETL operation level. We create a prototype, named Semantic ETL Construct (SETLCONSTRUCT), based on the innovative ETL constructs proposed here. To evaluate SETLCONSTRUCT, we create a multidimensional semantic DW by integrating a Danish Business dataset and an EU Subsidy dataset using it and compare it with the previous programmable framework SETLPROG in terms of productivity, development time and performance. The evaluation shows that 1) SETLCONSTRUCT uses 92% fewer Number of Typed Characters (NOTC) than SETLPROG, and SETLAUTO (the extension of SETLCONSTRUCT for generating ETL execution flow automatically) further reduces the Number of Used Concepts (NOUC) by another 25%; 2) using SETLCONSTRUCT, the development time is almost cut in half compared to SETLPROG, and is cut by another 27% using SETLAUTO; 3) SETLCONSTRUCT is scalable and has similar performance compared to SETLPROG.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。