arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.18649cs.DB
收藏

开源数据质量工具综述:揭示实践中数据质量维度的物化

A survey of open-source data quality tools: shedding light on the materialization of data quality dimensions in practice

Vasileios Papastergios, Anastasios Gounaris

AI总结:

本文系统考察6个开源数据质量工具,建立其底层功能与ISO/IEC 25012标准高层维度间的多对多映射,揭示实践中DQ维度的物化及软件工程实现细节。

摘要:

数据质量(DQ)描述了数据特征满足要求并适合人类和/或系统使用的程度。DQ可以在多个方面进行衡量,称为DQ维度(如准确性、完整性、一致性等),文献中也称其为特征。ISO/IEC 25012标准定义了一个包含15个此类维度的数据质量模型,设定了数据产品应满足的要求。在本短篇报告中,我们旨在以系统的方式弥合DQ工具提供的底层功能与高层维度之间的差距,揭示它们之间的多对多关系。为此,我们考察了6个开源DQ工具,并重点提供了它们提供的功能与ISO标准定义的DQ维度之间的映射。在适用的情况下,我们还提供了工具为应对DQ挑战而利用的软件工程细节的见解。

英文摘要:

Data Quality (DQ) describes the degree to which data characteristics meet requirements and are fit for use by humans and/or systems. There are several aspects in which DQ can be measured, called DQ dimensions (i.e. accuracy, completeness, consistency, etc.), also referred to as characteristics in literature. ISO/IEC 25012 Standard defines a data quality model with fifteen such dimensions, setting the requirements a data product should meet. In this short report, we aim to bridge the gap between lower-level functionalities offered by DQ tools and higher-level dimensions in a systematic manner, revealing the many-to-many relationships between them. To this end, we examine 6 open-source DQ tools and we emphasize on providing a mapping between the functionalities they offer and the DQ dimensions, as defined by the ISO standard. Wherever applicable, we also provide insights into the software engineering details that tools leverage, in order to address DQ challenges.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑