arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1911.01274cs.CY
收藏

大数据质量的情境化:一个比较框架

Contextualization of Big Data Quality: A framework for comparison

Mostafa Mirzaie, Behshid Behkamal, Samad Paydar

摘要:

随着大数据应用的出现以及这些应用中产生的数据量的增加,有效的大数据分析方法的重要性变得非常明显。然而,如果数据缺乏所需的质量,任何这种方法的成功都将受到阻碍。因此,大数据质量评估是任何使用大数据分析进行决策的组织或企业的主要要求。另一方面,使用上下文信息在各种领域中的许多分析任务(例如,社交网络中的用户行为分析)中是有利的。然而,大数据质量评估从这种潜力中受益较少。在大数据领域有各种各样的数据源,可以用来提高大数据的质量评估。将这些来源提供的上下文信息纳入大数据质量评估过程是一种新兴趋势,旨在提高质量评估的性能和准确性。本文提出了一个大数据质量的上下文分类框架,将上下文特征分为四个主要维度:1)上下文类别,2)上下文特征来源的数据源类型,3)上下文的发现和提取方法,4)上下文数据影响的质量因素。该模型引入了新的上下文特征和维度,需要在大数据质量评估中加以考虑。初步评估表明,该模型更容易理解,更全面,更丰富,更有用的现有模型相比。

英文摘要:

With the advent of big data applications and the increasing amount of data being produced in these applications, the importance of efficient methods for big data analysis has become highly evident. However, the success of any such method will be hindered should the data lacks the required quality. Big data quality assessment is therefore a major requirement for any organization or business that use big data analytics for its decision making. On the other hand, using contextual information is advantageous in many analysis tasks in various domains, e.g. user behavior analysis in the social networks. However, the big data quality assessment has benefited less from this potential. There is a vast variety of data sources in the big data domain that can be utilized to improve the quality evaluation of big data. Including contextual information provided by these sources into the big data quality assessment process is an emerging trend towards more advanced techniques aimed at enhancing the performance and accuracy of quality assessment. This paper presents a context classification framework for big data quality, categorizing the context features into four primary dimensions: 1) context category, 2) data source type that contextual features come from, 3) discovery and extraction method of context, and 4) the quality factors affected by the contextual data. The proposed model introduces new context features and dimensions that need to be taken into consideration in quality assessment of big data. The initial evaluation demonstrates that the model is more understandable, more comprehensive, richer, and more useful compared to existing models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑