arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1910.11040cs.DB
收藏

基于视图的数据清理架构

Toward a view-based data cleaning architecture

Toshiyuki Shimizu, Hiroki Omori, Masatoshi Yoshikawa

摘要:

随着机器学习技术的发展,大数据分析已经成为一个活跃的研究领域。为了正确分析数据,重要的是保持高质量的数据。因此,对数据清洗的研究也很重要。对于需要专业知识的数据或由许多贡献者创建的数据(例如来自异构数据源的集成数据),很难自动检测和纠正不一致的值。这类数据的一个例子是科学数据集的元数据,数据管理人员在处理数据时应确认这些元数据。为了支持数据管理员有效地清洗数据,我们提出了一个数据清洗架构,数据管理员交互式浏览和正确的数据部分通过视图。在本文中,我们解释了我们的基于视图的数据清洗架构,并讨论了一些剩余的问题。

英文摘要:

Big data analysis has become an active area of study with the growth of machine learning techniques. To properly analyze data, it is important to maintain high-quality data. Thus, research on data cleaning is also important. It is difficult to automatically detect and correct inconsistent values for data requiring expert knowledge or data created by many contributors, such as integrated data from heterogeneous data sources. An example of such data is metadata for scientific datasets, which should be confirmed by data managers while handling the data. To support the efficient cleaning of data by data managers, we propose a data cleaning architecture in which data managers interactively browse and correct portions of data through views. In this paper, we explain our view-based data cleaning architecture and discuss some remaining issues.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑