arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1910.08670cs.LGcs.SIstat.ML
收藏

通过偏差消除和数据不完整性缓解的上下文驱动数据采掘

Context-Driven Data Mining through Bias Removal and Data Incompleteness Mitigation

College of Science, George Mason University(乔治梅森大学科学学院)

Feras A. Batarseh, Ajay Kulkarni

摘要:

数据采掘工作的结果主要由数据质量驱动。在这些部署过程中,严重的问题仍然没有得到解决,例如:数据汇集不明确,数据不平衡,数据中隐藏的偏见,缺乏领域信息,以及数据不完整。本文的前提是,背景可以帮助缓解这些问题。在传统的数据科学生命周期中,不考虑上下文。本文的主要贡献是上下文驱动的数据科学模型(C-DSL),它是为了应对这些挑战而开发的。两个案例研究(使用体育赛事的数据集)开发测试C-DSL。使用常见的数据采掘指标,如:决定系数(R2值)和混淆矩阵的两个案例研究的结果进行评估。本文提出的工作旨在重新定义生命周期,并对其结果进行切实的改进。

英文摘要:

The results of data mining endeavors are majorly driven by data quality. Throughout these deployments, serious show-stopper problems are still unresolved, such as: data collection ambiguities, data imbalance, hidden biases in data, the lack of domain information, and data incompleteness. This paper is based on the premise that context can aid in mitigating these issues. In a traditional data science lifecycle, context is not considered. Context-driven Data Science Lifecycle (C-DSL); the main contribution of this paper, is developed to address these challenges. Two case studies (using data-sets from sports events) are developed to test C-DSL. Results from both case studies are evaluated using common data mining metrics such as: coefficient of determination (R2 value) and confusion matrices. The work presented in this paper aims to re-define the lifecycle and introduce tangible improvements to its outcomes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑