Context: Machine Learning (ML) is integrated into a growing number of systems for various applications. Because the performance of an ML model is highly dependent on the quality of the data it has been trained on, there is a growing interest in approaches to detect and repair data errors (i.e., data cleaning). Researchers are also exploring how ML can be used for data cleaning; hence creating a dual relationship between ML and data cleaning. To the best of our knowledge, there is no study that comprehensively reviews this relationship. Objective: This paper's objectives are twofold. First, it aims to summarize the latest approaches for data cleaning for ML and ML for data cleaning. Second, it provides future work recommendations. Method: We conduct a systematic literature review of the papers published between 2016 and 2022 inclusively. We identify different types of data cleaning activities with and for ML: feature cleaning, label cleaning, entity matching, outlier detection, imputation, and holistic data cleaning. Results: We summarize the content of 101 papers covering various data cleaning activities and provide 24 future work recommendations. Our review highlights many promising data cleaning techniques that can be further extended. Conclusion: We believe that our review of the literature will help the community develop better approaches to clean data.
数据清理通常是确保预测模型(如回归和分类)不受系统错误(如不一致、过时或离群数据)影响的重要步骤。识别脏数据通常是一个手动和迭代的过程,并且在大型数据集上可能具有挑战性。然而,由于违反了独立性假设,许多数据清洗工作流可能会在训练过程中引入微妙的偏差。我们提出了ActiveClean,这是一种渐进式清理方法,其中模型是增量更新的,而不是重新训练,并且可以保证部分清理数据的准确性。ActiveClean支持一类流行的模型,称为凸损失模型(例如,线性回归和SVM)。ActiveClean还利用用户模型的结构来优先清理那些可能影响结果的记录。我们在五个真实世界的数据集UCI Adult,UCI EEG,MNIST,Dollars For Money和Worldbank上评估了ActiveClean的真实和合成误差。我们的研究结果表明,我们提出的优化可以将模型准确性提高2.5倍,而数据量相同。此外,对于固定的清理预算和所有真实的脏数据集,ActiveClean返回的模型比均匀采样和主动学习更准确。
University of Basel(巴塞尔大学);Lucerne University of Applied Sciences and Arts(卢塞恩应用科学大学);University Hospital of Basel(巴塞尔大学医院);Northwestern University(西北大学);Northeast Dermatology Associates(东北皮肤科诊所);Medical University of Vienna(维也纳医科大学);Banner Health(Banner健康系统)
Explainable Artificial Intelligence: a Systematic Review
School of Computer Science, College of Science and Health, Technological University Dublin(都柏林理工大学科学与健康学院计算机科学学院);Technological University Dublin(都柏林理工大学)
Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages
Trinity Centre for Global Health(三一全球健康中心);School of Psychology(心理学院);Trinity College Dublin(都柏林圣三一学院);University of York(约克大学)