arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.19614cs.LGcs.AI
收藏

面向机器学习的数据质量维度与工具综述

A Survey on Data Quality Dimensions and Tools for Machine Learning

University of North Texas(北得克萨斯大学)

Yuhan Zhou, Fengjiao Tu, Kewei Sha, Junhua Ding, Haihua Chen

AI总结:

本文综述了过去5年17种面向机器学习的数据质量评估与改进工具,比较其维度、指标、优势与局限,并提出开源工具路线图及大语言模型和生成式AI的应用前景。

摘要:

机器学习(ML)技术已在我们社会的几乎所有方面变得举足轻重,而数据质量(DQ)对于ML模型的性能、公平性、鲁棒性、安全性和可扩展性至关重要。在以数据为中心的人工智能中,面对大规模且复杂的数据,探索性数据分析(EDA)和交叉验证(CV)等传统方法面临挑战,这凸显了掌握DQ工具的重要性。在本综述中,我们回顾了过去5年中的17种DQ评估与改进工具。通过介绍这些工具内置的DQ维度、指标和主要功能,我们比较了它们的优势与局限,并提出了开发面向ML的开源DQ工具的路线图。基于对挑战和新兴趋势的讨论,我们进一步强调了大语言模型(LLMs)和生成式AI在面向ML的DQ评估与改进中的潜在应用。我们相信,这篇全面的综述能够加深对ML中DQ的理解,并推动以数据为中心的人工智能取得进展。本综述所调查文献的完整列表可在GitHub上获取:https://github.com/haihua0913/awesome-dq4ml。

英文摘要:

Machine learning (ML) technologies have become substantial in practically all aspects of our society, and data quality (DQ) is critical for the performance, fairness, robustness, safety, and scalability of ML models. With the large and complex data in data-centric AI, traditional methods like exploratory data analysis (EDA) and cross-validation (CV) face challenges, highlighting the importance of mastering DQ tools. In this survey, we review 17 DQ evaluation and improvement tools in the last 5 years. By introducing the DQ dimensions, metrics, and main functions embedded in these tools, we compare their strengths and limitations and propose a roadmap for developing open-source DQ tools for ML. Based on the discussions on the challenges and emerging trends, we further highlight the potential applications of large language models (LLMs) and generative AI in DQ evaluation and improvement for ML. We believe this comprehensive survey can enhance understanding of DQ in ML and could drive progress in data-centric AI. A complete list of the literature investigated in this survey is available on GitHub at: https://github.com/haihua0913/awesome-dq4ml.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑