arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.19256cs.AI
收藏

用于量化评估AI数据就绪度的AI数据就绪度检查器(AIDRIN)

AI Data Readiness Inspector (AIDRIN) for Quantitative Assessment of Data Readiness for AI

The Ohio State University(俄亥俄州立大学);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);Argonne National Laboratory(阿贡国家实验室)

Kaveen Hiniduma, Suren Byna, Jean Luca Bez, Ravi Madduri

AI总结:

本文提出AIDRIN框架,通过传统数据质量指标与AI专属指标(如特征重要性、公平性、隐私、FAIR合规性)定量评估数据就绪度,并提供可视化报告以提升机器学习流水线决策效率。

摘要:

“垃圾进,垃圾出”是包括人工智能(AI)在内的各个领域计算机科学家普遍认同的一句话。由于数据是AI的燃料,在低质量、有偏见的数据上训练的模型往往效果不佳。使用AI的计算机科学家在准备AI数据方面投入了大量时间和精力。然而,目前没有标准方法或框架来评估数据对AI的“就绪度”。为了对AI过程的数据就绪度提供可量化的评估,我们定义了AI数据就绪度的参数,并引入了AIDRIN(AI Data Readiness Inspector,AI数据就绪度检查器)。AIDRIN是一个框架,涵盖了文献中可用的广泛就绪度维度,有助于定量和定性地评估数据就绪度。AIDRIN使用传统数据质量评估中的指标,如完整性、异常值和重复项来进行数据评估。此外,AIDRIN还使用专门用于评估AI数据的指标,例如特征重要性、特征相关性、类别不平衡、公平性、隐私性以及FAIR(可发现性、可访问性、互操作性和可重用性)原则合规性。AIDRIN提供可视化和报告,以帮助数据科学家进一步调查数据就绪度。AIDRIN框架提高了机器学习流水线的效率,以便为AI应用做出关于数据就绪度的明智决策。

英文摘要:

"Garbage In Garbage Out" is a universally agreed quote by computer scientists from various domains, including Artificial Intelligence (AI). As data is the fuel for AI, models trained on low-quality, biased data are often ineffective. Computer scientists who use AI invest a considerable amount of time and effort in preparing the data for AI. However, there are no standard methods or frameworks for assessing the "readiness" of data for AI. To provide a quantifiable assessment of the readiness of data for AI processes, we define parameters of AI data readiness and introduce AIDRIN (AI Data Readiness Inspector). AIDRIN is a framework covering a broad range of readiness dimensions available in the literature that aid in evaluating the readiness of data quantitatively and qualitatively. AIDRIN uses metrics in traditional data quality assessment such as completeness, outliers, and duplicates for data evaluation. Furthermore, AIDRIN uses metrics specific to assess data for AI, such as feature importance, feature correlations, class imbalance, fairness, privacy, and FAIR (Findability, Accessibility, Interoperability, and Reusability) principle compliance. AIDRIN provides visualizations and reports to assist data scientists in further investigating the readiness of data. The AIDRIN framework enhances the efficiency of the machine learning pipeline to make informed decisions on data readiness for AI applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑