arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.02848cs.LGcs.AIcs.SE
收藏

一种用于描述机器学习数据集的领域特定语言

A domain-specific language for describing machine learning datasets

ICREA(加泰罗尼亚高等研究院)

Joan Giner-Miguelez, Abel Gómez, Jordi Cabot

AI总结:

本文提出一种用于精确描述机器学习数据集结构、来源和社会关切的领域特定语言,并以VS Code插件形式开源发布,以支持以数据为中心的机器学习实践。

摘要:

数据集在机器学习(ML)模型的训练和评估中发挥着核心作用。但它们也是许多不良模型行为(例如有偏预测)的根本原因。为了改变这一状况,机器学习社区正在推动一种以数据为中心的文化转变,使数据问题得到应有的重视,并开始讨论和建立围绕数据集收集与处理的更标准化的实践。迄今为止,这些提议大多是使用自然语言描述的高层指导方针,因此难以形式化并应用于具体的数据集。鉴于此,并受这些提议的启发,我们定义了一种新的领域特定语言(DSL),用于从数据集的结构、数据来源和社会关切等方面精确描述机器学习数据集。我们相信,这种DSL将有助于任何机器学习项目利用并受益于机器学习领域中以数据为中心的转变(例如,为新项目选择最合适的数据集,或更好地复现其他机器学习结果)。该DSL已实现为一个Visual Studio Code插件,并以开源许可证发布。

英文摘要:

Datasets play a central role in the training and evaluation of machine learning (ML) models. But they are also the root cause of many undesired model behaviors, such as biased predictions. To overcome this situation, the ML community is proposing a data-centric cultural shift where data issues are given the attention they deserve, and more standard practices around the gathering and processing of datasets start to be discussed and established. So far, these proposals are mostly high-level guidelines described in natural language and, as such, they are difficult to formalize and apply to particular datasets. In this sense, and inspired by these proposals, we define a new domain-specific language (DSL) to precisely describe machine learning datasets in terms of their structure, data provenance, and social concerns. We believe this DSL will facilitate any ML initiative to leverage and benefit from this data-centric shift in ML (e.g., selecting the most appropriate dataset for a new project or better replicating other ML results). The DSL is implemented as a Visual Studio Code plugin, and it has been published under an open source license.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑