arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.10258cs.CL
收藏

为公平AI策划具备全球视角的落地式合成数据

Curating Grounded Synthetic Data with Global Perspectives for Equitable AI

Emergent Methods(新兴方法机构)

Elin Törnquist, Robert Alexander Caulk

AI总结:

本研究针对传统数据集表征不足问题,提出基于12种语言125国新闻、通过主题多样化等手段生成落地式合成数据的方法,在NER基准上性能最高提升7.3%,并提供了经策划的NER数据集,为公平AI发展提供数据支撑。

摘要:

鲁棒AI模型的开发高度依赖可用训练数据的质量与多样性。在数据稀缺问题普遍存在的领域,合成数据生成提供了关键解决方案。本文提出一种创建合成数据集的新方法,该方法以现实世界多样性为基础,并通过策略性多样化手段进行丰富。我们使用涵盖12种语言、来自125个国家的大量新闻文章合成数据,以确保语言和文化表征的广度。通过强制主题多样化、翻译和摘要处理,生成的数据集准确反映了现实世界的复杂性,解决了传统数据集中的表征不足问题。该方法最初应用于命名实体识别(Named Entity Recognition, NER),可为众多AI学科提供参考范式——在这些学科中,数据多样化对模型泛化能力至关重要。初步结果显示,该方法在传统NER基准上的性能提升最高达7.3%,凸显了我们的合成数据在模拟全球数据源丰富多样的细微差别方面的有效性。本文概述了合成多样化数据集所采用的策略,并提供了一个经策划的NER专用数据集。

英文摘要:

The development of robust AI models relies heavily on the quality and variety of training data available. In fields where data scarcity is prevalent, synthetic data generation offers a vital solution. In this paper, we introduce a novel approach to creating synthetic datasets, grounded in real-world diversity and enriched through strategic diversification. We synthesize data using a comprehensive collection of news articles spanning 12 languages and originating from 125 countries, to ensure a breadth of linguistic and cultural representations. Through enforced topic diversification, translation, and summarization, the resulting dataset accurately mirrors real-world complexities and addresses the issue of underrepresentation in traditional datasets. This methodology, applied initially to Named Entity Recognition (NER), serves as a model for numerous AI disciplines where data diversification is critical for generalizability. Preliminary results demonstrate substantial improvements in performance on traditional NER benchmarks, by up to 7.3%, highlighting the effectiveness of our synthetic data in mimicking the rich, varied nuances of global data sources. This paper outlines the strategies employed for synthesizing diverse datasets and provides such a curated dataset for NER.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑