介绍 OmniGEC:一个用于语法错误纠正的多语言银标数据集
Introducing OmniGEC: A Silver Multilingual Dataset for Grammatical Error Correction
AI总结:
本文提出覆盖11种语言的多语言银标语法纠错数据集 OmniGEC,融合维基百科人工修正与 GPT-4o-mini 自动纠正数据,并基于其微调两个开源大模型取得段落级多语言 GEC 的 SOTA 结果。
摘要:
在本文中,我们介绍了 OmniGEC,这是一个面向语法错误纠正(GEC)任务的多语言银标数据集集合,覆盖十一种语言:捷克语、英语、爱沙尼亚语、德语、希腊语、冰岛语、意大利语、拉脱维亚语、斯洛文尼亚语、瑞典语和乌克兰语。这些数据集有助于开发多语言 GEC 解决方案,并有助于弥合在将英语 GEC 解决方案适配到多语言 GEC 时的数据差距。数据集中的文本来源于三个渠道:十一种目标语言的维基百科编辑、十一种目标语言的 Reddit 子版块,以及仅包含乌克兰语的 UberText 2.0 社交媒体语料库。维基百科编辑来源于人工修正,而 Reddit 和 UberText 2.0 数据则使用 GPT-4o-mini 模型自动纠正。数据集中的纠正质量经过了自动和人工两种方式的评估。最后,我们在多语言 OmniGEC 语料库上微调了两个开源大语言模型——Aya-Expanse(8B)和 Gemma-3(12B),并在段落级多语言 GEC 上取得了最先进(SOTA)的结果。数据集集合和性能最佳的模型已在 Hugging Face 上提供。
英文摘要:
In this paper, we introduce OmniGEC, a collection of multilingual silver-standard datasets for the task of Grammatical Error Correction (GEC), covering eleven languages: Czech, English, Estonian, German, Greek, Icelandic, Italian, Latvian, Slovene, Swedish, and Ukrainian. These datasets facilitate the development of multilingual GEC solutions and help bridge the data gap in adapting English GEC solutions to multilingual GEC. The texts in the datasets originate from three sources: Wikipedia edits for the eleven target languages, subreddits from Reddit in the eleven target languages, and the Ukrainian-only UberText 2.0 social media corpus. While Wikipedia edits were derived from human-made corrections, the Reddit and UberText 2.0 data were automatically corrected with the GPT-4o-mini model. The quality of the corrections in the datasets was evaluated both automatically and manually. Finally, we fine-tune two open-source large language models - Aya-Expanse (8B) and Gemma-3 (12B) - on the multilingual OmniGEC corpora and achieve state-of-the-art (SOTA) results for paragraph-level multilingual GEC. The dataset collection and the best-performing models are available on Hugging Face.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。