针对四种非洲语言的FLORES评估数据集修正
Correcting FLORES Evaluation Dataset for Four African Languages
AI总结：
针对FLORES评估数据集中四种非洲语言存在的不准确问题，通过母语人士细致审查完成数据集修正并开展统计分析，提升了数据可靠性，为相关NLP任务的有效评估提供支撑。
摘要：
本文阐述了对四种非洲语言——豪萨语、北索托语（Sepedi）、聪加语（Xitsonga）和祖鲁语（isiZulu）——的FLORES评估数据集（开发集与开发测试集）所做的修正工作。原始数据集尽管在低资源语言覆盖方面具有开创性，但在所审查的语言中存在各类不一致与不准确之处，可能会损害自然语言处理（NLP）下游任务（尤其是机器翻译）评估的完整性。通过母语人士开展的细致审查流程，研究团队识别并落实了多项修正，提升了数据集的整体质量与可靠性。针对每种语言，本文均提供了所发现并修正的错误的简要总结，同时呈现了衡量现有数据集与修正后数据集之间差异的统计分析结果。我们认为这些修正提升了数据的语言准确性与可靠性，进而有助于更有效地评估涉及这四种非洲语言的NLP任务。最后，本文建议未来的翻译工作（尤其是低资源语言的翻译工作）应优先让母语人士积极参与流程的每个阶段，以确保语言准确性与文化相关性。
英文摘要：
This paper describes the corrections made to the FLORES evaluation (dev and devtest) dataset for four African languages, namely Hausa, Northern Sotho (Sepedi), Xitsonga, and isiZulu. The original dataset, though groundbreaking in its coverage of low-resource languages, exhibited various inconsistencies and inaccuracies in the reviewed languages that could potentially hinder the integrity of the evaluation of downstream tasks in natural language processing (NLP), especially machine translation. Through a meticulous review process by native speakers, several corrections were identified and implemented, improving the overall quality and reliability of the dataset. For each language, we provide a concise summary of the errors encountered and corrected and also present some statistical analysis that measures the difference between the existing and corrected datasets. We believe that our corrections improve the linguistic accuracy and reliability of the data and, thereby, contribute to a more effective evaluation of NLP tasks involving the four African languages. Finally, we recommend that future translation efforts, particularly in low-resource languages, prioritize the active involvement of native speakers at every stage of the process to ensure linguistic accuracy and cultural relevance.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
