约鲁巴语嵌入中的变音符号的挑战
The Challenge of Diacritics in Yoruba Embeddings
摘要：
这项工作的主要贡献包括经验建立一个更好的性能约鲁巴语嵌入未变音符号（规范化）的数据集和提供新的类比集进行评估。约鲁巴语是一种音调语言，以书面形式使用变音符号（音调标记）。我们表明，这会影响嵌入性能，从完全相同的维基百科数据集创建嵌入，但第二个规范化为undiacritized。我们进一步比较平均内在性能与其他两个工作（使用类比测试集& WordSim），我们得到最好的性能在WordSim和相应的斯皮尔曼相关。
英文摘要：
The major contributions of this work include the empirical establishment of a better performance for Yoruba embeddings from undiacritized (normalized) dataset and provision of new analogy sets for evaluation. The Yoruba language, being a tonal language, utilizes diacritics (tonal marks) in written form. We show that this affects embedding performance by creating embeddings from exactly the same Wikipedia dataset but with the second one normalized to be undiacritized. We further compare average intrinsic performance with two other work (using analogy test set & WordSim) and we obtain the best performance in WordSim and corresponding Spearman correlation.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
