基于SAT的波斯语词嵌入类比评价框架
SAT Based Analogy Evaluation Framework for Persian Word Embeddings
摘要:
近年来,词嵌入作为一种将词转换为向量的新方法引起了人们的特别兴趣。如何理解词的语义有多少被转化到嵌入向量中已经成为一个焦点。这一点很重要,因为嵌入将被用作下游NLP应用程序的基础,并且端到端评估应用程序以识别所使用的嵌入模型的质量将是昂贵的。一般来说,词嵌入是通过一系列测试来评估的,包括类比测试。在本文中,我们提出了一个波斯语嵌入模型的测试框架。波斯语是一种低资源语言,没有丰富的语义基准来评估这种语言的词嵌入模型。在本文中,我们介绍了一个评估框架,包括手工制作的波斯SAT的类比数据集,colliquial测试集(特定于波斯语)和基准研究的语义评估任务的各种参数的影响。
英文摘要:
In recent years there has been a special interest in word embeddings as a new approach to convert words to vectors. It has been a focal point to understand how much of the semantics of the the words has been transferred into embedding vectors. This is important as the embedding is going to be used as the basis for downstream NLP applications and it will be costly to evaluate the application end-to-end in order to identify quality of the used embedding model. Generally the word embeddings are evaluated through a number of tests, including analogy test. In this paper we propose a test framework for Persian embedding models. Persian is a low resource language and there is no rich semantic benchmark to evaluate word embedding models for this language. In this paper we introduce an evaluation framework including a hand crafted Persian SAT based analogy dataset, a colliquial test set (specific to Persian) and a benchmark to study the impact of various parameters on the semantic evaluation task.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。