arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.10445cs.CLcs.AI
收藏

基于词源的词嵌入的同义词发现

Synonym Discovery with Etymology-based Word Embeddings

Seoul National University(首尔大学);Google Inc.(谷歌公司)

Seunghyun Yoon, Pablo Estrada, Kyomin Jung

摘要:

我们提出了一种新的方法来学习词嵌入的基础上扩展版本的分布假设。我们的模型使用单词的词源组成而不是它们出现的上下文来推导词嵌入向量。它的优点是不需要大型文本语料库,但它需要可靠地访问单词的词源,使其特别适合于具有语标书写系统的语言。该模型包括三个步骤:(1)建立词源图,它是一个由词和词根组成的二分网络;(2)获得词源图的双邻接矩阵并对其进行降维;(3)将所得矩阵的列/行作为嵌入向量。我们测试我们的模型在中国和中韩词汇。我们的图由一组117,000个中文单词和一组135,000个中韩单词组成。在这两种情况下,我们表明,我们的模型表现良好的同义词发现的任务。

英文摘要:

We propose a novel approach to learn word embeddings based on an extended version of the distributional hypothesis. Our model derives word embedding vectors using the etymological composition of words, rather than the context in which they appear. It has the strength of not requiring a large text corpus, but instead it requires reliable access to etymological roots of words, making it specially fit for languages with logographic writing systems. The model consists on three steps: (1) building an etymological graph, which is a bipartite network of words and etymological roots, (2) obtaining the biadjacency matrix of the etymological graph and reducing its dimensionality, (3) using columns/rows of the resulting matrices as embedding vectors. We test our model in the Chinese and Sino-Korean vocabularies. Our graphs are formed by a set of 117,000 Chinese words, and a set of 135,000 Sino-Korean words. In both cases we show that our model performs well in the task of synonym discovery.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑