arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.01804cs.CLcs.AIcs.LGcs.NE
收藏

神经词嵌入研究综述

A Survey On Neural Word Embeddings

Izmir Institute of Technology(伊兹密尔理工学院)

Erhan Sezerer, Selma Tekir

摘要:

理解人类语言一直是智能机器道路上的一个子挑战。自然语言处理中的意义研究依赖于分布假设,即语言元素从上下文中共同出现的单词中获得意义。概念的分布式表征这一革命性的想法与人类思维的工作方式非常接近,因为一个单词的含义分散在几个神经元中,而失去激活只会轻微影响记忆提取过程。神经词嵌入通过在所有NLP任务中引入实质性的改进,改变了整个NLP领域。在这项调查中,我们提供了一个全面的文献综述神经词嵌入。我们给出了理论基础,并描述了现有的工作之间的相互作用词嵌入和语言建模。我们提供了广泛的覆盖神经词嵌入,包括早期的词嵌入,嵌入针对特定的语义关系,意义嵌入,词素嵌入,最后,上下文表示。最后,我们描述了字嵌入的性能评估和下游任务中的基准数据集以及词嵌入的性能结果。

英文摘要:

Understanding human language has been a sub-challenge on the way of intelligent machines. The study of meaning in natural language processing (NLP) relies on the distributional hypothesis where language elements get meaning from the words that co-occur within contexts. The revolutionary idea of distributed representation for a concept is close to the working of a human mind in that the meaning of a word is spread across several neurons, and a loss of activation will only slightly affect the memory retrieval process. Neural word embeddings transformed the whole field of NLP by introducing substantial improvements in all NLP tasks. In this survey, we provide a comprehensive literature review on neural word embeddings. We give theoretical foundations and describe existing work by an interplay between word embeddings and language modelling. We provide broad coverage on neural word embeddings, including early word embeddings, embeddings targeting specific semantic relations, sense embeddings, morpheme embeddings, and finally, contextual representations. Finally, we describe benchmark datasets in word embeddings' performance evaluation and downstream tasks along with the performance results of/due to word embeddings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑