arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.01830cs.CLq-bio.NC
收藏

分布语义模型的神经生物学理据分析

A Neurobiologically Motivated Analysis of Distributional Semantic Models

The University of Electro-Communications(电子通信大学)

Akira Utsumi

摘要:

分布式语义模型或词嵌入在各种研究领域中的广泛使用是由于它们在实际应用和认知建模中表示词的含义的显着能力。然而,很少有人知道什么样的信息是编码在基于文本的词向量。当词向量被视为抽象概念的语义表示模型时,这种理解的缺乏尤其成问题。本文利用Binder等人的分析方法,试图揭示分布词向量的内在信息。’s(2016)brain-based vectors,基于神经生物学动机属性的显式结构化概念表征。在分析中,训练从基于文本的向量到基于大脑的向量的映射,并通过比较估计的和原始的基于大脑的向量来评估预测性能。分析表明,社会和认知信息更好地编码在基于文本的词向量,但情感信息不是。这一结果将从抽象概念的具身理论的角度进行讨论。

英文摘要:

The pervasive use of distributional semantic models or word embeddings in a variety of research fields is due to their remarkable ability to represent the meanings of words for both practical application and cognitive modeling. However, little has been known about what kind of information is encoded in text-based word vectors. This lack of understanding is particularly problematic when word vectors are regarded as a model of semantic representation for abstract concepts. This paper attempts to reveal the internal information of distributional word vectors by the analysis using Binder et al.'s (2016) brain-based vectors, explicitly structured conceptual representations based on neurobiologically motivated attributes. In the analysis, the mapping from text-based vectors to brain-based vectors is trained and prediction performance is evaluated by comparing the estimated and original brain-based vectors. The analysis demonstrates that social and cognitive information is better encoded in text-based word vectors, but emotional information is not. This result is discussed in terms of embodied theories for abstract concepts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑