词嵌入的拓扑:奇异性反映多义性
Topology of Word Embeddings: Singularities Reflect Polysemy
摘要:
流形假设表明,词向量存在于其周围向量空间中的子流形上。我们认为,我们应该,更准确地说,期望他们生活在一个捏流形:一个奇异的商的流形,通过确定它的一些点。识别出的奇异点对应于多义性词,即具有多重含义的词。我们的观点认为,单义词和多义词可以区分的基础上的拓扑结构的邻居。我们提出了两种经验证据来支持这一观点:(1)我们引入了一个基于持续同源的拓扑度量,它与一个词的实际意义数量有很好的相关性。(2)我们提出了一个简单的,拓扑动机的解决方案SemEval-2010任务的词义归纳和消歧,产生竞争力的结果。
英文摘要:
The manifold hypothesis suggests that word vectors live on a submanifold within their ambient vector space. We argue that we should, more accurately, expect them to live on a pinched manifold: a singular quotient of a manifold obtained by identifying some of its points. The identified, singular points correspond to polysemous words, i.e. words with multiple meanings. Our point of view suggests that monosemous and polysemous words can be distinguished based on the topology of their neighbourhoods. We present two kinds of empirical evidence to support this point of view: (1) We introduce a topological measure of polysemy based on persistent homology that correlates well with the actual number of meanings of a word. (2) We propose a simple, topologically motivated solution to the SemEval-2010 task on Word Sense Induction & Disambiguation that produces competitive results.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。