arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1705.04416cs.CL
收藏

向量空间类比模型的评价

Evaluating vector-space models of analogy

University of California, Berkeley(加州大学伯克利分校)

Dawn Chen, Joshua C. Peterson, Thomas L. Griffiths

摘要:

向量空间表示提供了几何工具,用于推理一组对象的相似性及其关系。最近的用于导出词的向量空间嵌入的机器学习方法(例如,Word2VEC)在自然语言处理中取得了相当大的成功。这些向量空间也被证明表现出惊人的能力来捕捉言语类比,对自然图像也有类似的结果,为认知科学家首次提出的平行四边形类比的经典模型赋予了新的生命。我们评估的类比模型应用于现代词嵌入,提供了一个详细的分析,在何种程度上,这种方法捕捉人类关系的相似性判断在一个大型的基准数据集。我们发现,一些语义关系比其他更好地捕捉。然后,我们提供的证据,更深层次的限制的基础上的内在几何约束的向量空间,平行的经典结果的一阶相似性的ESTA模型。

英文摘要:

Vector-space representations provide geometric tools for reasoning about the similarity of a set of objects and their relationships. Recent machine learning methods for deriving vector-space embeddings of words (e.g., word2vec) have achieved considerable success in natural language processing. These vector spaces have also been shown to exhibit a surprising capacity to capture verbal analogies, with similar results for natural images, giving new life to a classic model of analogies as parallelograms that was first proposed by cognitive scientists. We evaluate the parallelogram model of analogy as applied to modern word embeddings, providing a detailed analysis of the extent to which this approach captures human relational similarity judgments in a large benchmark dataset. We find that that some semantic relationships are better captured than others. We then provide evidence for deeper limitations of the parallelogram model based on the intrinsic geometric constraints of vector spaces, paralleling classic results for first-order similarity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑