真是个书呆子!ESL和TOEFL数据集中的Beating Students和矢量余弦
What a Nerd! Beating Students and Vector Cosine in the ESL and TOEFL Datasets
摘要:
在本文中,我们声称,向量余弦,这通常被认为是最有效的无监督的措施之一,用于识别词的相似性在向量空间模型,可以优于一个完全无监督的措施,评估的程度之间的交集最相关的两个目标词的上下文,加权这种交集根据排名的依赖排名列表中的共享上下文。这一说法来自于这样一个假设,即相似的词不仅仅出现在相似的语境中,而且与其他相关词相比,它们共享更大部分最相关的语境。为了证明这一点,我们描述和评估APSyn,平均精度的一个变体,独立于所采用的参数,优于矢量余弦和ESL和托福考试集上的同现。在最佳设置下,APSyn在ESL数据集上的准确率达到0.73,在TOEFL数据集上的准确率达到0.70,因此击败了非英语美国大学申请者(据文献报道,其平均值为64.50%)和几种最先进的方法。
英文摘要:
In this paper, we claim that Vector Cosine, which is generally considered one of the most efficient unsupervised measures for identifying word similarity in Vector Space Models, can be outperformed by a completely unsupervised measure that evaluates the extent of the intersection among the most associated contexts of two target words, weighting such intersection according to the rank of the shared contexts in the dependency ranked lists. This claim comes from the hypothesis that similar words do not simply occur in similar contexts, but they share a larger portion of their most relevant contexts compared to other related words. To prove it, we describe and evaluate APSyn, a variant of Average Precision that, independently of the adopted parameters, outperforms the Vector Cosine and the co-occurrence on the ESL and TOEFL test sets. In the best setting, APSyn reaches 0.73 accuracy on the ESL dataset and 0.70 accuracy in the TOEFL dataset, beating therefore the non-English US college applicants (whose average, as reported in the literature, is 64.50%) and several state-of-the-art approaches.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。