arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0508053cs.LGcs.CLcs.IR
收藏

基于潜在关系分析的语义相似度度量

Measuring Semantic Similarity by Latent Relational Analysis

Peter D. Turney

摘要:

本文介绍了潜在关系分析(LRA),一种测量语义相似度的方法。LRA度量两对词之间语义关系的相似性。当两对具有高度的关系相似性时,它们是相似的。例如,对cat:meow类似于对dog:bark。认知科学有证据表明,关系相似性是许多认知和语言任务的基础(例如,类比推理)。在向量空间模型(VSM)方法来测量关系的相似性,两对之间的相似性是由代表两对向量之间的夹角的余弦计算。向量中的元素基于大型语料库中手动构建的模式的频率。LRA以三种方式扩展了VSM方法:(1)模式自动从语料库中导出,(2)奇异值分解用于平滑频率数据,以及(3)同义词用于重新表达单词对。本文介绍了LRA算法和实验比较LRA VSM两个任务,回答大学水平的多项选择词类比问题和分类名词修饰语表达的语义关系。LRA实现了最先进的结果,在类比问题上达到了人类水平的表现,并且在两项任务上都大大超过了VSM的表现。

英文摘要:

This paper introduces Latent Relational Analysis (LRA), a method for measuring semantic similarity. LRA measures similarity in the semantic relations between two pairs of words. When two pairs have a high degree of relational similarity, they are analogous. For example, the pair cat:meow is analogous to the pair dog:bark. There is evidence from cognitive science that relational similarity is fundamental to many cognitive and linguistic tasks (e.g., analogical reasoning). In the Vector Space Model (VSM) approach to measuring relational similarity, the similarity between two pairs is calculated by the cosine of the angle between the vectors that represent the two pairs. The elements in the vectors are based on the frequencies of manually constructed patterns in a large corpus. LRA extends the VSM approach in three ways: (1) patterns are derived automatically from the corpus, (2) Singular Value Decomposition is used to smooth the frequency data, and (3) synonyms are used to reformulate word pairs. This paper describes the LRA algorithm and experimentally compares LRA to VSM on two tasks, answering college-level multiple-choice word analogy questions and classifying semantic relations in noun-modifier expressions. LRA achieves state-of-the-art results, reaching human-level performance on the analogy questions and significantly exceeding VSM performance on both tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑