arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0910.5682cs.CLcs.AI
收藏

基于可比语料库的英西对齐短语词义消歧

Word Sense Disambiguation Using English-Spanish Aligned Phrases over Comparable Corpora

UNED(西班牙国立远程教育大学)

David Fernandez-Amoros

摘要:

在本文中,我们描述了一个WSD实验的基础上双语英语-西班牙语可比语料库中的个别名词短语已被确定,并与他们各自的对应在其他语言。该实验的评估是针对SemCor进行的。我们发现,采用的对齐算法,潜在的精度是高的(74.3%),但该方法的覆盖率是低的(2.7%),由于对齐是远远低于我们预期的频率。与我们的直觉相反,精确度并不随着比对的数量而一致地上升。由于几个因素,覆盖率很低;存在重要的领域差异,并且英语和西班牙语对于这种方法来说过于接近,无法有效地区分感官,因此不适合WSD,尽管该方法在机器翻译中可能更有成效。

英文摘要:

In this paper we describe a WSD experiment based on bilingual English-Spanish comparable corpora in which individual noun phrases have been identified and aligned with their respective counterparts in the other language. The evaluation of the experiment has been carried out against SemCor. We show that, with the alignment algorithm employed, potential precision is high (74.3%), however the coverage of the method is low (2.7%), due to alignments being far less frequent than we expected. Contrary to our intuition, precision does not rise consistently with the number of alignments. The coverage is low due to several factors; there are important domain differences, and English and Spanish are too close languages for this approach to be able to discriminate efficiently between senses, rendering it unsuitable for WSD, although the method may prove more productive in machine translation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑