arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0204029cs.CL
收藏

巴斯克任务:系统是否在上界运行?

The Basque task: did systems perform in the upperbound?

Eneko Agirre, Elena Garcia, Mikel Lersundi, David Martinez, Eli Pociello

摘要:

在本文中,我们描述了Senseval 2巴斯克词汇样本任务。该任务包括40个单词(15个名词,15个动词和10个形容词),选自巴斯克语主要词典Euskal Hiztegia。大多数例子摘自《Egunkaria》报纸。用于手工标记示例的方法在仲裁之前产生了低的标记者间一致性(75%)。四个竞争系统获得的结果远高于最常见的基线,最好的系统在100%覆盖率下获得了75%的精确度。本文包括分析所使用的标记程序,以及竞争系统的性能。特别是,我们认为,标签间的协议是不是一个真正的上限巴斯克水务署的任务。

英文摘要:

In this paper we describe the Senseval 2 Basque lexical-sample task. The task comprised 40 words (15 nouns, 15 verbs and 10 adjectives) selected from Euskal Hiztegia, the main Basque dictionary. Most examples were taken from the Egunkaria newspaper. The method used to hand-tag the examples produced low inter-tagger agreement (75%) before arbitration. The four competing systems attained results well above the most frequent baseline and the best system scored 75% precision at 100% coverage. The paper includes an analysis of the tagging procedure used, as well as the performance of the competing systems. In particular, we argue that inter-tagger agreement is not a real upperbound for the Basque WSD task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑