EPIE数据集:一个可能的习语语料库
EPIE Dataset: A Corpus For Possible Idiomatic Expressions
摘要:
习惯表达一直是语言理解和自然语言理解的瓶颈,特别是对于机器翻译(MT)这样的任务。机器翻译系统主要产生习语表达的直译,因为它们不表现出通用的和语言上确定的模式,可以用来理解表达的非成分意义。这些表达出现在用于训练的平行语料库中,但由于习语的组成词在字面语境中的出现率相对较高,习语意义被表达的组成意义所压倒。现有的隐喻检测系统能够检测出非组合词的使用,但却忽略了特殊的短语表达。这就迫切需要一个覆盖范围更广、经常出现的惯用表达出现率更高的数据集,其跨度可用于隐喻检测。考虑到这一点,我们提出了我们的英语可能的习语表达(EPIE)语料库包含25206个句子标记的词汇实例717个习语表达。这些span还涵盖了给定惯用表达式集的字面用法。我们还介绍了我们的数据集的实用性,通过使用它来训练序列标签模块和测试三个独立的数据集具有高准确度,精确度和召回分数。
英文摘要:
Idiomatic expressions have always been a bottleneck for language comprehension and natural language understanding, specifically for tasks like Machine Translation(MT). MT systems predominantly produce literal translations of idiomatic expressions as they do not exhibit generic and linguistically deterministic patterns which can be exploited for comprehension of the non-compositional meaning of the expressions. These expressions occur in parallel corpora used for training, but due to the comparatively high occurrences of the constituent words of idiomatic expressions in literal context, the idiomatic meaning gets overpowered by the compositional meaning of the expression. State of the art Metaphor Detection Systems are able to detect non-compositional usage at word level but miss out on idiosyncratic phrasal idiomatic expressions. This creates a dire need for a dataset with a wider coverage and higher occurrence of commonly occurring idiomatic expressions, the spans of which can be used for Metaphor Detection. With this in mind, we present our English Possible Idiomatic Expressions(EPIE) corpus containing 25206 sentences labelled with lexical instances of 717 idiomatic expressions. These spans also cover literal usages for the given set of idiomatic expressions. We also present the utility of our dataset by using it to train a sequence labelling module and testing on three independent datasets with high accuracy, precision and recall scores.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。