arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.02285cs.CL
收藏

英语和瑞典语中未记录词义的检测

Detection of Non-recorded Word Senses in English and Swedish

University of Stuttgart(斯图加特大学);University of Gothenburg(哥德堡大学);University de Genève(日内瓦大学)

Jonathan Lautenschlager, Emma Sköldberg, Simon Hengchen, Dominik Schlechtweg

AI总结:

本研究针对英语和瑞典语未知词义检测任务,采用预训练Word-in-Context嵌入器在少样本场景下比对词典词义与语料库词用,经人工标注调参与5折交叉验证,模型大幅提升了未记录词义用法的检出量。

摘要:

本研究针对英语和瑞典语中的未知词义检测任务展开。该任务的核心目标是判断某一单词的特定用法含义是否已被词典收录。为此,我们利用预训练的Word-in-Context(上下文中的词)嵌入器,将词义条目与来自现代及历史语料库的单词用法进行比对,该嵌入器支持我们在少样本场景下对该任务建模。此外,我们借助目标语料库上的人工标注调整超参数,并通过5折交叉验证评估模型。与语料库的随机样本相比,我们的模型能大幅提升未记录词义的单词用法的检出数量。

英文摘要:

This study addresses the task of Unknown Sense Detection in English and Swedish. The primary objective of this task is to determine whether the meaning of a particular word usage is documented in a dictionary or not. For this purpose, sense entries are compared with word usages from modern and historical corpora using a pre-trained Word-in-Context embedder that allows us to model this task in a few-shot scenario. Additionally, we use human annotations on the target corpora to adapt hyperparameters and evaluate our models using 5-fold cross-validation. Compared to a random sample from a corpus, our model is able to considerably increase the detected number of word usages with non-recorded senses.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑