arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1912.01795cs.CLcs.AI
收藏

多语言义素知识库的建立:BabelNet同义词集的义素预测

Towards Building a Multilingual Sememe Knowledge Base: Predicting Sememes for BabelNet Synsets

Tsinghua University(清华大学);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心);Beijing University of Posts and Telecommunications(北京邮电大学);Jiangsu Normal University(江苏师范大学)

Fanchao Qi, Liang Chang, Maosong Sun, Sicong Ouyang, Zhiyuan Liu

摘要:

义位是人类语言的最小语义单位。义素知识库(KBs),其中包含的词与义素注释,已成功地应用于许多NLP任务。然而,现有的义素知识库都是建立在少数几种语言上的,这阻碍了它们的广泛应用。为了解决这个问题,我们建议建立一个统一的义素知识库,为多种语言的基础上BabelNet,一个多语种的词典。我们首先建立一个数据集作为种子的多语言义素KB。它手动注释超过$15$千个同义词集(BabelNet的条目)的义位。然后,我们提出了一个新的任务自动义位预测同义词集,旨在扩大种子数据集到一个可用的知识库。我们还提出了两个简单而有效的模型,利用不同的信息的同义词集。最后,我们进行了定量和定性分析,以探索任务的重要因素和困难。本工作的所有源代码和数据可以在https://github.com/thunlp/BabelNet-Sememe-Prediction上获得。

英文摘要:

A sememe is defined as the minimum semantic unit of human languages. Sememe knowledge bases (KBs), which contain words annotated with sememes, have been successfully applied to many NLP tasks. However, existing sememe KBs are built on only a few languages, which hinders their widespread utilization. To address the issue, we propose to build a unified sememe KB for multiple languages based on BabelNet, a multilingual encyclopedic dictionary. We first build a dataset serving as the seed of the multilingual sememe KB. It manually annotates sememes for over $15$ thousand synsets (the entries of BabelNet). Then, we present a novel task of automatic sememe prediction for synsets, aiming to expand the seed dataset into a usable KB. We also propose two simple and effective models, which exploit different information of synsets. Finally, we conduct quantitative and qualitative analyses to explore important factors and difficulties in the task. All the source code and data of this work can be obtained on https://github.com/thunlp/BabelNet-Sememe-Prediction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑