arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.06200cs.CL
收藏

基于知识的语言注释对科学嵌入质量的影响

On the Impact of Knowledge-based Linguistic Annotations in the Quality of Scientific Embeddings

Expert.ai Research Lab(Expert.ai 研究实验室)

Andres Garcia-Silva, Ronald Denaux, Jose Manuel Gomez-Perez

摘要:

从本质上讲,嵌入算法的工作原理是优化单词与其通常上下文之间的距离,以生成一个嵌入空间,对单词的分布表示进行编码。除了单个单词或单词片段之外,从文本的语言分析中产生的其他特征,包括词汇,语法和语义信息,可以用于提高嵌入空间的质量。然而,到目前为止,我们还没有精确地了解这些单独的注释及其可能的组合对嵌入质量的影响。在本文中,我们进行了全面的研究,使用显式的语言注释,从科学语料库中生成嵌入,并量化其在所产生的表示的影响。我们的研究结果表明,这种注释的嵌入效果如何根据评估任务而变化。总的来说,我们观察到使用语言注释学习嵌入有助于实现更好的评估结果。

英文摘要:

In essence, embedding algorithms work by optimizing the distance between a word and its usual context in order to generate an embedding space that encodes the distributional representation of words. In addition to single words or word pieces, other features which result from the linguistic analysis of text, including lexical, grammatical and semantic information, can be used to improve the quality of embedding spaces. However, until now we did not have a precise understanding of the impact that such individual annotations and their possible combinations may have in the quality of the embeddings. In this paper, we conduct a comprehensive study on the use of explicit linguistic annotations to generate embeddings from a scientific corpus and quantify their impact in the resulting representations. Our results show how the effect of such annotations in the embeddings varies depending on the evaluation task. In general, we observe that learning embeddings using linguistic annotations contributes to achieve better evaluation results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑