arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.00761cs.CL
收藏

利用时空信息丰富词嵌入

Enriching Word Embeddings with Temporal and Spatial Information

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Hongyu Gong, Suma Bhat, Pramod Viswanath

摘要:

一个词的意义与社会文化因素密切相关,这些因素会随着时间和地点的变化而变化,从而导致相应的意义变化。在广泛使用的语言(如英语)中对单词及其含义进行全面的审视,可能需要我们捕捉更精确的语义,以用于特定时间或位置感知的情况,如文化趋势或语言使用的研究。然而,流行的词的矢量表示不充分包括时间或空间信息。在这项工作中,我们提出了一个模型,学习单词表示条件的时间和位置。除了捕捉随着时间和地点的意义变化,我们要求得到的词嵌入保留突出的语义和几何属性。我们训练我们的模型上的时间和位置标记语料库,并使用定量和定性的评估,它可以捕捉跨时间和地点的语义。我们注意到,我们的模型与特定时间嵌入的最新技术相比毫不逊色,并作为特定位置嵌入的新基准。

英文摘要:

The meaning of a word is closely linked to sociocultural factors that can change over time and location, resulting in corresponding meaning changes. Taking a global view of words and their meanings in a widely used language, such as English, may require us to capture more refined semantics for use in time-specific or location-aware situations, such as the study of cultural trends or language use. However, popular vector representations for words do not adequately include temporal or spatial information. In this work, we present a model for learning word representation conditioned on time and location. In addition to capturing meaning changes over time and location, we require that the resulting word embeddings retain salient semantic and geometric properties. We train our model on time- and location-stamped corpora, and show using both quantitative and qualitative evaluations that it can capture semantics across time and locations. We note that our model compares favorably with the state-of-the-art for time-specific embedding, and serves as a new benchmark for location-specific embeddings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑