arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1405.3515cs.CL
收藏

基于神经语言模型的语言时序分析

Temporal Analysis of Language through Neural Language Models

New York University(纽约大学);Google Inc.(谷歌公司)

Yoon Kim, Yi-I Chiu, Kentaro Hanaki, Darshan Hegde, Slav Petrov

摘要:

我们提供了一种通过按时间顺序训练的神经语言模型自动检测语言随时间变化的方法。我们在Google Books Ngram语料库上对模型进行训练,以获得特定于每一年的词向量表示,并识别出从1900年到2009年发生了显著变化的词。该模型将诸如“cell”和“gay”之类的词识别为在该时间段内发生了变化。该模型同时确定了这些词发生变化的具体年份。

英文摘要:

We provide a method for automatically detecting change in language across time through a chronologically trained neural language model. We train the model on the Google Books Ngram corpus to obtain word vector representations specific to each year, and identify words that have changed significantly from 1900 to 2009. The model identifies words such as "cell" and "gay" as having changed during that time period. The model simultaneously identifies the specific years during which such words underwent change.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑