arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1705.00441cs.CL
收藏

学习主题敏感的单词表示

Learning Topic-Sensitive Word Representations

Informatics Institute, University of Amsterdam(阿姆斯特丹大学信息学院)

Marzieh Fadaee, Arianna Bisazza, Christof Monz

摘要:

分布式单词表示广泛用于NLP任务中的单词建模。大多数现有的模型生成一个表示每个字,不考虑不同的含义的一个字。我们提出了两种方法来学习多个主题敏感的表示,每个词使用分层Dirichlet过程。我们观察到,通过对每个文档的主题建模和整合主题分布,我们获得了能够区分给定单词的不同含义的表示。我们的模型产生统计上显着的改进,词汇替代任务表明,常用的单个单词表示,即使与上下文信息相结合,是不够的,这项任务。

英文摘要:

Distributed word representations are widely used for modeling words in NLP tasks. Most of the existing models generate one representation per word and do not consider different meanings of a word. We present two approaches to learn multiple topic-sensitive representations per word by using Hierarchical Dirichlet Process. We observe that by modeling topics and integrating topic distributions for each document we obtain representations that are able to distinguish between different meanings of a given word. Our models yield statistically significant improvements for the lexical substitution task indicating that commonly used single word representations, even when combined with contextual information, are insufficient for this task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑