arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.03496cs.CLcs.LG
收藏

监控词嵌入的几何特性以检测新主题的出现

Monitoring geometrical properties of word embeddings for detecting the emergence of new topics

Université de Lyon, Lyon 2(里昂第二大学);UR ERIC(ERIC研究单位);EDF R&D(法国电力公司研发中心)

Clément Christophe, Julien Velcin, Jairo Cugliari, Manel Boumghar, Philippe Suignard

摘要:

慢出现话题检测是介于事件检测和语言进化之间的一项任务,事件检测是我们在短时间内聚合不同单词的行为,而语言进化是我们监视它们的长期进化。在这项工作中,我们解决了早期发现缓慢出现的新主题的问题。为此,我们收集了单词层面上微弱信号的证据。我们建议监控嵌入空间中的单词表示的行为,并使用其几何特性之一来表征主题的出现。由于这种任务的评价通常很难,我们提出了一个定量评价的框架。我们在两个公开的新闻和科学文章数据集上显示了优于最先进方法的积极结果。

英文摘要:

Slow emerging topic detection is a task between event detection, where we aggregate behaviors of different words on short period of time, and language evolution, where we monitor their long term evolution. In this work, we tackle the problem of early detection of slowly emerging new topics. To this end, we gather evidence of weak signals at the word level. We propose to monitor the behavior of words representation in an embedding space and use one of its geometrical properties to characterize the emergence of topics. As evaluation is typically hard for this kind of task, we present a framework for quantitative evaluation. We show positive results that outperform state-of-the-art methods on two public datasets of press and scientific articles.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑