arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1806.07573cs.CLcs.IRcs.SI
收藏

从微博中提取新闻事件

Extracting News Events from Microblogs

Norwegian University of Science and Technology(挪威科技大学)

Øystein Repp, Heri Ramampiaro

摘要:

Twitter流已经成为许多人的一个重要信息来源,但推文的数量及其内容的嘈杂性使得从Twitter中获取知识对研究人员来说是一项具有挑战性的任务。为了克服从Twitter流中提取隐藏信息的一些主要挑战,这项工作提出了一种新的方法,从Twitter流中实时检测新闻事件。我们将方法分为三个步骤。第一步是使用神经网络或深度学习从流中检测与新闻相关的推文。第二步是将一种新的流数据聚类算法应用于检测到的新闻推文以形成新闻事件。第三步也是最后一步是根据事件集群的大小和鸣叫频率的增长速度对检测到的事件进行排名。我们评估了一个大型的,公开可用的语料库的注释新闻事件从Twitter上提出的系统。作为评估的一部分,我们将我们的方法与相关的最先进的解决方案进行比较。总体而言,我们的实验和基于用户的评估表明,我们的方法检测当前(真实)新闻事件提供了最先进的性能。

英文摘要:

Twitter stream has become a large source of information for many people, but the magnitude of tweets and the noisy nature of its content have made harvesting the knowledge from Twitter a challenging task for researchers for a long time. Aiming at overcoming some of the main challenges of extracting the hidden information from tweet streams, this work proposes a new approach for real-time detection of news events from the Twitter stream. We divide our approach into three steps. The first step is to use a neural network or deep learning to detect news-relevant tweets from the stream. The second step is to apply a novel streaming data clustering algorithm to the detected news tweets to form news events. The third and final step is to rank the detected events based on the size of the event clusters and growth speed of the tweet frequencies. We evaluate the proposed system on a large, publicly available corpus of annotated news events from Twitter. As part of the evaluation, we compare our approach with a related state-of-the-art solution. Overall, our experiments and user-based evaluation show that our approach on detecting current (real) news events delivers a state-of-the-art performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑