融合文本和图像的Twitter事件检测
Fusing Text and Image for Event Detection in Twitter
摘要:
在这篇文章中,我们开发了一种准确有效的事件检测方法来检测Twitter流中的事件,该方法使用视觉和文本信息来提高挖掘过程的性能。该方法监视Twitter流以拾取具有文本和图像的推文,并将它们存储到数据库中。接下来是应用挖掘算法来检测事件。该过程首先检测事件的基础上,只有通过使用的词袋,这是使用词频逆文档频率(TF-IDF)的方法计算的功能的文本。然后,它检测基于图像的事件,仅使用视觉特征,包括直方图的有向梯度(HOG)描述符,灰度共生矩阵(GLCM),颜色直方图。在检测中使用K近邻(Knn)分类。基于纯文本检测和纯图像检测的可靠性来做出事件检测的最终决策。实验结果表明,该方法取得了较高的准确率为0.94,与0.89相比,只有文本,只有图像0.86。
英文摘要:
In this contribution, we develop an accurate and effective event detection method to detect events from a Twitter stream, which uses visual and textual information to improve the performance of the mining process. The method monitors a Twitter stream to pick up tweets having texts and images and stores them into a database. This is followed by applying a mining algorithm to detect an event. The procedure starts with detecting events based on text only by using the feature of the bag-of-words which is calculated using the term frequency-inverse document frequency (TF-IDF) method. Then it detects the event based on image only by using visual features including histogram of oriented gradients (HOG) descriptors, grey-level cooccurrence matrix (GLCM), and color histogram. K nearest neighbours (Knn) classification is used in the detection. The final decision of the event detection is made based on the reliabilities of text only detection and image only detection. The experiment result showed that the proposed method achieved high accuracy of 0.94, comparing with 0.89 with texts only, and 0.86 with images only.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。