arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1506.00765cs.MMcs.CLcs.IR
收藏

基于大规模中层本体的视频(GIF)情感分析

Video (GIF) Sentiment Analysis using Large-Scale Mid-Level Ontology

Xiamen University(厦门大学)

Zheng Cai, Donglin Cao, Rongrong Ji

摘要:

随着更快的连接速度,互联网用户现在使社交网络成为文本,图像和视频剪辑(GIF)的巨大水库。情感分析可用于预测政治选举、评估经济指标等,但GIF情感分析具有相当大的挑战性,不仅因为它依赖于时空视觉内容的提取,而且这种提取与最终情感之间的关系还不清楚。本文提出了一种基于SentiPairSequence的时空视觉情感本体,它构成了GIF情感的中级表示。SentiPair的建立过程包括两个步骤。首先,我们构造Synset森林来定义视觉情感标签元素的语义树结构。然后,通过Synset森林,我们有机地选择和组合情感标签元素,形成一个中级的视觉情感表示。我们的实验表明,SentiPair优于其他竞争的中级属性。使用SentiPair,我们的分析框架可以达到令人满意的预测准确率(72.6%)。我们还向研究界开放了我们的数据集(GSO-2015)。GSO-2015包含了40,000多个候选项中的6,000多个手动注释的GIF。每个都标有情感和SentiPair序列。

英文摘要:

With faster connection speed, Internet users are now making social network a huge reservoir of texts, images and video clips (GIF). Sentiment analysis for such online platform can be used to predict political elections, evaluates economic indicators and so on. However, GIF sentiment analysis is quite challenging, not only because it hinges on spatio-temporal visual contentabstraction, but also for the relationship between such abstraction and final sentiment remains unknown.In this paper, we dedicated to find out such relationship.We proposed a SentiPairSequence basedspatiotemporal visual sentiment ontology, which forms the midlevel representations for GIFsentiment. The establishment process of SentiPair contains two steps. First, we construct the Synset Forest to define the semantic tree structure of visual sentiment label elements. Then, through theSynset Forest, we organically select and combine sentiment label elements to form a mid-level visual sentiment representation. Our experiments indicate that SentiPair outperforms other competing mid-level attributes. Using SentiPair, our analysis frameworkcan achieve satisfying prediction accuracy (72.6%). We also opened ourdataset (GSO-2015) to the research community. GSO-2015 contains more than 6,000 manually annotated GIFs out of more than 40,000 candidates. Each is labeled with both sentiment and SentiPair Sequence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑