arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2207.03317cs.AI
收藏

基于多模态特征提取的模因情感分类

Multimodal Feature Extraction for Memes Sentiment Classification

Eötvös Loránd University(厄特沃什·罗兰大学);Pavol Jozef Šafárik University(帕沃尔·约瑟夫·沙法里克大学);Wollo University(沃洛大学)

Sofiane Ouaari, Tsegaye Misikir Tashu, Tomas Horvath

摘要:

在这项研究中,我们提出了使用深度学习方法进行多模态模因分类的特征提取。模因通常是年轻一代在社交媒体平台上分享的带有文字的照片或视频,表达了与文化相关的想法。因为它们是表达情感和感受的有效方式,所以一个好的分类器可以对模因背后的情感进行分类是很重要的。为了使学习过程更有效,减少过拟合的可能性,并提高模型的泛化能力,需要一种好的方法来从所有模态中提取联合特征提取。在这项工作中,我们提出了使用不同的多模态神经网络方法进行多模态特征提取,并使用提取的特征训练分类器来识别模因中的情感。

英文摘要:

In this study, we propose feature extraction for multimodal meme classification using Deep Learning approaches. A meme is usually a photo or video with text shared by the young generation on social media platforms that expresses a culturally relevant idea. Since they are an efficient way to express emotions and feelings, a good classifier that can classify the sentiment behind the meme is important. To make the learning process more efficient, reduce the likelihood of overfitting, and improve the generalizability of the model, one needs a good approach for joint feature extraction from all modalities. In this work, we proposed to use different multimodal neural network approaches for multimodal feature extraction and use the extracted features to train a classifier to identify the sentiment in a meme.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑