UPB在SemEval-2020的任务8:多任务学习架构中的文本和视觉联合建模
UPB at SemEval-2020 Task 8: Joint Textual and Visual Modeling in a Multi-Task Learning Architecture for Memotion Analysis
摘要:
来自在线环境的用户可以创建不同的方式来表达他们的想法,意见或娱乐概念。网络迷因就是专门为这些情况而创造的。它们的主要目的是通过使用图像和文本的组合来传递思想,这样它们将为受体创造某种状态,这取决于模因必须发送的信息。这些帖子可以与各种情况或事件相关,从而为我们的世界所处的任何环境添加有趣的一面。在本文中,我们描述了我们的团队为SemEval-2020任务8:情感分析开发的系统。更具体地说,我们引入了一种新的系统来分析这些帖子,这是一种多模态多任务学习架构,它将用于文本编码的ALBERT与用于图像表示的VGG-16相结合。通过这种方式,我们可以正确地揭示它们背后的信息。我们的方法在当前比赛的三个子任务中的每一个上都取得了良好的性能,子任务A排名第11(0.3453宏F1分数),子任务B排名第1(0.5183宏F1分数),子任务C排名第3(0.3171宏F1分数),同时超过了官方基线结果。
英文摘要:
Users from the online environment can create different ways of expressing their thoughts, opinions, or conception of amusement. Internet memes were created specifically for these situations. Their main purpose is to transmit ideas by using combinations of images and texts such that they will create a certain state for the receptor, depending on the message the meme has to send. These posts can be related to various situations or events, thus adding a funny side to any circumstance our world is situated in. In this paper, we describe the system developed by our team for SemEval-2020 Task 8: Memotion Analysis. More specifically, we introduce a novel system to analyze these posts, a multimodal multi-task learning architecture that combines ALBERT for text encoding with VGG-16 for image representation. In this manner, we show that the information behind them can be properly revealed. Our approach achieves good performance on each of the three subtasks of the current competition, ranking 11th for Subtask A (0.3453 macro F1-score), 1st for Subtask B (0.5183 macro F1-score), and 3rd for Subtask C (0.3171 macro F1-score) while exceeding the official baseline results by high margins.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。