Internet Memes remain a challenging form of user-generated content for automated sentiment classification. The availability of labelled memes is a barrier to developing sentiment classifiers of multimodal memes. To address the shortage of labelled memes, we propose to supplement the training of a multimodal meme classifier with unimodal (image-only and text-only) data. In this work, we present a novel variant of supervised intermediate training that uses relatively abundant sentiment-labelled unimodal data. Our results show a statistically significant performance improvement from the incorporation of unimodal text data. Furthermore, we show that the training set of labelled memes can be reduced by 40% without reducing the performance of the downstream model.
Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memes
IIIT Sri City（印度信息技术与管理研究所斯里城分校）；UCLA（加利福尼亚大学洛杉矶分校）；University of South Carolina（南卡罗来纳大学）；Carnegie Mellon University（卡内基梅隆大学）；Stanford University（斯坦福大学）；Amazon AI（亚马逊人工智能部门）；Microsoft（微软公司）；IIT Patna（印度理工学院巴特那分校）；Georgia Tech（佐治亚理工学院）
BLUE at Memotion 2.0 2022: You have my Image, my Text and my Transformer
Interdisciplinary School of Doctoral Studies, University of Bucharest（布加勒斯特大学跨学科博士研究学院）；Faculty of Automatics and Control, University Politehnica of Bucharest（布加勒斯特理工大学自动化与控制学院）；University of Bucharest（布加勒斯特大学）
On VLMs for Diverse Tasks in Multimodal Meme Classification
Peng Wang and Shuai Bai and Sinan Tan and Shijie Wang and Zhihao Fan and Jinze Bai and Keqin Chen and Xuejing Liu and Jialin Wang and Wenbin Ge and Yang Fan and Kai Dang and Mengfei Du and Xuancheng Ren and Rui Men and Dayiheng Liu and Chang Zhou and Jingren Zhou and Junyang Lin（研究人员）
Multi-Granular Multimodal Clue Fusion for Meme Understanding
School of Cyber Science and Engineering, Wuhan University（武汉大学网络空间安全学院）；National University of Singapore（新加坡国立大学）；North China Institute of Computing Technology（华北计算技术研究所）
Beyond the Literal: Decomposing Pragmatic Intent in Multimodal Meme Understanding
The Chinese University of Hong Kong（香港中文大学）；Huawei（华为）；Central China Normal University（中央师范大学）；Shenzhen University（深圳大学）；King’s College London（伦敦国王学院）；University of International Relations（国际关系大学）
Singapore University of Design and Technology（新加坡设计与科技大学）；Singapore Management University（新加坡管理大学）；University of Electronic Science and Technology of China（电子科技大学）
LLaVAC: Fine-tuning LLaVA as a Multimodal Sentiment Classifier
iApp Technology Co., Ltd.（iApp科技有限公司）；Panasonic Research and Development on Artificial Intelligence (AI)（松下人工智能研发中心）；Sirindhorn International Institute of Technology, Thammasat University（泰国法政大学诗琳通国际理工学院）
Indraprastha Institute of Information Technology - Delhi（德里英迪拉普拉斯信息技术学院）；Sofia University（索非亚大学）；Wipro AI Labs（威普罗人工智能实验室）；Qatar Computing Research Institute, HBKU（卡塔尔计算研究所（哈马德·本·哈利法大学））
MEMEX: Detecting Explanatory Evidence for Memes via Knowledge-Enriched Contextualization
Indian Institute of Technology Delhi（印度理工学院德里分校）；Wipro AI Labs（威普罗人工智能实验室）；Vellore Institute of Technology（韦洛尔理工学院）；Indraprastha Institute of Information Technology Delhi（德里英德拉普拉斯塔信息技术学院）
本文提出 MEMEX 任务及 MCC 数据集，并设计多模态神经框架 MIME，利用常识增强表示和分层跨模态建模来挖掘模因的解释性语境，较最佳基线 F1 提升约 4%。
Variational Fusion for Multimodal Sentiment Analysis
A*STAR AI Initiative, Institute of High Performance Computing（A*STAR人工智能计划、高性能计算研究院）；Adobe Research（奥多比研究院）；University of Michigan（密歇根大学）；Centro de Investigación en Computación, Instituto Politécnico Nacional（国立理工学院计算研究中心）；SUTD（新加坡科技设计大学）
MER-Bench: Benchmarking Multimodal Emotional Reappraisal for Image-Text Memes
School of Artificial Intelligence, Anhui University（安徽大学人工智能学院）；Institute of Artificial Intelligence, Hefei Comprehensive National Science Center（合肥综合性国家科学中心人工智能研究院）；School of Computer Science and Information Engineering, Hefei University of Technology（合肥工业大学计算机科学与信息工程学院）；College of Information Technology, United Arab Emirates University（阿拉伯联合酋长国大学信息学院）；Institute of Advanced Technology, University of Science and Technology of China（中国科学技术大学先进技术研究院）
DISARM: Detecting the Victims Targeted by Harmful Memes
Indraprastha Institute of Information Technology - Delhi（德里英德拉普拉斯塔信息技术学院）；Wipro AI Labs（威普罗人工智能实验室）；Qatar Computing Research Institute, HBKU（哈马德·本·哈利法大学卡塔尔计算研究所）
Cooperative Sentiment Agents for Multimodal Sentiment Analysis
College of Computer Science and Technology in Nanjing University of Aeronautics and Astronautics（南京航空航天大学计算机科学与技术学院）；School of Computer Science in Nanjing University of Posts and Telecommunications（南京邮电大学计算机学院）；Nanjing University of Aeronautics and Astronautics（南京航空航天大学）；Functional Brain Imaging Institute（功能脑成像研究所）；Nanjing Medical University（南京医科大学）
Segregate, Refine, Integrate: Decomposing Multimodal Fusion for Sentiment Analysis
National Technical University of Athens（雅典国立技术大学）；Athena Research Center（雅典娜研究中心）；University of Bern（伯尔尼大学）；Archimedes AI（阿基米德人工智能公司）；Synaptic Bloom PBC（突触绽放有限责任公司）
CAGMamba: Context-Aware Gated Cross-Modal Mamba Network for Multimodal Sentiment Analysis
School of Computer Science and Engineering, Northeastern University（东北大学计算机科学与工程学院）；Xingning Power Supply Bureau, Guangdong Power Grid Co., Ltd.（广东电网有限责任公司兴宁供电局）
TCAN: Text-oriented Cross Attention Network for Multimodal Sentiment Analysis
State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences（多模态人工智能系统国家重点实验室，中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；School of Artificial Intelligence and Automation, Huazhong University of Science and Technology（华中科技大学人工智能与自动化学院）；Tencent（腾讯）；School of Information Science and Technology, Donghua University（东华大学信息科学与技术学院）
