Online misinformation is a prevalent societal issue, with adversaries relying on tools ranging from cheap fakes to sophisticated deep fakes. We are motivated by the threat scenario where an image is used out of context to support a certain narrative. While some prior datasets for detecting image-text inconsistency generate samples via text manipulation, we propose a dataset where both image and text are unmanipulated but mismatched. We introduce several strategies for automatically retrieving convincing images for a given caption, capturing cases with inconsistent entities or semantic context. Our large-scale automatically generated NewsCLIPpings Dataset: (1) demonstrates that machine-driven image repurposing is now a realistic threat, and (2) provides samples that represent challenging instances of mismatch between text and image in news that are able to mislead humans. We benchmark several state-of-the-art multimodal models on our dataset and analyze their performance across different pretraining domains and visual backbones.
Medico Multimedia Task at MediaEval 2020: Automatic Polyp Segmentation
SimulaMet（西穆拉大都会研究所）；UiT The Arctic University of Norway（挪威UiT北极大学）；Oslo Metropolitan University（奥斯陆城市大学）；Augere Medical AS（奥杰雷医疗公司）；Sahlgrenska University Hospital（萨尔格伦斯卡大学医院）；Bærum Hospital（贝鲁姆医院）
Semi-automatic Generation of Multilingual Datasets for Stance Detection in Twitter
Vicomtech Foundation（维康泰克基金会）；Basque Research and Technology Alliance (BRTA)（巴斯克研究与技术联盟（BRTA））；University of the Basque Country UPV/EHU（巴斯克大学（UPV/EHU））
Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media
Università di Bologna（博洛尼亚大学）；Qatar University（卡塔尔大学）；Qatar Computing Research Institute, HBKU（卡塔尔计算研究所（哈马德·本·哈利法大学））；Sofia University “St Kliment Ohridski”（索菲亚大学“圣克莱门特·奥赫里德斯基”）
Deep Multimodal Image-Text Embeddings for Automatic Cross-Media Retrieval
Institute for Advanced Studies in Basic Sciences (IASBS)（基础科学高级研究所）；Charles University（查尔斯大学）；Institute for Research in Fundamental Sciences (IPM)（基础科学研究所）；University of Parma（帕尔马大学）
Exploiting Dialect Identification in Automatic Dialectal Text Normalization
Computational Approaches to Modeling Language Lab（语言建模计算方法实验室）；New York University Abu Dhabi（纽约大学迪拜分校）；Carnegie Mellon University in Qatar（卡内基梅隆大学多哈分校）
Interpretable Multimodal Out-of-context Detection with Soft Logic Regularization
School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Center for Research on Intelligent Perception and Computing (CRIPAC)（智能感知与计算研究中心）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）
3D Quantum Cuts for Automatic Segmentation of Porous Media in Tomography Images
Qatar University（卡塔尔大学）；Institute of Research for Development（发展研究所）；French National Institute for Agricultural Research, INRA（法国国家农业研究院（INRA））；University of Burgundy（勃艮第大学）；Aarhus University（奥胡斯大学）；Tampere University of Technology（坦佩雷理工大学）；AgroParisTech（巴黎高科农业学院）
MobileVidFactory: Automatic Diffusion-Based Social Media Video Generation for Mobile Devices from Text
University of Electronic Science and Technology of China（电子科技大学）；Microsoft Research（微软研究院）；University of Rochester（罗切斯特大学）；National Taiwan University（国立台湾大学）
