多模态大模型

"Subverting the Jewtocracy": Online Antisemitism Detection Using Multimodal Deep Learning

Mohit Chandra, Dheeraj Pailla, Himanshu Bhatia, Aadilmehdi Sanchawala, Manish Gupta, Manish Shrivastava, Ponnurangam Kumaraguru

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.MM

Knowledge distillation from multi-modal to mono-modal segmentation networks

Minhao Hu, Matthis Maillard, Ya Zhang, Tommaso Ciceri, Giammarco La Barbera, Isabelle Bloch, Pietro Gori

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments MICCAI 2020

Journal ref MICCAI 2020

A Two-stage Multi-modal Affect Analysis Framework for Children with Autism Spectrum Disorder

Jicheng Li, Anjana Bhat, Roghayeh Barmaki

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.MM

Comments 8 pages including reference; 8 figures

Journal ref The AAAI-21 Workshop On Affective Content Analysis; 2021

A Fair and Comprehensive Comparison of Multimodal Tweet Sentiment Analysis Methods

Gullal S. Cheema, Sherzod Hakimov, Eric Müller-Budack, Ralph Ewerth

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted in Workshop on Multi-ModalPre-Training for Multimedia Understanding (MMPT 2021), co-located with ICMR 2021

Sejong Face Database: A Multi-Modal Disguise Face Database

Usman Cheema, Seungbin Moon

专题命中 多模态评测 ：multi-modal(title)；multimodal(abstract)；分类 cs.CV、cs.AI

Comments Database Access Link: https://github.com/usmancheema89/SejongFaceDatabase

Journal ref Computer Vision and Image Understanding, Volumes 208-209, 2021

Exploring Text Specific and Blackbox Fairness Algorithms in Multimodal Clinical NLP

John Chen, Ian Berlot-Attwell, Safwan Hossain, Xindi Wang, Frank Rudzicz

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments Best paper award at 3rd Clinical Natural Language Processing Workshop at EMNLP 2020

Journal ref Proceedings of the 3rd Clinical Natural Language Processing Workshop (2020), pages 301--312

Adversarial Evaluation of Multimodal Models under Realistic Gray Box Assumption

Ivan Evtimov, Russel Howes, Brian Dolhansky, Hamed Firooz, Cristian Canton Ferrer

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Multimodal Deep Learning Framework for Image Popularity Prediction on Social Media

Fatma S. Abousaleh, Wen-Huang Cheng, Neng-Hao Yu, Yu Tsao

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.MM

Comments 14 pages, 11 figures, 7 tables

Journal ref IEEE Transactions on Cognitive and Developmental Systems. 2020 Nov 9

MUSER: MUltimodal Stress Detection using Emotion Recognition as an Auxiliary Task

Yiqun Yao, Michalis Papakostas, Mihai Burzo, Mohamed Abouelenien, Rada Mihalcea

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、eess.AS

Comments NAACL 2021 accepted

Multimodal Entity Linking for Tweets

Omar Adjali, Romaric Besançon, Olivier Ferret, Herve Le Borgne, Brigitte Grau

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.MM

Journal ref In: Jose J. et al. (eds) Advances in Information Retrieval. ECIR 2020. Lecture Notes in Computer Science, vol 12035. Springer, Cham

Evaluation of Multimodal Semantic Segmentation using RGB-D Data

Jiesi Hu, Ganning Zhao, Suya You, C. C. Jay Kuo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 12 pages, 5 figures

Shared Cross-Modal Trajectory Prediction for Autonomous Driving

Chiho Choi, Joon Hee Choi, Jiachen Li, Srikanth Malla

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV、cs.AI

Comments CVPR 2021 [Oral]

Exploiting Multi-Modal Features From Pre-trained Networks for Alzheimer's Dementia Recognition

Junghyun Koo, Jie Hwan Lee, Jaewoo Pyo, Yujin Jo, Kyogu Lee

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL、eess.AS

Comments In the Proceedings of INTERSPEECH 2020

Multimodal-Aware Weakly Supervised Metric Learning with Self-weighting Triplet Loss

Huiyuan Deng, Xiangzhu Meng, Lin Feng

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI、cs.MM

Multi-Modal Aesthetic Assessment for MObile Gaming Image

Zhenyu Lei, Yejing Xie, Suiyi Ling, Andreas Pastor, Junle Wang, Patrick Le Callet

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 5 pages

On-Device Document Classification using multimodal features

Sugam Garg, Harichandana, Sumit Kumar

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 8th ACM IKDD CODS and 26th COMAD 2-4 January 2021

MELINDA: A Multimodal Dataset for Biomedical Experiment Method Classification

Te-Lin Wu, Shikhar Singh, Sayan Paul, Gully Burns, Nanyun Peng

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments In The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21), 2021

Multimodal Spatio-Temporal Deep Learning Approach for Neonatal Postoperative Pain Assessment

Md Sirajus Salekin, Ghada Zamzmi, Dmitry Goldgof, Rangachar Kasturi, Thao Ho, Yu Sun

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted in Computers in Biology and Medicine, 2020

Language-guided Navigation via Cross-Modal Grounding and Alternate Adversarial Learning

Weixia Zhang, Chao Ma, Qi Wu, Xiaokang Yang

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to IEEE TCSVT

Supervised Multimodal Bitransformers for Classifying Images and Text

Douwe Kiela, Suvrat Bhooshan, Hamed Firooz, Ethan Perez, Davide Testuggine

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Rejected from EMNLP, twice

Multi-modal, multi-task, multi-attention (M3) deep learning detection of reticular pseudodrusen: towards automated and accessible classification of age-related macular degeneration

Qingyu Chen, Tiarnan D. L. Keenan, Alexis Allot, Yifan Peng, Elvira Agrón, Amitha Domalpally, Caroline C. W. Klaver, Daniel T. Luttikhuizen, Marcus H. Colyer, Catherine A. Cukras, Henry E. Wiley, M. Teresa Magone, Chantal Cousineau-Krieger, Wai T. Wong, Yingying Zhu, Emily Y. Chew, Zhiyong Lu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 5 figures and 4 tables, To appear in Journal of the American Medical Informatics Association

Situated and Interactive Multimodal Conversations

Seungwhan Moon, Satwik Kottur, Paul A. Crook, Ankita De, Shivani Poddar, Theodore Levin, David Whitney, Daniel Difranco, Ahmad Beirami, Eunjoon Cho, Rajen Subba, Alborz Geramifard

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments 20 pages, 5 figures, 11 tables, accepted to COLING 2020

Cross-modal Knowledge Reasoning for Knowledge-based Visual Question Answering

Jing Yu, Zihao Zhu, Yujing Wang, Weifeng Zhang, Yue Hu, Jianlong Tan

专题命中 多模态评测 ：cross-modal(title)；multimodal(abstract)；分类 cs.CV、cs.AI

Comments Accepted at Pattern Recognition. arXiv admin note: substantial text overlap with arXiv:2006.09073

MM-Hand: 3D-Aware Multi-Modal Guided Hand Generative Network for 3D Hand Pose Synthesis

Zhenyu Wu, Duc Hoang, Shih-Yao Lin, Yusheng Xie, Liangjian Chen, Yen-Yu Lin, Zhangyang Wang, Wei Fan

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted by ACM Multimedia 2020

Hierarchical Deep Multi-modal Network for Medical Visual Question Answering

Deepak Gupta, Swati Suman, Asif Ekbal

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted for publication at Expert Systems with Applications

RGB2LIDAR: Towards Solving Large-Scale Cross-Modal Visual Localization

Niluthpol Chowdhury Mithun, Karan Sikka, Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV、cs.MM

Comments ACM Multimedia 2020

Dynamic Context-guided Capsule Network for Multimodal Machine Translation

Huan Lin, Fandong Meng, Jinsong Su, Yongjing Yin, Zhengyuan Yang, Yubin Ge, Jie Zhou, Jiebo Luo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.MM

Leveraging Multimodal Behavioral Analytics for Automated Job Interview Performance Assessment and Feedback

Anumeha Agrawal, Rosa Anil George, Selvan Sunitha Ravi, Sowmya Kamath S, Anand Kumar M

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 9 pages, ACL 2020

Real-time Ultrasound-enhanced Multimodal Imaging of Tongue using 3D Printable Stabilizer System: A Deep Learning Approach

M. Hamed Mozaffari, Won-Sook Lee

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、eess.AS

Comments 12 figures, 1 table

Journal ref Canadian Acoustics. 48, 1 (Mar. 2020)

SIMMC: Situated Interactive Multi-Modal Conversational Data Collection And Evaluation Platform

Paul A. Crook, Shivani Poddar, Ankita De, Semir Shafi, David Whitney, Alborz Geramifard, Rajen Subba

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL、cs.AI

Comments ASRU 2019 (demonstration)