多模态大模型

A multimodal method based on cross-attention and convolution for postoperative infection diagnosis

Xianjie Liu, Hongwei Shi

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

OneCAD: One Classifier for All image Datasets using multimodal learning

Shakti N. Wadekar, Eugenio Culurciello

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 8 pages, 6 figures

Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization

Yunlong Liang, Fandong Meng, Jinan Xu, Jiaan Wang, Yufeng Chen, Jie Zhou

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted at ACL 2023 as a long paper of the main conference. Data and Code: https://github.com/XL2248/SOV-MAS

Read My Mind: A Multi-Modal Dataset for Human Belief Prediction

Jiafei Duan, Samson Yu, Nicholas Tan, Yi Ru Wang, Cheston Tan

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to ICRA 2023 Communicating Robot Learning Across Human-Robot Interaction Workshop

PheME: A deep ensemble framework for improving phenotype prediction from multi-modal data

Shenghan Zhang, Haoxuan Li, Ruixiang Tang, Sirui Ding, Laila Rasmy, Degui Zhi, Na Zou, Xia Hu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL、cs.MM

Personalized Showcases: Generating Multi-Modal Explanations for Recommendations

An Yan, Zhankui He, Jiacheng Li, Tianyang Zhang, Julian McAuley

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to SIGIR-23, with additional dataset details. Code and data: https://github.com/zzxslp/Gest

AutoFed: Heterogeneity-Aware Federated Multimodal Learning for Robust Autonomous Driving

Tianyue Zheng, Ang Li, Zhe Chen, Hongbo Wang, Jun Luo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

MultiModal Bias: Introducing a Framework for Stereotypical Bias Assessment beyond Gender and Race in Vision Language Models

Sepehr Janghorbani, Gerard de Melo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Self-Supervised Learning for Multimodal Non-Rigid 3D Shape Matching

Dongliang Cao, Florian Bernard

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments accepted by CVPR 2023

Just Noticeable Visual Redundancy Forecasting: A Deep Multimodal-driven Approach

Wuyuan Xie, Shukang Wang, Sukun Tian, Lirong Huang, Ye Liu, Miaohui Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.MM

Journal ref AAAI 2023

Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graph

Shumin Deng, Chengming Wang, Zhoubo Li, Ningyu Zhang, Zelin Dai, Hehong Chen, Feiyu Xiong, Ming Yan, Qiang Chen, Mosha Chen, Jiaoyan Chen, Jeff Z. Pan, Bryan Hooi, Huajun Chen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments OpenBG. Accepted by ICDE 2023. The project is released at https://github.com/OpenBGBenchmark/OpenBG . Website: https://kg.alibaba.com/ , Leaderboard: https://tianchi.aliyun.com/dataset/dataDetail?dataId=122271

ViLPAct: A Benchmark for Compositional Generalization on Multimodal Human Activities

Terry Yue Zhuo, Yaqing Liao, Yuecheng Lei, Lizhen Qu, Gerard de Melo, Xiaojun Chang, Yazhou Ren, Zenglin Xu

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CV、cs.CL

Comments Accepted at EACL2023 (Findings)

Flat Multi-modal Interaction Transformer for Named Entity Recognition

Junyu Lu, Dixiang Zhang, Pingjian Zhang

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted by COLING 2022, oral paper

Knowledge-aware Bayesian Co-attention for Multimodal Emotion Recognition

Zihan Zhao, Yu Wang, Yanfeng Wang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、eess.AS

Comments Accepted to IEEE ICASSP 2023

Enhancing Fine-Grained 3D Object Recognition using Hybrid Multi-Modal Vision Transformer-CNN Models

Songsong Xiong, Georgios Tziafas, Hamidreza Kasaei

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

That's the Wrong Lung! Evaluating and Improving the Interpretability of Unsupervised Multimodal Encoders for Medical Data

Denis Jered McInerney, Geoffrey Young, Jan-Willem van de Meent, Byron C. Wallace

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Journal ref Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing

Large Scale Multi-Lingual Multi-Modal Summarization Dataset

Yash Verma, Anubhav Jangra, Raghvendra Kumar, Sriparna Saha

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL、cs.MM

Multi-Modal Evaluation Approach for Medical Image Segmentation

Seyed M. R. Modaresi, Aomar Osmani, Mohammadreza Razzazi, Abdelghani Chibani

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Werewolf Among Us: A Multimodal Dataset for Modeling Persuasion Behaviors in Social Deduction Games

Bolin Lai, Hongxin Zhang, Miao Liu, Aryan Pariani, Fiona Ryan, Wenqi Jia, Shirley Anugrah Hayati, James M. Rehg, Diyi Yang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 17 pages

FLAME: Facial Landmark Heatmap Activated Multimodal Gaze Estimation

Neelabh Sinha, Michal Balazia, Francois Bremond

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Preprint. Final paper accepted at the 17th IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS), virtual, November 2021. 8 pages

Multimodal Tree Decoder for Table of Contents Extraction in Document Images

Pengfei Hu, Zhenrong Zhang, Jianshu Zhang, Jun Du, Jiajia Wu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ICPR2022

FAF: A novel multimodal emotion recognition approach integrating face, body and text

Zhongyu Fang, Aoyun He, Qihui Yu, Baopeng Gao, Weiping Ding, Tong Zhang, Lei Ma

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

GLAMI-1M: A Multilingual Image-Text Fashion Dataset

Vaclav Kosar, Antonín Hoskovec, Milan Šulc, Radek Bartyzal

专题命中 多模态评测 ：image-text(title,abstract)；分类 cs.CV、cs.CL

Explaining (Sarcastic) Utterances to Enhance Affect Understanding in Multimodal Dialogues

Shivani Kumar, Ishani Mondal, Md Shad Akhtar, Tanmoy Chakraborty

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at AAAI 2023. 11 Pages; 14 Tables; 3 Figures

Exploiting modality-invariant feature for robust multimodal emotion recognition with missing modalities

Haolin Zuo, Rui Liu, Jinming Zhao, Guanglai Gao, Haizhou Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 5 pages, 3 figures, 1 table. Submitted to ICASSP 2023. We release the code at: https://github.com/ZhuoYulang/IF-MMIN

Multilingual Multimodal Learning with Machine Translated Text

Chen Qiu, Dan Oneata, Emanuele Bugliarello, Stella Frank, Desmond Elliott

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments EMNLP 2022

McQueen: a Benchmark for Multimodal Conversational Query Rewrite

Yifei Yuan, Chen Shi, Runze Wang, Liyi Chen, Feijun Jiang, Yuan You, Wai Lam

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP22

Unsupervised active speaker detection in media content using cross-modal information

Rahul Sharma, Shrikanth Narayanan

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV、eess.AS

Comments Under review at IEEE Transactions on Image Processing

Multimodal Learning on Graphs for Disease Relation Extraction

Yucong Lin, Keming Lu, Sheng Yu, Tianxi Cai, Marinka Zitnik

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

CH-MARL: A Multimodal Benchmark for Cooperative, Heterogeneous Multi-Agent Reinforcement Learning

Vasu Sharma, Prasoon Goyal, Kaixiang Lin, Govind Thattai, Qiaozi Gao, Gaurav S. Sukhatme

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.AI