多模态大模型

Multimodal Physical Activity Forecasting in Free-Living Clinical Settings: Hunting Opportunities for Just-in-Time Interventions

Abdullah Mamun, Krista S. Leonard, Megan E. Petrov, Matthew P. Buman, Hassan Ghasemzadeh

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 9 pages, 5 figures

M3Hop-CoT: Misogynous Meme Identification with Multimodal Multi-hop Chain-of-Thought

Gitanjali Kumari, Kirtan Jain, Asif Ekbal

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments 34 Pages. Accepted in The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024). Main Conference

Multi-Modal and Multi-Resolution Data Fusion for High-Resolution Cloud Removal: A Novel Baseline and Benchmark

Fang Xu, Yilei Shi, Patrick Ebel, Wen Yang, Xiao Xiang Zhu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Journal ref in IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1-15, 2024

MIBench: Evaluating Multimodal Large Language Models over Multiple Images

Haowei Liu, Xi Zhang, Haiyang Xu, Yaya Shi, Chaoya Jiang, Ming Yan, Ji Zhang, Fei Huang, Chunfeng Yuan, Bing Li, Weiming Hu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments EMNLP 2024

Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models

Wenhao Shi, Zhiqiang Hu, Yi Bin, Junhua Liu, Yang Yang, See-Kiong Ng, Lidong Bing, Roy Ka-Wei Lee

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted at Findings of EMNLP2024

UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Cause

Guimin Hu, Zhihong Zhu, Daniel Hershcovich, Lijie Hu, Hasti Seifi, Jiayuan Xie

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

VISTA: A Visual and Textual Attention Dataset for Interpreting Multimodal Models

Harshit, Tolga Tasdizen

专题命中 多模态评测 ：multimodal(title)；image-text(abstract)；分类 cs.CV

MFE-ETP: A Comprehensive Evaluation Benchmark for Multi-modal Foundation Models on Embodied Task Planning

Min Zhang, Xian Fu, Jianye Hao, Peilong Han, Hao Zhang, Lei Shi, Hongyao Tang, Yan Zheng

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale

Xiaotang Gai, Chenyi Zhou, Jiaxiang Liu, Yang Feng, Jian Wu, Zuozhu Liu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Kiss up, Kick down: Exploring Behavioral Changes in Multi-modal Large Language Models with Assigned Visual Personas

Seungjong Sun, Eungu Lee, Seo Yeon Baek, Seunghyun Hwang, Wonbyung Lee, Dongyan Nan, Bernard J. Jansen, Jang Hyun Kim

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Comments EMNLP 2024

Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models

Javier Chiyah-Garcia, Alessandro Suglia, Arash Eshghi

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP'24 Main (Upcoming). Data and code at www.github.com/JChiyah/blockworld-repairs - for Bibtex see https://raw.githubusercontent.com/JChiyah/blockworld-repairs/refs/heads/main/citation.bib

FMBench: Benchmarking Fairness in Multimodal Large Language Models on Medical Tasks

Peiran Wu, Che Liu, Canyu Chen, Jun Li, Cosmin I. Bercea, Rossella Arcucci

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

GAMMA-PD: Graph-based Analysis of Multi-Modal Motor Impairment Assessments in Parkinson's Disease

Favour Nerrise, Alice Louise Heiman, Ehsan Adeli

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

Comments Accepted by the 6th Workshop on GRaphs in biomedicAl Image anaLysis (GRAIL) at the 27th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2024). 12 pages, 3 figures, 2 tables, Source Code: https://github.com/favour-nerrise/GAMMA-PD

FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture

Wenyan Li, Xinyu Zhang, Jiaang Li, Qiwei Peng, Raphael Tang, Li Zhou, Weijia Zhang, Guimin Hu, Yifei Yuan, Anders Søgaard, Daniel Hershcovich, Desmond Elliott

专题命中 多模态评测 ：multimodal(title)；image-text(abstract)；分类 cs.CL

Beyond Raw Videos: Understanding Edited Videos with Large Multimodal Model

Lu Xu, Sijie Zhu, Chunyuan Li, Chia-Wen Kuo, Fan Chen, Xinyao Wang, Guang Chen, Dawei Du, Ye Yuan, Longyin Wen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

WebQuest: A Benchmark for Multimodal QA on Web Page Sequences

Maria Wang, Srinivas Sunkara, Gilles Baechler, Jason Lin, Yun Zhu, Fedir Zubach, Lei Shu, Jindong Chen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

MM-CamObj: A Comprehensive Multimodal Dataset for Camouflaged Object Scenarios

Jiacheng Ruan, Wenzhen Yuan, Zehao Lin, Ning Liao, Zhiyu Li, Feiyu Xiong, Ting Liu, Yuzhuo Fu

专题命中 多模态评测 ：multimodal(title)；image-text(abstract)；分类 cs.CV

Comments 9 pages, 5 figures. Work in progress

Automated Assessment of Multimodal Answer Sheets in the STEM domain

Rajlaxmi Patil, Aditya Ashutosh Kulkarni, Ruturaj Ghatage, Sharvi Endait, Geetanjali Kale, Raviraj Joshi

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

MTP: A Dataset for Multi-Modal Turning Points in Casual Conversations

Gia-Bao Dinh Ho, Chang Wei Tan, Zahra Zamanzadeh Darban, Mahsa Salehi, Gholamreza Haffari, Wray Buntine

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2024 main conference

Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild

Lingni Ma, Yuting Ye, Fangzhou Hong, Vladimir Guzov, Yifeng Jiang, Rowan Postyeni, Luis Pesqueira, Alexander Gamino, Vijay Baiyya, Hyo Jin Kim, Kevin Bailey, David Soriano Fosas, C. Karen Liu, Ziwei Liu, Jakob Engel, Renzo De Nardi, Richard Newcombe

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

A Novel Perspective for Multi-modal Multi-label Skin Lesion Classification

Yuan Zhang, Yutong Xie, Hu Wang, Jodie C Avery, M Louise Hull, Gustavo Carneiro

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by WACV2025

Uddessho: An Extensive Benchmark Dataset for Multimodal Author Intent Classification in Low-Resource Bangla Language

Fatema Tuj Johora Faria, Mukaffi Bin Moin, Md. Mahfuzur Rahman, Md Morshed Alam Shanto, Asif Iftekher Fahim, Md. Moinul Hoque

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted for publication in "18th International Conference on Information Technology and Applications (ICITA 2024)"

A Multimodal Framework for the Assessment of the Schizophrenia Spectrum

Gowtham Premananth, Yashish M. Siriwardena, Philip Resnik, Sonia Bansal, Deanna L. Kelly, Carol Espy-Wilson

专题命中 多模态评测 ：multimodal(title,abstract)；分类 eess.AS

Comments Accepted to be presented at Interspeech 2024

Exploring Graph Structure Comprehension Ability of Multimodal Large Language Models: Case Studies

Zhiqiang Zhong, Davide Mottin

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Multi-V2X: A Large Scale Multi-modal Multi-penetration-rate Dataset for Cooperative Perception

Rongsong Li, Xin Pei

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Comments 9 pages, 4 figures, 5 tables

Understanding eGFR Trajectories and Kidney Function Decline via Large Multimodal Models

Chih-Yuan Li, Jun-Ting Wu, Chan Hsu, Ming-Yen Lin, Yihuang Kang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments This preprint version includes corrections of typographical errors related to numerical values in Table 2, which were present in the version published at the BDH workshop in MIPR 2024. These corrections do not affect the overall conclusions of the study

Non-target Divergence Hypothesis: Toward Understanding Domain Gaps in Cross-Modal Knowledge Distillation

Yilong Chen, Zongyi Xu, Xiaoshui Huang, Shanshan Zhao, Xinqi Jiang, Xinyu Gao, Xinbo Gao

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CV

Multimodal Recommender Systems: A Survey

Qidong Liu, Jiaxi Hu, Yutian Xiao, Xiangyu Zhao, Jingtong Gao, Wanyu Wang, Qing Li, Jiliang Tang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments accepted by CSUR

Multi-Modal Experience Inspired AI Creation

Qian Cao, Xu Chen, Ruihua Song, Hao Jiang, Guang Yang, Zhao Cao

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

Comments Accepted by ACM Multimedia 2022

NYK-MS: A Well-annotated Multi-modal Metaphor and Sarcasm Understanding Benchmark on Cartoon-Caption Dataset

Ke Chang, Hao Li, Junzhao Zhang, Yunfang Wu

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CL

Comments 13 pages, 6 figures