多模态大模型

Towards General Multimodal Visual Tracking

Andong Lu, Mai Wen, Jinhu Wang, Yuanzhi Guo, Chenglong Li, Jin Tang, Bin Luo

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments In peer review

DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understanding

Ayesha Ishaq, Jean Lahoud, Ketan More, Omkar Thawakar, Ritesh Thawkar, Dinura Dissanayake, Noor Ahsan, Yuhao Li, Fahad Shahbaz Khan, Hisham Cholakkal, Ivan Laptev, Rao Muhammad Anwer, Salman Khan

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments 8 pages, 4 figures, 3 tables, github: https://github.com/ayesha-ishaq/DriveLMM-o1

A Multi-Modal Federated Learning Framework for Remote Sensing Image Classification

Barış Büyüktaş, Gencer Sumbul, Begüm Demir

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Post-interactive Multimodal Trajectory Prediction for Autonomous Driving

Ziyi Huang, Yang Li, Dushuai Li, Yao Mu, Hongmao Qin, Nan Zheng

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

A Multimodal Physics-Informed Neural Network Approach for Mean Radiant Temperature Modeling

Pouya Shaeri, Saud AlKhaled, Ariane Middel

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Towards Zero-Shot Multimodal Machine Translation

Matthieu Futeral, Cordelia Schmid, Benoît Sagot, Rachel Bawden

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments NAACL 2025 (Findings)

Are GNNs Actually Effective for Multimodal Fault Diagnosis in Microservice Systems?

Fei Gao, Ruyue Xin, Xiaocui Li, Yaqiang Zhang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 6 pages, 5 figures, submitted to conference

MGAug: Multimodal Geometric Augmentation in Latent Spaces of Image Deformations

Tonmoy Hossain, Miaomiao Zhang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation

Cheng-Yi Li, Kao-Jung Chang, Cheng-Fu Yang, Hsin-Yu Wu, Wenting Chen, Hritik Bansal, Ling Chen, Yi-Ping Yang, Yu-Chun Chen, Shih-Pin Chen, Jiing-Feng Lirng, Kai-Wei Chang, Shih-Hwa Chiou

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CL

Comments 6 figures, 5 supplementary figures, 8 supplementary tables

Journal ref Nature Communications 16, 2258 (2025)

BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense Evaluation

Haiyang Yu, Tian Xie, Jiaping Gui, Pengyang Wang, Ping Yi, Yue Wu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

MM-OR: A Large Multimodal Operating Room Dataset for Semantic Understanding of High-Intensity Surgical Environments

Ege Özsoy, Chantal Pellegrini, Tobias Czempiel, Felix Tristram, Kun Yuan, David Bani-Harouni, Ulrich Eck, Benjamin Busam, Matthias Keicher, Nassir Navab

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

LLMs as Educational Analysts: Transforming Multimodal Data Traces into Actionable Reading Assessment Reports

Eduardo Davalos, Yike Zhang, Namrata Srivastava, Jorge Alberto Salas, Sara McFadden, Sun-Joo Cho, Gautam Biswas, Amanda Goodwin

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 15 pages, 5 figures, 3 tables

MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge

Yuntao Du, Kailin Jiang, Zhi Gao, Chenrui Shi, Zilong Zheng, Siyuan Qi, Qing Li

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments Accept to ICLR2025. Project Page: https://mmke-bench-iclr.github.io/

Multimodal Learning for Just-In-Time Software Defect Prediction in Autonomous Driving Systems

Faisal Mohammad, Duksan Ryu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 9

MiCEval: Unveiling Multimodal Chain of Thought's Quality via Image Description and Reasoning Steps

Xiongtao Zhou, Jie He, Lanyu Chen, Jingyu Li, Haojing Chen, Víctor Gutiérrez-Basulto, Jeff Z. Pan, Hanjie Chen

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Comments NAACL 2025

Agentic Mixture-of-Workflows for Multi-Modal Chemical Search

Tiffany J. Callahan, Nathaniel H. Park, Sara Capponi

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.AI

Comments PDF includes supplemental material

EEE-Bench: A Comprehensive Multimodal Electrical And Electronics Engineering Benchmark

Ming Li, Jike Zhong, Tianle Chen, Yuxiang Lai, Konstantinos Psounis

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted to CVPR 2025

PFSD: A Multi-Modal Pedestrian-Focus Scene Dataset for Rich Tasks in Semi-Structured Environments

Yueting Liu, Hanshi Wang, Zhengjun Zha, Weiming Hu, Jin Gao

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

Does Table Source Matter? Benchmarking and Improving Multimodal Scientific Table Understanding and Reasoning

Bohao Yang, Yingji Zhang, Dong Liu, André Freitas, Chenghua Lin

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

Design and implementation of a distributed security threat detection system integrating federated learning and multimodal LLM

Yuqing Wang, Xiao Yang

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models

Zhongzhan Huang, Shanshan Zhong, Pan Zhou, Shanghua Gao, Marinka Zitnik, Liang Lin

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted by TPAMI. arXiv admin note: text overlap with arXiv:2312.02439

FedMobile: Enabling Knowledge Contribution-aware Multi-modal Federated Learning with Incomplete Modalities

Yi Liu, Cong Wang, Xingliang Yuan

专题命中 多模态评测 ：multi-modal(title)；multimodal(abstract)；分类 cs.AI

Comments The Web Conference 2025

Multimodal Graph-Based Variational Mixture of Experts Network for Zero-Shot Multimodal Information Extraction

Baohang Zhou, Ying Zhang, Yu Zhao, Xuhui Sui, Xiaojie Yuan

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.MM

Comments Accepted by WWW 2025

SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Models

Xianfu Cheng, Wei Zhang, Shiwei Zhang, Jian Yang, Xiangyuan Guan, Xianjie Wu, Xiang Li, Ge Zhang, Jiaheng Liu, Yuying Mai, Yutao Zeng, Zhoufutu Wen, Ke Jin, Baorui Wang, Weixiao Zhou, Yunhong Lu, Tongliang Li, Wenhao Huang, Zhoujun Li

专题命中 多模态评测 ：multimodal(title)；multi-modal(abstract)；分类 cs.CL

MVL-SIB: A Massively Multilingual Vision-Language Benchmark for Cross-Modal Topical Matching

Fabian David Schmidt, Florian Schneider, Chris Biemann, Goran Glavaš

专题命中 多模态评测 ：cross-modal(title,abstract)；分类 cs.CL

REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark

Navve Wasserman, Roi Pony, Oshri Naparstek, Adi Raz Goldfarb, Eli Schwartz, Udi Barzelay, Leonid Karlinsky

专题命中 多模态评测 ：multi-modal(title,abstract)；分类 cs.CV

UNITE-FND: Reframing Multimodal Fake News Detection through Unimodal Scene Translation

Arka Mukherjee, Shreya Ghosh

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 28 pages, 16 figures

MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents

Yanqi Dai, Huanran Hu, Lei Wang, Shengjie Jin, Xu Chen, Zhiwu Lu

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted for the 13th International Conference on Learning Representations (ICLR 2025)

AttenGluco: Multimodal Transformer-Based Blood Glucose Forecasting on AI-READI Dataset

Ebrahim Farahmand, Reza Rahimi Azghan, Nooshin Taheri Chatrudi, Eric Kim, Gautham Krishna Gudur, Edison Thomaz, Giulia Pedrielli, Pavan Turaga, Hassan Ghasemzadeh

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarks

Mohamed Elrefaie, Florin Morar, Angela Dai, Faez Ahmed

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Journal ref 38th Conference on Neural Information Processing Systems (NeurIPS 2024) Track on Datasets and Benchmarks