多模态大模型

VideoRewardBench: Comprehensive Evaluation of Multimodal Reward Models for Video Understanding

Zhihong Zhang, Xiaojian Huang, Jin Xu, Zhuodong Luo, Xinzhi Wang, Jiansheng Wei, Xuejin Chen

机构 * University of Science and Technology of China（中国科学技术大学） ； Huawei Noah’s Ark Lab（华为诺亚实验室） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.CV、cs.AI

Comments https://videorewardbench.github.io/

Prompt-based Multimodal Semantic Communication for Multi-spectral Image Segmentation

Haoshuo Zhang, Yufei Bo, Hongwei Zhang, Meixia Tao

专题命中 多模态评测 ：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.MM

Comments The full-length version, arXiv:2508.20057, has been updated

Advancing Grounded Multimodal Named Entity Recognition via LLM-Based Reformulation and Box-Based Segmentation

Jinyuan Li, Ziyan Li, Han Li, Jianfei Yu, Rui Xia, Di Sun, Gang Pan

机构 * College of Intelligence and Computing, Tianjin University（智能与计算学院，天津大学） ； NJUST（南京理工大学） ； College of Mathematics, Taiyuan University of Technology（数学学院，太原科技大学） ； Tianjin University of Science and Technology（天津科技大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.MM

Comments Extension of our Findings of EMNLP 2023 & ACL 2024 paper, IEEE Transactions on Multimedia accepted on July 19, 2025

Detecting Visual Information Manipulation Attacks in Augmented Reality: A Multimodal Semantic Reasoning Approach

Yanming Xiu, Maria Gorlatova

机构 * Duke University（杜克大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments The paper has been accepted to the 2025 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), and selected for publication in the 2025 IEEE Transactions on Visualization and Computer Graphics (TVCG) special issue

A Multimodal Cross-View Model for Predicting Postoperative Neck Pain in Cervical Spondylosis Patients

Jingyang Shan, Qishuai Yu, Jiacen Liu, Shaolin Zhang, Wen Shen, Yanxiao Zhao, Tianyi Wang, Xiaolin Qin, Yiheng Yin

机构 * Chengdu Institute of Computer Applications, Chinese Academy of Sciences（成都计算机应用研究所，中国科学院） ； University of Chinese Academy of Sciences（中国科学院大学） ； Department of Neurosurgery, the First Medical Center, Chinese PLA General Hospital（中国人民解放军总医院神经外科部） ； School of Medicine, Nankai University（南开大学医学院） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Text Reinforcement for Multimodal Time Series Forecasting

Chen Su, Yuanhe Tian, Yan Song, Yongdong Zhang

机构 * University of Science and Technology of China（中国科学技术大学） ； University of Washington（华盛顿大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

CLARE: Cognitive Load Assessment in REaltime with Multimodal Data

Anubhav Bhatti, Prithila Angkan, Behnam Behinaein, Zunayed Mahmud, Dirk Rodenburg, Heather Braund, P. James Mclellan, Aaron Ruberto, Geoffery Harrison, Daryl Wilson, Adam Szulewski, Dan Howes, Ali Etemad, Paul Hungler

机构 * Department of Electrical and Computer Engineering and Ingenuity Research Labs（电气与计算机工程系和Ingenuity研究实验室） ； Queen’s University（女王大学） ； Ingenuity Research Labs（Ingenuity研究实验室） ； Department of Psychology（心理学系） ； School of Medicine（医学院） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 13 pages, 10 figures, 6 tables

Journal ref IEEE Transactions on Cognitive and Developmental Systems, 2025

REVELIO -- Universal Multimodal Task Load Estimation for Cross-Domain Generalization

Maximilian P. Oppelt, Andreas Foltyn, Nadine R. Lang-Richter, Bjoern M. Eskofier

机构 * Fraunhofer Institute for Integrated Circuits IIS（弗劳恩霍夫集成电路研究所） ； Friedrich-Alexander-University Erlangen Nuremberg（埃朗根-纽伦堡弗赖堡-亚历山大大学） ； Helmholtz Zentrum München（亥姆霍兹慕尼黑研究中心） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learning

Qi Yang, Bolin Ni, Shiming Xiang, Han Hu, Houwen Peng, Jie Jiang

机构 * Tencent Hunyuan Team（腾讯文言团队） ； Institute of Automation, CAS（中国科学院自动化研究所） 纠错

专题命中 多模态评测 ：multimodal(abstract)；MLLM(abstract)；分类 cs.CV、cs.AI

Comments 20 pages, 14 figures, 5 tables

Omnidirectional Spatial Modeling from Correlated Panoramas

Xinshen Zhang, Tongxi Fu, Xu Zheng

机构 * The Hong Kong Polytechnic University（香港理工大学） ； Zhejiang Sci-Tech University（浙江科技学院） 纠错

专题命中 多模态评测 ：multi-modal(abstract)；MLLM(abstract)；分类 cs.CV

Distill Visual Chart Reasoning Ability from LLMs to MLLMs

Wei He, Zhiheng Xi, Wanxu Zhao, Xiaoran Fan, Yiwen Ding, Zifei Shan, Tao Gui, Qi Zhang, Xuanjing Huang

机构 * School of Computer Science, Fudan University（复旦大学计算机学院） ； Weixin Group, Tencent（腾讯Weixin部门） ； Shanghai Innovation Institute（上海创新研究院） ； Shanghai Key Lab of Intelligent Information Processing（上海智能信息处理重点实验室） 纠错

专题命中 多模态评测 ：multimodal(abstract)；cross-modal(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025 Findings. The code and dataset are publicly available at https://github.com/hewei2001/ReachQA

Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture

Wanyue Zhang, Yibin Huang, Yangbin Xu, JingJing Huang, Helu Zhi, Shuo Ren, Wang Xu, Jiajun Zhang

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV

Comments The benchmark MulSeT is available at https://huggingface.co/datasets/WanyueZhang/MulSeT

AgroSense: An Integrated Deep Learning System for Crop Recommendation via Soil Image Analysis and Nutrient Profiling

Vishal Pandey, Ranjita Das, Debasmita Biswas

机构 * Independent Researcher（独立研究者） ； Assistant Professor, Department of Computer Science and Engineering（计算机科学与工程系副教授） 纠错

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV

Comments Preprint, 23 pages, 6 images, 1 table

ST-Raptor: LLM-Powered Semi-Structured Table Question Answering

Zirui Tang, Boyu Niu, Xuanhe Zhou, Boxiu Li, Wei Zhou, Jiannan Wang, Guoliang Li, Xinyi Zhang, Fan Wu

机构 * Shanghai Jiao Tong University（上海交通大学） ； Simon Fraser University（西蒙弗雷泽大学） ； Tsinghua University（清华大学） ； Renmin University of China（中国人民大学） 纠错

专题命中 多模态评测 ：multi-modal(abstract)；分类 cs.AI

Comments Extension of our SIGMOD 2026 paper. Please refer to source code available at: https://github.com/weAIDB/ST-Raptor

Galaxea Open-World Dataset and G0 Dual-System VLA Model

Tao Jiang, Tianyuan Yuan, Yicheng Liu, Chenhao Lu, Jianning Cui, Xiao Liu, Shuiqi Cheng, Jiyang Gao, Huazhe Xu, Hang Zhao

机构 * Galaxea Team（Galaxea 团队） 纠错

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV

Comments https://opengalaxea.github.io/G0/

AI and Generative AI Transforming Disaster Management: A Survey of Damage Assessment and Response Techniques

Aman Raj, Lakshit Arora, Sanjay Surendranath Girija, Shashank Kapoor, Dipen Pradhan, Ankit Shetgaonkar

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.AI

Comments Accepted in IEEE Compsac 2025

Journal ref 2025 IEEE 49th Annual Computers, Software, and Applications Conference (COMPSAC)

IndusGCC: A Data Benchmark and Evaluation Framework for GUI-Based General Computer Control in Industrial Automation

Xiaoran Yang, Yuyang Du, Kexin Chen, Soung Chang Liew, Jiamin Lu, Ziyu Guo, Xiaoyan Liu, Qun Yang, Shiqi Xu, Xingyu Fan, Yuchen Pan, Taoyong Cui, Hongyu Deng, Boris Dudder, Jianzhang Pan, Qun Fang, Pheng Ann Heng

专题命中 多模态评测 ：multimodal(abstract)