多模态大模型

FBMS: An R Package for Flexible Bayesian Model Selection and Model Averaging

Florian Frommlet, Jon Lachmann, Geir Storvik, Aliaksandr Hubin

专题命中 多模态生成 ：multi-modal(abstract)

Comments 69 pages, 5 tables, 5 figures

Operating advanced scientific instruments with AI agents that learn on the job

Aikaterini Vriza, Michael H. Prince, Tao Zhou, Henry Chan, Mathew J. Cherukara

专题命中 多模态生成 ：multimodal(abstract)

PreGenie: An Agentic Framework for High-quality Visual Presentation Generation

Xiaojie Xu, Xinli Xu, Sirui Chen, Haoyu Chen, Fan Zhang, Ying-Cong Chen

机构 * The Hong Kong University of Science and Technology(Guangzhou)（香港科技大学（广州）） ； The Hong Kong University of Science and Technology（香港科技大学） ； Shanghai AI Laboratory（上海人工智能实验室） 纠错

专题命中 多模态生成 ：multimodal(abstract)

Comments Accepted at EMNLP 2025, Findings

Opportunities and Applications of GenAI in Smart Cities: A User-Centric Survey

Ankit Shetgaonkar, Dipen Pradhan, Lakshit Arora, Sanjay Surendranath Girija, Shashank Kapoor, Aman Raj

专题命中 多模态生成 ：multimodal(abstract)

Comments Accepted in IEEE COINS 2025

Journal ref 2025 IEEE International Conference on Omni-layer Intelligent Systems (COINS)

VideoRewardBench: Comprehensive Evaluation of Multimodal Reward Models for Video Understanding

Zhihong Zhang, Xiaojian Huang, Jin Xu, Zhuodong Luo, Xinzhi Wang, Jiansheng Wei, Xuejin Chen

机构 * University of Science and Technology of China（中国科学技术大学） ； Huawei Noah’s Ark Lab（华为诺亚实验室） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.CV、cs.AI

Comments https://videorewardbench.github.io/

Prompt-based Multimodal Semantic Communication for Multi-spectral Image Segmentation

Haoshuo Zhang, Yufei Bo, Hongwei Zhang, Meixia Tao

专题命中 多模态评测 ：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.MM

Comments The full-length version, arXiv:2508.20057, has been updated

Advancing Grounded Multimodal Named Entity Recognition via LLM-Based Reformulation and Box-Based Segmentation

Jinyuan Li, Ziyan Li, Han Li, Jianfei Yu, Rui Xia, Di Sun, Gang Pan

机构 * College of Intelligence and Computing, Tianjin University（智能与计算学院，天津大学） ； NJUST（南京理工大学） ； College of Mathematics, Taiyuan University of Technology（数学学院，太原科技大学） ； Tianjin University of Science and Technology（天津科技大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.MM

Comments Extension of our Findings of EMNLP 2023 & ACL 2024 paper, IEEE Transactions on Multimedia accepted on July 19, 2025

Detecting Visual Information Manipulation Attacks in Augmented Reality: A Multimodal Semantic Reasoning Approach

Yanming Xiu, Maria Gorlatova

机构 * Duke University（杜克大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Comments The paper has been accepted to the 2025 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), and selected for publication in the 2025 IEEE Transactions on Visualization and Computer Graphics (TVCG) special issue

A Multimodal Cross-View Model for Predicting Postoperative Neck Pain in Cervical Spondylosis Patients

Jingyang Shan, Qishuai Yu, Jiacen Liu, Shaolin Zhang, Wen Shen, Yanxiao Zhao, Tianyi Wang, Xiaolin Qin, Yiheng Yin

机构 * Chengdu Institute of Computer Applications, Chinese Academy of Sciences（成都计算机应用研究所，中国科学院） ； University of Chinese Academy of Sciences（中国科学院大学） ； Department of Neurosurgery, the First Medical Center, Chinese PLA General Hospital（中国人民解放军总医院神经外科部） ； School of Medicine, Nankai University（南开大学医学院） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CV

Text Reinforcement for Multimodal Time Series Forecasting

Chen Su, Yuanhe Tian, Yan Song, Yongdong Zhang

机构 * University of Science and Technology of China（中国科学技术大学） ； University of Washington（华盛顿大学） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.CL

CLARE: Cognitive Load Assessment in REaltime with Multimodal Data

Anubhav Bhatti, Prithila Angkan, Behnam Behinaein, Zunayed Mahmud, Dirk Rodenburg, Heather Braund, P. James Mclellan, Aaron Ruberto, Geoffery Harrison, Daryl Wilson, Adam Szulewski, Dan Howes, Ali Etemad, Paul Hungler

机构 * Department of Electrical and Computer Engineering and Ingenuity Research Labs（电气与计算机工程系和Ingenuity研究实验室） ； Queen’s University（女王大学） ； Ingenuity Research Labs（Ingenuity研究实验室） ； Department of Psychology（心理学系） ； School of Medicine（医学院） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)；分类 cs.AI

Comments 13 pages, 10 figures, 6 tables

Journal ref IEEE Transactions on Cognitive and Developmental Systems, 2025

REVELIO -- Universal Multimodal Task Load Estimation for Cross-Domain Generalization

Maximilian P. Oppelt, Andreas Foltyn, Nadine R. Lang-Richter, Bjoern M. Eskofier

机构 * Fraunhofer Institute for Integrated Circuits IIS（弗劳恩霍夫集成电路研究所） ； Friedrich-Alexander-University Erlangen Nuremberg（埃朗根-纽伦堡弗赖堡-亚历山大大学） ； Helmholtz Zentrum München（亥姆霍兹慕尼黑研究中心） 纠错

专题命中 多模态评测 ：multimodal(title,abstract)

R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learning

Qi Yang, Bolin Ni, Shiming Xiang, Han Hu, Houwen Peng, Jie Jiang

机构 * Tencent Hunyuan Team（腾讯文言团队） ； Institute of Automation, CAS（中国科学院自动化研究所） 纠错

专题命中 多模态评测 ：multimodal(abstract)；MLLM(abstract)；分类 cs.CV、cs.AI

Comments 20 pages, 14 figures, 5 tables

Omnidirectional Spatial Modeling from Correlated Panoramas

Xinshen Zhang, Tongxi Fu, Xu Zheng

机构 * The Hong Kong Polytechnic University（香港理工大学） ； Zhejiang Sci-Tech University（浙江科技学院） 纠错

专题命中 多模态评测 ：multi-modal(abstract)；MLLM(abstract)；分类 cs.CV

Distill Visual Chart Reasoning Ability from LLMs to MLLMs

Wei He, Zhiheng Xi, Wanxu Zhao, Xiaoran Fan, Yiwen Ding, Zifei Shan, Tao Gui, Qi Zhang, Xuanjing Huang

机构 * School of Computer Science, Fudan University（复旦大学计算机学院） ； Weixin Group, Tencent（腾讯Weixin部门） ； Shanghai Innovation Institute（上海创新研究院） ； Shanghai Key Lab of Intelligent Information Processing（上海智能信息处理重点实验室） 纠错

专题命中 多模态评测 ：multimodal(abstract)；cross-modal(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025 Findings. The code and dataset are publicly available at https://github.com/hewei2001/ReachQA

Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture

Wanyue Zhang, Yibin Huang, Yangbin Xu, JingJing Huang, Helu Zhi, Shuo Ren, Wang Xu, Jiajun Zhang

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV

Comments The benchmark MulSeT is available at https://huggingface.co/datasets/WanyueZhang/MulSeT

AgroSense: An Integrated Deep Learning System for Crop Recommendation via Soil Image Analysis and Nutrient Profiling

Vishal Pandey, Ranjita Das, Debasmita Biswas

机构 * Independent Researcher（独立研究者） ； Assistant Professor, Department of Computer Science and Engineering（计算机科学与工程系副教授） 纠错

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV

Comments Preprint, 23 pages, 6 images, 1 table

ST-Raptor: LLM-Powered Semi-Structured Table Question Answering

Zirui Tang, Boyu Niu, Xuanhe Zhou, Boxiu Li, Wei Zhou, Jiannan Wang, Guoliang Li, Xinyi Zhang, Fan Wu

机构 * Shanghai Jiao Tong University（上海交通大学） ； Simon Fraser University（西蒙弗雷泽大学） ； Tsinghua University（清华大学） ； Renmin University of China（中国人民大学） 纠错

专题命中 多模态评测 ：multi-modal(abstract)；分类 cs.AI

Comments Extension of our SIGMOD 2026 paper. Please refer to source code available at: https://github.com/weAIDB/ST-Raptor

Galaxea Open-World Dataset and G0 Dual-System VLA Model

Tao Jiang, Tianyuan Yuan, Yicheng Liu, Chenhao Lu, Jianning Cui, Xiao Liu, Shuiqi Cheng, Jiyang Gao, Huazhe Xu, Hang Zhao

机构 * Galaxea Team（Galaxea 团队） 纠错

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.CV

Comments https://opengalaxea.github.io/G0/

AI and Generative AI Transforming Disaster Management: A Survey of Damage Assessment and Response Techniques

Aman Raj, Lakshit Arora, Sanjay Surendranath Girija, Shashank Kapoor, Dipen Pradhan, Ankit Shetgaonkar

专题命中 多模态评测 ：multimodal(abstract)；分类 cs.AI

Comments Accepted in IEEE Compsac 2025

Journal ref 2025 IEEE 49th Annual Computers, Software, and Applications Conference (COMPSAC)

IndusGCC: A Data Benchmark and Evaluation Framework for GUI-Based General Computer Control in Industrial Automation

Xiaoran Yang, Yuyang Du, Kexin Chen, Soung Chang Liew, Jiamin Lu, Ziyu Guo, Xiaoyan Liu, Qun Yang, Shiqi Xu, Xingyu Fan, Yuchen Pan, Taoyong Cui, Hongyu Deng, Boris Dudder, Jianzhang Pan, Qun Fang, Pheng Ann Heng

专题命中 多模态评测 ：multimodal(abstract)

Multi-Modal Machine Learning Framework for Predicting Early Recurrence of Brain Tumors Using MRI and Clinical Biomarkers

Cheng Cheng, Zeping Chen, Rui Xie, Peiyao Zheng, Xavier Wang

机构 * Department of Encephalopathy, Chengdu Pidu District Hospital of Traditional Chinese Medicine（脑病科，成都_pidu区中医医院） ； Department of Tuina, Chengdu Pidu District Hospital of Traditional Chinese Medicine（推拿科，成都_pidu区中医医院） ； Wuhan Hospital of Integrated Traditional Chinese and Western Medicine, Affiliated to Hubei University of Chinese Medicine（中西医结合医院，湖北中医药大学附属医院） ； Department of Electrical and Computer Engineering, Carnegie Mellon University（电气与计算机工程系，卡内基梅隆大学） 纠错

专题命中 多模态Agent ：multi-modal(title,abstract)

WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agent

Xinyu Geng, Peng Xia, Zhen Zhang, Xinyu Wang, Qiuchen Wang, Ruixue Ding, Chenxi Wang, Jialong Wu, Yida Zhao, Kuan Li, Yong Jiang, Pengjun Xie, Fei Huang, Jingren Zhou

专题命中 多模态Agent ：multimodal(abstract)；multi-modal(abstract)

OmniActor: A Generalist GUI and Embodied Agent for 2D&3D Worlds

Longrong Yang, Zhixiong Zeng, Yufeng Zhong, Jing Huang, Liming Zheng, Lei Chen, Haibo Qiu, Zequn Qin, Lin Ma, Xi Li

机构 * Meituan（美团） ； Zhejiang University（浙江大学） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Multi-Agent System for Comprehensive Soccer Understanding

Jiayuan Rao, Zifeng Li, Haoning Wu, Ya Zhang, Yanfeng Wang, Weidi Xie

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Accepted by ACM MM 2025; Project Page: https://jyrao.github.io/SoccerAgent/

Structuring GUI Elements through Vision Language Models: Towards Action Space Generation

Yi Xu, Yesheng Zhang, Jiajia Liu, Jingdong Chen

机构 * Shanghai Jiao Tong University（上海交通大学） ； Ant Group（蚂蚁集团） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 10pageV0

Graph-Augmented Large Language Model Agents: Current Progress and Future Prospects

Yixin Liu, Guibin Zhang, Kun Wang, Shiyuan Li, Shirui Pan

机构 * Griffith University（格里菲斯大学） ； National University of Singapore（国立新加坡大学） ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 15 pages, 7 figures

Semi-on-Demand Transit Feeders with Shared Autonomous Vehicles and Reinforcement-Learning-Based Zonal Dispatching Control

Max T. M. Ng, Roman Engelhardt, Florian Dandl, Hani S. Mahmassani, Klaus Bogenberger

机构 * Northwestern University Transportation Center（西北大学交通中心） ； Chair of Traffic Engineering and Control, Technical University of Munich（慕尼黑技术大学交通工程与控制教授职位） 纠错

专题命中 多模态Agent ：multimodal(abstract)

Comments 6 pages, 9 figures, published in 2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC), Edmonton, Canada, 24-27 September 2024

Journal ref 2024 IEEE 27th International Conference on Intelligent Transportation Systems (ITSC)

CARIS: A Context-Adaptable Robot Interface System for Personalized and Scalable Human-Robot Interaction

Felipe Arias-Russi, Yuanchen Bai, Angelique Taylor

机构 * Department of Systems and Computing Engineering, Mathematics, Universidad de los Andes（系统与计算工程系、数学系，Universidad de los Andes大学） ； Department of Information Science, Cornell Tech（信息科学系，Cornell Tech） 纠错

专题命中 多模态Agent ：multimodal(abstract)

Needle Biopsy And Fiber-Optic Compatible Robotic Insertion Platform

Fanxin Wang, Yikun Cheng, Chuyuan Tao, Rohit Bhargava, Thenkurussi Kesavadas

机构 * Department of Mechatronics and Robotics（机械电子与机器人系） ； Department of Mechanical Science and Engineering（机械科学与工程系） ； Beckman Institute for Advanced Science and Technology（先进科学与技术研究所） ； Division of Research and Economic Development（研究与经济开发部门） 纠错

专题命中 多模态Agent ：multi-modal(abstract)

Comments Presented in EMBC 2025