多模态大模型 - arXivDaily 专题

2506.17939 2025-10-29 cs.CV cs.AI 84%

GEMeX-RMCoT: An Enhanced Med-VQA Dataset for Region-Aware Multimodal Chain-of-Thought Reasoning

Bo Liu, Xiangyu Zhao, Along He, Yidi Chen, Huazhu Fu, Xiao-Ming Wu

机构 * The Hong Kong Polytechnic University（香港理工大学）； Shenzhen University（深圳大学）； West China Hospital of Sichuan University（四川大学华西医院）； IHPC, Agency for Science, Technology and Research（科技研究局IHPC）

专题命中多模态评测：multimodal(title,abstract)；multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Accepted at ACM MM 2025 (also known as GEMeX-ThinkVG)

2507.12841 2025-10-29 cs.CV 83%

AnyCap Project: A Unified Framework, Dataset, and Benchmark for Controllable Omni-modal Captioning

Yiming Ren, Zhiqiang Lin, Yu Li, Gao Meng, Weiyun Wang, Junjie Wang, Zicheng Lin, Jifeng Dai, Yujiu Yang, Wenhai Wang, Ruihang Chu

机构 * Tsinghua University（清华大学）； Shanghai AI Laboratory（上海人工智能实验室）； Fudan University（复旦大学）； The Chinese University of Hong Kong（香港中文大学）

专题命中多模态评测：omni-modal(title,abstract)；multimodal(abstract)；分类 cs.CV

2510.22672 2025-10-29 cs.CV cs.CL cs.RO 81%

Look and Tell: A Dataset for Multimodal Grounding Across Egocentric and Exocentric Views

Anna Deichler, Jonas Beskow

机构 * KTH Royal Institute of Technology（皇家理工学院）

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 10 pages, 6 figures, 2 tables. Accepted to the NeurIPS 2025 Workshop on SPACE in Vision, Language, and Embodied AI (SpaVLE). Dataset: https://huggingface.co/datasets/annadeichler/KTH-ARIA-referential

2510.23727 2025-10-29 cs.LG cs.CL 79%

MUStReason: A Benchmark for Diagnosing Pragmatic Reasoning in Video-LMs for Multimodal Sarcasm Detection

Anisha Saha, Varsha Suresh, Timothy Hospedales, Vera Demberg

机构 * Max Planck Institute for Informatics, Saarland Informatics Campus（马克斯·普朗克研究所信息学研究所，萨尔兰州信息学校园）； Saarland University（萨尔兰州大学）； The University of Edinburgh（爱丁堡大学）； Samsung AI Center, Cambridge（三星人工智能中心，剑桥）

专题命中多模态评测：multimodal(title,abstract)；分类 cs.CL

2507.01271 2025-10-29 cs.LG cs.AI 79%

PULSE: Practical Evaluation Scenarios for Large Multimodal Model Unlearning

Tatsuki Kawakami, Kazuki Egashira, Atsuyuki Miyai, Go Irie, Kiyoharu Aizawa

机构 * The University of Tokyo（东京大学）； Tokyo University of Science（东京科学大学）

专题命中多模态评测：multimodal(title,abstract)；分类 cs.AI

Comments Accepted at NeurIPS 2025 Workshop: Evaluating the Evolving LLM Lifecycle

2505.11842 2025-10-29 cs.CV cs.CL 62%

Video-SafetyBench: A Benchmark for Safety Evaluation of Video LVLMs

Xuannan Liu, Zekun Li, Zheqi He, Peipei Li, Shuhan Xia, Xing Cui, Huaibo Huang, Xi Yang, Ran He

机构 * Beijing University of Posts and Telecommunications（北京邮电大学）； Beijing Academy of Artificial Intelligence（北京人工智能研究院）； University of California, Santa Barbara（加州大学圣芭芭拉分校）； Center for Research on Intelligent Perception and Computing, NLPR, CASIA（中国科学院CASIA智能感知与计算中心）

专题命中多模态评测：multimodal(abstract)；分类 cs.CV、cs.CL

Comments Accepted by NeurIPS 2025 Dataset and Benchmark Track, Project page: https://liuxuannan.github.io/Video-SafetyBench.github.io/

2506.04897 2025-10-29 cs.CV 61%

From Objects to Anywhere: A Holistic Benchmark for Multi-level Visual Grounding in 3D Scenes

Tianxu Wang, Zhuofan Zhang, Ziyu Zhu, Yue Fan, Jing Xiong, Pengxiang Li, Xiaojian Ma, Qing Li

机构 * State Key Laboratory of General Artificial Intelligence, BIGAI（通用人工智能国家重点实验室，BIGAI）； Tsinghua University（清华大学）； Peking University（北京大学）； Beijing Institute of Technology（北京理工大学）

专题命中多模态评测：multimodal(abstract,comments)；分类 cs.CV

Comments Update v3 of the NeurIPS 2025 Datasets and Benchmarks paper (v2), including additional evaluations of state-of-the-art multimodal large language models. Project page: https://anywhere-3d.github.io/

2508.17102 2025-10-29 cs.CV 57%

GRASP: Geospatial pixel Reasoning viA Structured Policy learning

Chengjie Jiang, Yunqi Zhou, Jiafeng Yan, Jing Li, Jiayang Li, Yue Zhou, Hongjie He, Jonathan Li

机构 * Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）； School of Information, Central University of Finance and Economics（中央财经大学信息学院）； Key Laboratory of Geographic Information Science (Ministry of Education), East China Normal University（教育部地理信息科学重点实验室，华东师范大学）； School of Electronic and Computer Engineering, Peking University（北京大学电子工程学院）； Department of Geography and Environmental Management, University of Waterloo（滑铁卢大学地理与环境管理系）

专题命中多模态评测：multimodal(abstract)；分类 cs.CV

Comments 15 pages, 9 figures

2505.20510 2025-10-29 cs.CV 57%

CPathAgent: An Agent-based Foundation Model for Interpretable High-Resolution Pathology Image Analysis Mimicking Pathologists' Diagnostic Logic

Yuxuan Sun, Yixuan Si, Chenglu Zhu, Kai Zhang, Zhongyi Shui, Bowen Ding, Tao Lin, Lin Yang

机构 * College of Computer Science and Technology, Zhejiang University, China（浙江大学计算机科学与技术学院）； Research Center for Industries of the Future and School of Engineering, Westlake University, China（未来产业研究中心和西湖大学工程学院）； Department of Computer Science and Engineering, The Ohio State University, USA（俄亥俄州立大学计算机科学与工程系）

专题命中多模态评测：multimodal(abstract)；分类 cs.CV

Comments 52 pages, 34 figures

2504.06560 2025-10-29 cs.CL 57%

NeedleInATable: Exploring Long-Context Capability of Large Language Models towards Long-Structured Tables

Lanrui Wang, Mingyu Zheng, Hongyin Tang, Zheng Lin, Yanan Cao, Jingang Wang, Xunliang Cai, Weiping Wang

机构 * Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）； School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络安全学院）

专题命中多模态评测：multimodal(abstract)；分类 cs.CL

Comments Accepted by NeurIPS 2025

2510.22414 2025-10-29 cs.HC 50%

Complementary Human-AI Clinical Reasoning in Ophthalmology

Mertcan Sevgi, Fares Antaki, Abdullah Zafar Khan, Ariel Yuhan Ong, David Adrian Merle, Kuang Hu, Shafi Balal, Sophie-Christin Kornelia Ernst, Josef Huemer, Gabriel T. Kaufmann, Hagar Khalid, Faye Levina, Celeste Limoli, Ana Paula Ribeiro Reis, Samir Touma, Anil Palepu, Khaled Saab, Ryutaro Tanno, Valentin Liévin, Tao Tu, Yong Cheng, Mike Schaekermann, S. Sara Mahdavi, Elahe Vedadi, David Stutz, Vivek Natarajan, Alan Karthikesalingam, Pearse A. Keane, Wei-Hung Weng

专题命中多模态评测：multimodal(abstract)

2505.09539 2025-10-29 cs.IR 50%

GlobalMood: A cross-cultural benchmark for music emotion recognition

Harin Lee, Elif Çelen, Peter Harrison, Manuel Anglada-Tort, Pol van Rijn, Minsu Park, Marc Schönwiesner, Nori Jacoby