视觉大模型 / VLM

PathoHR: Hierarchical Reasoning for Vision-Language Models in Pathology

Yating Huang, Ziyan Huang, Lintao Xiang, Qijun Yang, Hujun Yin

机构 * University of Manchester（曼彻斯特大学） ； South China University of Technology（华南理工大学） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

Comments Accept by EMNLP2025

Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models

Tan-Hanh Pham, Chris Ngo

机构 * Harvard Medical School, Harvard University（哈佛医学院、哈佛大学） ； Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital（阿提尼乌拉A.马丁努斯生物医学成像中心、麻省总医院） ； Knovel Engineering Lab, Singapore（Knovel工程实验室、新加坡） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

AURA: A Fine-Grained Benchmark and Decomposed Metric for Audio-Visual Reasoning

Siminfar Samakoush Galougah, Rishie Raj, Sanjoy Chowdhury, Sayan Nag, Ramani Duraiswami

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.CV

HumanPCR: Probing MLLM Capabilities in Diverse Human-Centric Scenes

Keliang Li, Hongze Shen, Hao Shi, Ruibing Hou, Hong Chang, Jie Huang, Chenghao Jia, Wen Wang, Yiling Wu, Dongmei Jiang, Shiguang Shan, Xilin Chen

机构 * Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, China（中国科学院智能信息处理重点实验室（中国科学院）、计算技术研究所、中国） 纠错

专题命中 视觉推理 ：MLLM(title)；分类 cs.CV

X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoning

Chee Ng, Liliang Sun, Shaoqing Tang

机构 * Universiti Teknologi Malaysia（马来西亚技术大学） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

Diagnostic Accuracy of Open-Source Vision-Language Models on Diverse Medical Imaging Tasks

Gustav Müller-Franzes, Debora Jutz, Jakob Nikolas Kather, Christiane Kuhl, Sven Nebelung, Daniel Truhn

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

Learning to Tune Like an Expert: Interpretable and Scene-Aware Navigation via MLLM Reasoning and CVAE-Based Adaptation

Yanbo Wang, Zipeng Fang, Lei Zhao, Weidong Chen

专题命中 视觉推理 ：MLLM(title)；分类 cs.CV

Enhancing Spatial Reasoning in Multimodal Large Language Models through Reasoning-based Segmentation

Zhenhua Ning, Zhuotao Tian, Shaoshuai Shi, Guangming Lu, Daojing He, Wenjie Pei, Li Jiang

机构 * Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳）） ； Pengcheng Laboratory（鹏城实验室） ； The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）） ； Voyager Research, Didi Chuxing 纠错

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.CV

Domain Specific Benchmarks for Evaluating Multimodal Large Language Models

Khizar Anjum, Muhammad Arbab Arshad, Kadhim Hayawi, Efstathios Polyzos, Asadullah Tariq, Mohamed Adel Serhani, Laiba Batool, Brady Lund, Nishith Reddy Mannuru, Ravi Varma Kumar Bevara, Taslim Mahbub, Muhammad Zeeshan Akram, Sakib Shahriar

机构 * Rutgers University（罗切斯特大学） ； Iowa State University（爱荷华州立大学） ； Zayed University（扎耶德大学） ； United Arab Emirates University（阿拉伯联合酋长国大学） ； University of Sharjah（沙迦大学） ； University of North Texas（北德克萨斯大学） ； George Washington University（乔治·华盛顿大学） ； University of Louisville（路易斯维尔大学） ； University of Guelph（圭尔夫大学） 纠错

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.LG

X-Driver: Explainable Autonomous Driving with Vision-Language Models

Wei Liu, Jiyuan Zhang, Binxiong Zheng, Yufeng Hu, Yingzhan Lin, Zengfeng Zeng

机构 * Harbin Institute of Technology, Shenzhen（哈尔滨工业大学（深圳）） ； Baidu Inc.（百度公司） 纠错

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

RBench-V: A Primary Assessment for Visual Reasoning Models with Multi-modal Outputs

Meng-Hao Guo, Xuanyu Chu, Qianrui Yang, Zhe-Han Mo, Yiqing Shen, Pei-lin Li, Xinjie Lin, Jinnian Zhang, Xin-Sheng Chen, Yi Zhang, Kiyohiro Nakayama, Zhengyang Geng, Houwen Peng, Han Hu, Shi-Min Hu

机构 * Tsinghua University（清华大学） ； Tencent Hunyuan X（腾讯文英实验室） ； Stanford University（斯坦福大学） ； Carnegie Mellon University（卡内基梅隆大学） 纠错

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.CV

Comments 12 pages

Unified Modeling Language Code Generation from Diagram Images Using Multimodal Large Language Models

Averi Bates, Ryan Vavricka, Shane Carleton, Ruosi Shao, Chongle Pan

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.LG

Comments Published in the Journal of Machine Learning with Applications, Author Contributions: Averi Bates: Methodology, Development, Analysis, Data Curation, Drafting, Review. Ryan Vavricka: Data Curation, Development, Review. Shane Carleton: Supervision, Funding. Ruosi Shao: Review. Chongle Pan: Supervision, Review

Journal ref Mach. Learn. Appl. 20 (2025) 100660

R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluation

Meng-Hao Guo, Jiajun Xu, Yi Zhang, Jiaxi Song, Haoyang Peng, Yi-Xuan Deng, Xinzhi Dong, Kiyohiro Nakayama, Zhengyang Geng, Chen Wang, Bolin Ni, Guo-Wei Yang, Yongming Rao, Houwen Peng, Han Hu, Gordon Wetzstein, Shi-min Hu

专题命中 视觉推理 ：MLLM(title)；分类 cs.CV

Comments 18pages

Grounding Agent Reasoning in Image Schemas: A Neurosymbolic Approach to Embodied Cognition

François Olivier, Zied Bouraoui

专题命中 视觉推理 ：grounding(title)；分类 cs.AI

Towards Agentic Recommender Systems in the Era of Multimodal Large Language Models

Chengkai Huang, Junda Wu, Yu Xia, Zixu Yu, Ruhan Wang, Tong Yu, Ruiyi Zhang, Ryan A. Rossi, Branislav Kveton, Dongruo Zhou, Julian McAuley, Lina Yao

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.AI

Do Multimodal Large Language Models Understand Welding?

Grigorii Khvatskii, Yong Suk Lee, Corey Angst, Maria Gibbs, Robert Landers, Nitesh V. Chawla

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.CV

Comments 16 pages

Can Large Vision Language Models Read Maps Like a Human?

Shuo Xing, Zezhou Sun, Shuangyu Xie, Kaiyuan Chen, Yanjia Huang, Yuping Wang, Jiachen Li, Dezhen Song, Zhengzhong Tu

专题命中 视觉推理 ：vision language model(title)；分类 cs.CV

Comments 35 pages

GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing

Rongyao Fang, Chengqi Duan, Kun Wang, Linjiang Huang, Hao Li, Shilin Yan, Hao Tian, Xingyu Zeng, Rui Zhao, Jifeng Dai, Xihui Liu, Hongsheng Li

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.CV

Comments Dataset and models are released in https://github.com/rongyaofang/GoT

A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models

Zhongzhan Huang, Shanshan Zhong, Pan Zhou, Shanghua Gao, Marinka Zitnik, Liang Lin

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.AI

Comments Accepted by TPAMI. arXiv admin note: text overlap with arXiv:2312.02439

SIFT: Grounding LLM Reasoning in Contexts via Stickers

Zihao Zeng, Xuyao Huang, Boxiu Li, Zhijie Deng

专题命中 视觉推理 ：grounding(title)；分类 cs.AI

Atari-GPT: Benchmarking Multimodal Large Language Models as Low-Level Policies in Atari Games

Nicholas R. Waytowich, Devin White, MD Sunbeam, Vinicius G. Goecks

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.AI

Comments Currently under review

FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models

Zhikai Zhang, Yitang Li, Haofeng Huang, Mingxian Lin, Li Yi

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.CV

Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding

Jiwan Chung, Sungjae Lee, Minseo Kim, Seungju Han, Ashkan Yousefpour, Jack Hessel, Youngjae Yu

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.CV

Comments 12 pages, 6 figures. Accepted as main paper in EMNLP 2024

Visual cognition in multimodal large language models

Luca M. Schulze Buschoff, Elif Akata, Matthias Bethge, Eric Schulz

专题命中 视觉推理 ：multimodal large language model(title)；分类 cs.LG

Comments Updated manuscript

Multi-Frame Vision-Language Model for Long-form Reasoning in Driver Behavior Analysis

Hiroshi Takato, Hiroshi Tsutsui, Komei Soda, Hidetaka Kamigaito

专题命中 视觉推理 ：vision-language model(title)；分类 cs.CV

Comments On-going work

Open-World Visual Reasoning by a Neuro-Symbolic Program of Zero-Shot Symbols

Gertjan Burghouts, Fieke Hillerström, Erwin Walraven, Michael van Bekkum, Frank Ruis, Joris Sijs, Jelle van Mil, Judith Dijk

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.LG

Comments 12 pages

Journal ref International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI) 2024

Disentangling Knowledge-based and Visual Reasoning by Question Decomposition in KB-VQA

Elham J. Barezi, Parisa Kordjamshidi

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.AI

Beyond Pixels: Exploring Human-Readable SVG Generation for Simple Images with Vision Language Models

Tong Zhang, Haoyang Liu, Peiyan Zhang, Yuxuan Cheng, Haohan Wang

专题命中 视觉推理 ：vision language model(title)；分类 cs.CV

Comments 10 pages, 7 figures

Deep Neural Networks for Visual Reasoning

Thao Minh Le

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.CV

Comments PhD thesis

V-PROM: A Benchmark for Visual Reasoning Using Visual Progressive Matrices

Damien Teney, Peng Wang, Jiewei Cao, Lingqiao Liu, Chunhua Shen, Anton van den Hengel

专题命中 视觉推理 ：visual reasoning(title)；分类 cs.CV