视觉大模型 / VLM

VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning

Haozhe Wang, Chao Qu, Zuming Huang, Wei Chu, Fangzhen Lin, Wenhu Chen

机构 * HKUST（香港科技大学） ； University of Waterloo（滑铁卢大学） ； Vector Institute（向量研究所） 纠错

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.AI、cs.LG

Comments Preprint

Weaving Context Across Images: Improving Vision-Language Models through Focus-Centric Visual Chains

Juntian Zhang, Chuanqi cheng, Yuhan Liu, Wei Liu, Jian Luan, Rui Yan

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学人工智能学院） 纠错

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

VCR: A Task for Pixel-Level Complex Reasoning in Vision Language Models via Restoring Occluded Text

Tianyu Zhang, Suyuchen Wang, Lu Li, Ge Zhang, Perouz Taslakian, Sai Rajeswar, Jie Fu, Bang Liu, Yoshua Bengio

专题命中 视觉推理 ：vision language model(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted at ICLR 2025. Original paper name: VCR: Visual Caption Restoration

EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios

Lu Qiu, Yi Chen, Yuying Ge, Yixiao Ge, Ying Shan, Xihui Liu

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.CV、cs.AI

Comments Code & data are available at: https://qiulu66.github.io/egoplanbench2/

MDK12-Bench: A Multi-Discipline Benchmark for Evaluating Reasoning in Multimodal Large Language Models

Pengfei Zhou, Fanrui Zhang, Xiaopeng Peng, Zhaopan Xu, Jiaxin Ai, Yansheng Qiu, Chuanhao Li, Zhen Li, Ming Li, Yukang Feng, Jianwen Sun, Haoquan Zhang, Zizhen Li, Xiaofeng Mao, Wangbo Zhao, Kai Wang, Xiaojun Chang, Wenqi Shao, Yang You, Kaipeng Zhang

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.CV、cs.AI

Comments 11 pages, 8 figures

Advancing Multimodal In-Context Learning in Large Vision-Language Models with Task-aware Demonstrations

Yanshu Li

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ICLR 2025 Workshop on Reasoning and Planning for LLMs, 25 pages, 13 tables

Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligence

Anita Rau, Mark Endo, Josiah Aklilu, Jaewoo Heo, Khaled Saab, Alberto Paderno, Jeffrey Jopling, F. Christopher Holsinger, Serena Yeung-Levy

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

NTSEBENCH: Cognitive Reasoning Benchmark for Vision Language Models

Pranshu Pandya, Vatsal Gupta, Agney S Talwarr, Tushar Kataria, Dan Roth, Vivek Gupta

专题命中 视觉推理 ：vision language model(title)；visual reasoning(abstract)；分类 cs.CV、cs.AI

Comments 28 pages, 3 figures, 12 tables

TopV-Nav: Unlocking the Top-View Spatial Reasoning Potential of MLLM for Zero-shot Object Navigation

Linqing Zhong, Chen Gao, Zihan Ding, Yue Liao, Huimin Ma, Shifeng Zhang, Xu Zhou, Si Liu

专题命中 视觉推理 ：MLLM(title,abstract)；分类 cs.CV、cs.AI

Comments 10 pages

Enhancing Zero-Shot Image Recognition in Vision-Language Models through Human-like Concept Guidance

Hui Liu, Wenya Wang, Kecheng Chen, Jie Liu, Yibing Liu, Tiexin Qin, Peisong He, Xinghao Jiang, Haoliang Li

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.LG

Comments 21 pages, 7 figures 7 tables

SeqAfford: Sequential 3D Affordance Reasoning via Multimodal Large Language Model

Chunlin Yu, Hanqing Wang, Ye Shi, Haoyang Luo, Sibei Yang, Jingyi Yu, Jingya Wang

专题命中 视觉推理 ：multimodal large language model(title)；grounding(abstract)；分类 cs.CV、cs.AI

VISCO: Benchmarking Fine-Grained Critique and Correction Towards Self-Improvement in Visual Reasoning

Xueqing Wu, Yuheng Ding, Bingxuan Li, Pan Lu, Da Yin, Kai-Wei Chang, Nanyun Peng

专题命中 视觉推理 ：visual reasoning(title)；vision-language model(abstract)；分类 cs.CV、cs.AI

Comments CVPR 2025. https://visco-benchmark.github.io/

CoMT: A Novel Benchmark for Chain of Multi-modal Thought on Large Vision-Language Models

Zihui Cheng, Qiguang Chen, Jin Zhang, Hao Fei, Xiaocheng Feng, Wanxiang Che, Min Li, Libo Qin

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted at AAAI 2025; Project Page: https://github.com/czhhzc/CoMT

DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models

Chengke Zou, Xingang Guo, Rui Yang, Junyu Zhang, Bin Hu, Huan Zhang

专题命中 视觉推理 ：vision language model(title)；vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted by ICLR 2025

HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks

Fengji Zhang, Linquan Wu, Huiyu Bai, Guancheng Lin, Xiao Li, Xiao Yu, Yue Wang, Bei Chen, Jacky Keung

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Comments homepage https://humaneval-v.github.io/

Bridging Visualization and Optimization: Multimodal Large Language Models on Graph-Structured Combinatorial Optimization

Jie Zhao, Kang Hao Cheong, Witold Pedrycz

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.AI、cs.LG

Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Search

Huanjin Yao, Jiaxing Huang, Wenhao Wu, Jingyi Zhang, Yibo Wang, Shunyu Liu, Yingjie Wang, Yuxin Song, Haocheng Feng, Li Shen, Dacheng Tao

专题命中 视觉推理 ：MLLM(title,abstract)；分类 cs.CV、cs.AI

Comments Technical report

TalkWithMachines: Enhancing Human-Robot Interaction for Interpretable Industrial Robotics Through Large/Vision Language Models

Ammar N. Abbas, Csaba Beleznai

专题命中 视觉推理 ：vision language model(title,abstract)；分类 cs.AI、cs.LG

Comments This paper has been accepted for publication in the proceedings of the 2024 Eighth IEEE International Conference on Robotic Computing (IRC)

IRR: Image Review Ranking Framework for Evaluating Vision-Language Models

Kazuki Hayashi, Kazuma Onishi, Toma Suzuki, Yusuke Ide, Seiji Gobara, Shigeki Saito, Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, Taro Watanabe

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments 18pages, Accepted at COLING25

First Multi-Dimensional Evaluation of Flowchart Comprehension for Multimodal Large Language Models

Enming Zhang, Ruobing Yao, Huanyong Liu, Junhui Yu, Jiale Wang

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.CV、cs.AI

Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models

Jiayu Wang, Yifei Ming, Zhenmei Shi, Vibhav Vineet, Xin Wang, Yixuan Li, Neel Joshi

专题命中 视觉推理 ：vision language model(title)；vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted to NeurIPS 2024

DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution

Yang Yue, Yulin Wang, Bingyi Kang, Yizeng Han, Shenzhi Wang, Shiji Song, Jiashi Feng, Gao Huang

专题命中 视觉推理 ：multimodal large language model(title)；MLLM(abstract)；分类 cs.AI、cs.LG

Comments 25 pages, 6 figures, NeurIPS 2024

Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties

Keunwoo Peter Yu, Zheyuan Zhang, Fengyuan Hu, Shane Storks, Joyce Chai

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments 16 pages, LaTeX; Accepted to EMNLP 2024 Main

Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning

Xiaoye Qu, Jiashuo Sun, Wei Wei, Yu Cheng

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments 13 pages, 7 tables, 7 figures

Every Part Matters: Integrity Verification of Scientific Figures Based on Multimodal Large Language Models

Xiang Shi, Jiawei Liu, Yinpeng Liu, Qikai Cheng, Wei Lu

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.CV、cs.AI

Comments 28 pages, 11 figures, under review

In-Context Learning Improves Compositional Understanding of Vision-Language Models

Matteo Nulli, Anesa Ibrahimi, Avik Pal, Hoshe Lee, Ivona Najdenkoska

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Large Vision-Language Models as Emotion Recognizers in Context Awareness

Yuxuan Lei, Dingkang Yang, Zhaoyu Chen, Jiawei Chen, Peng Zhai, Lihua Zhang

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

TopViewRS: Vision-Language Models as Top-View Spatial Reasoners

Chengzu Li, Caiqi Zhang, Han Zhou, Nigel Collier, Anna Korhonen, Ivan Vulić

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.LG

Comments 9 pages, 3 figures, 3 tables (21 pages, 4 figures, 15 tables including references and appendices)

Slot Abstractors: Toward Scalable Abstract Visual Reasoning

Shanka Subhra Mondal, Jonathan D. Cohen, Taylor W. Webb

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.LG

Comments 18 pages, 9 figures

InsightSee: Advancing Multi-agent Vision-Language Models for Enhanced Visual Understanding

Huaxiang Zhang, Yaojia Mu, Guo-Niu Zhu, Zhongxue Gan

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI