视觉大模型 / VLM

CoMT: A Novel Benchmark for Chain of Multi-modal Thought on Large Vision-Language Models

Zihui Cheng, Qiguang Chen, Jin Zhang, Hao Fei, Xiaocheng Feng, Wanxiang Che, Min Li, Libo Qin

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted at AAAI 2025; Project Page: https://github.com/czhhzc/CoMT

DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models

Chengke Zou, Xingang Guo, Rui Yang, Junyu Zhang, Bin Hu, Huan Zhang

专题命中 视觉推理 ：vision language model(title)；vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted by ICLR 2025

HumanEval-V: Benchmarking High-Level Visual Reasoning with Complex Diagrams in Coding Tasks

Fengji Zhang, Linquan Wu, Huiyu Bai, Guancheng Lin, Xiao Li, Xiao Yu, Yue Wang, Bei Chen, Jacky Keung

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Comments homepage https://humaneval-v.github.io/

Bridging Visualization and Optimization: Multimodal Large Language Models on Graph-Structured Combinatorial Optimization

Jie Zhao, Kang Hao Cheong, Witold Pedrycz

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.AI、cs.LG

Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Search

Huanjin Yao, Jiaxing Huang, Wenhao Wu, Jingyi Zhang, Yibo Wang, Shunyu Liu, Yingjie Wang, Yuxin Song, Haocheng Feng, Li Shen, Dacheng Tao

专题命中 视觉推理 ：MLLM(title,abstract)；分类 cs.CV、cs.AI

Comments Technical report

TalkWithMachines: Enhancing Human-Robot Interaction for Interpretable Industrial Robotics Through Large/Vision Language Models

Ammar N. Abbas, Csaba Beleznai

专题命中 视觉推理 ：vision language model(title,abstract)；分类 cs.AI、cs.LG

Comments This paper has been accepted for publication in the proceedings of the 2024 Eighth IEEE International Conference on Robotic Computing (IRC)

IRR: Image Review Ranking Framework for Evaluating Vision-Language Models

Kazuki Hayashi, Kazuma Onishi, Toma Suzuki, Yusuke Ide, Seiji Gobara, Shigeki Saito, Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, Taro Watanabe

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments 18pages, Accepted at COLING25

First Multi-Dimensional Evaluation of Flowchart Comprehension for Multimodal Large Language Models

Enming Zhang, Ruobing Yao, Huanyong Liu, Junhui Yu, Jiale Wang

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.CV、cs.AI

Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models

Jiayu Wang, Yifei Ming, Zhenmei Shi, Vibhav Vineet, Xin Wang, Yixuan Li, Neel Joshi

专题命中 视觉推理 ：vision language model(title)；vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted to NeurIPS 2024

DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution

Yang Yue, Yulin Wang, Bingyi Kang, Yizeng Han, Shenzhi Wang, Shiji Song, Jiashi Feng, Gao Huang

专题命中 视觉推理 ：multimodal large language model(title)；MLLM(abstract)；分类 cs.AI、cs.LG

Comments 25 pages, 6 figures, NeurIPS 2024

Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties

Keunwoo Peter Yu, Zheyuan Zhang, Fengyuan Hu, Shane Storks, Joyce Chai

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments 16 pages, LaTeX; Accepted to EMNLP 2024 Main

Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning

Xiaoye Qu, Jiashuo Sun, Wei Wei, Yu Cheng

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments 13 pages, 7 tables, 7 figures

Every Part Matters: Integrity Verification of Scientific Figures Based on Multimodal Large Language Models

Xiang Shi, Jiawei Liu, Yinpeng Liu, Qikai Cheng, Wei Lu

专题命中 视觉推理 ：multimodal large language model(title,abstract)；分类 cs.CV、cs.AI

Comments 28 pages, 11 figures, under review

In-Context Learning Improves Compositional Understanding of Vision-Language Models

Matteo Nulli, Anesa Ibrahimi, Avik Pal, Hoshe Lee, Ivona Najdenkoska

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Large Vision-Language Models as Emotion Recognizers in Context Awareness

Yuxuan Lei, Dingkang Yang, Zhaoyu Chen, Jiawei Chen, Peng Zhai, Lihua Zhang

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

TopViewRS: Vision-Language Models as Top-View Spatial Reasoners

Chengzu Li, Caiqi Zhang, Han Zhou, Nigel Collier, Anna Korhonen, Ivan Vulić

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.LG

Comments 9 pages, 3 figures, 3 tables (21 pages, 4 figures, 15 tables including references and appendices)

Slot Abstractors: Toward Scalable Abstract Visual Reasoning

Shanka Subhra Mondal, Jonathan D. Cohen, Taylor W. Webb

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.LG

Comments 18 pages, 9 figures

InsightSee: Advancing Multi-agent Vision-Language Models for Enhanced Visual Understanding

Huaxiang Zhang, Yaojia Mu, Guo-Niu Zhu, Zhongxue Gan

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

An Examination of the Compositionality of Large Generative Vision-Language Models

Teli Ma, Rong Li, Junwei Liang

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

VISREAS: Complex Visual Reasoning with Unanswerable Questions

Syeda Nahida Akter, Sangwu Lee, Yingshan Chang, Yonatan Bisk, Eric Nyberg

专题命中 视觉推理 ：visual reasoning(title)；LLaVA(abstract)；分类 cs.CV、cs.AI

Comments 18 pages, 14 figures, 5 tables

Revisiting Disentanglement in Downstream Tasks: A Study on Its Necessity for Abstract Visual Reasoning

Ruiqian Nai, Zixin Wen, Ji Li, Yuanzhi Li, Yang Gao

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted to AAAI-2024

Prompting Large Vision-Language Models for Compositional Reasoning

Timothy Ossowski, Ming Jiang, Junjie Hu

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Can Vision-Language Models be a Good Guesser? Exploring VLMs for Times and Location Reasoning

Gengyuan Zhang, Yurui Zhang, Kerui Zhang, Volker Tresp

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to WACV 2024

ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense

Kankan Zhou, Eason Lai, Wei Bin Au Yeong, Kyriakos Mouratidis, Jing Jiang

专题命中 视觉推理 ：vision-language model(title,abstract)；分类 cs.CV、cs.AI

Comments This is the camera-ready version of the paper that will be published in the EMNLP 2023 Findings (Singapore, 6-10 December 2023)

Multimodal Representations for Teacher-Guided Compositional Visual Reasoning

Wafa Aissa, Marin Ferecatu, Michel Crucianu

专题命中 视觉推理 ：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.LG

Journal ref Advanced Concepts for Intelligent Vision Systems, 21st International Conference (ACIVS 2023), Aug 2023, Kumamoto, Japan

Multimodal Analysis Of Google Bard And GPT-Vision: Experiments In Visual Reasoning

David Noever, Samantha Elizabeth Miller Noever

专题命中 视觉推理 ：visual reasoning(title)；vision-language model(abstract)；分类 cs.CV、cs.LG

Tree-of-Mixed-Thought: Combining Fast and Slow Thinking for Multi-hop Visual Reasoning

Pengbo Hu, Ji Qi, Xingyu Li, Hong Li, Xinqi Wang, Bing Quan, Ruiyu Wang, Yi Zhou

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Comments 16 pages,1 figures, under review

Visual Reasoning: from State to Transformation

Xin Hong, Yanyan Lan, Liang Pang, Jiafeng Guo, Xueqi Cheng

专题命中 视觉推理 ：visual reasoning(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by TPAMI. arXiv admin note: substantial text overlap with arXiv:2011.13160

Curriculum Learning for Compositional Visual Reasoning

Wafa Aissa, Marin Ferecatu, Michel Crucianu

专题命中 视觉推理 ：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.LG

Journal ref In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, Feb 2023, Lisbon, Portugal. pp.888-897

Visual Programming: Compositional visual reasoning without training

Tanmay Gupta, Aniruddha Kembhavi

专题命中 视觉推理 ：visual reasoning(title)；visual question answering(abstract)；分类 cs.CV、cs.AI