视觉大模型 / VLM

A Multi-Agent System for Complex Reasoning in Radiology Visual Question Answering

Ziruo Yi, Jinyu Liu, Ting Xiao, Mark V. Albert

机构 * University of North Texas（北卡罗来纳州立大学） 纠错

专题命中 视觉问答 ：visual question answering(title,abstract)；multimodal large language model(abstract)；MLLM(abstract)；分类 cs.AI

How Can Objects Help Video-Language Understanding?

Zitian Tang, Shijie Wang, Junho Cho, Jaewook Yoo, Chen Sun

机构 * Brown University（布朗大学） ； Samsung Electronics（三星电子） 纠错

专题命中 视觉问答 ：multimodal large language model(abstract)；MLLM(abstract)；分类 cs.CV

Enhancing Long Video Question Answering with Scene-Localized Frame Grouping

Xuyi Yang, Wenhao Zhang, Hongbo Jin, Lin Liu, Hongbo Xu, Yongwei Nie, Fei Yu, Fei Ma

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV、cs.AI

VQA support to Arabic Language Learning Educational Tool

Khaled Bachir Delassi, Lakhdar Zeggane, Hadda Cherroun, Abdelhamid Haouhat, Kaoutar Bouzouad

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

LMME3DHF: Benchmarking and Evaluating Multimodal 3D Human Face Generation with LMMs

Woo Yi Yang, Jiarui Wang, Sijing Wu, Huiyu Duan, Yuxin Zhu, Liu Yang, Kang Fu, Guangtao Zhai, Xiongkuo Min

机构 * Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Reinforcing VLMs to Use Tools for Detailed Visual Reasoning Under Resource Constraints

Sunil Kumar, Bowen Zhao, Leo Dirac, Paulina Varshavskaya

专题命中 视觉推理 ：visual reasoning(title,abstract)；vision-language model(abstract)；分类 cs.CV、cs.AI、cs.LG

Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Models

Wenjie Luo, Ruocheng Li, Shanshan Zhu, Julian Perry

机构 * Fujian University of Technology（福建工程大学） ； Delta University for Science and Technology（科技大学） 纠错

专题命中 视觉推理 ：vision-language model(title,abstract)；LLaVA(abstract)

Geoint-R1: Formalizing Multimodal Geometric Reasoning with Dynamic Auxiliary Constructions

Jingxuan Wei, Caijun Jia, Qi Chen, Honghao He, Linzhuang Sun, Conghui He, Lijun Wu, Bihui Yu, Cheng Tan

机构 * Shenyang institute of computing technology, Chinese academy of sciences（沈阳计算技术研究所，中国科学院） ； Shanghai AI Laboratory（上海人工智能实验室） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 视觉推理 ：multimodal large language model(abstract)；分类 cs.AI

Leveraging Vision-Language Models for Visual Grounding and Analysis of Automotive UI

Benjamin Raphael Ernhofer, Daniil Prokhorov, Jannica Langner, Dominik Bollmann

机构 * SPARKS Solutions GmbH（SPARKS解决方案有限公司） 纠错

专题命中 视觉定位与Grounding ：grounding(title,abstract)；vision-language model(title)；分类 cs.CV、cs.AI

VisuCraft: Enhancing Large Vision-Language Models for Complex Visual-Guided Creative Content Generation via Structured Information Extraction

Rongxin Jiang, Robert Long, Chenghao Gu, Mingrui Yan

机构 * Heilongjiang University of Science and Technology（黑龙江科技大学） ； University of Padua（帕多瓦大学） 纠错

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；LLaVA(abstract)；grounding(abstract)；分类 cs.CV

Can Large Vision-Language Models Understand Multimodal Sarcasm?

Xinyu Wang, Yue Zhang, Liqiang Jing

机构 * The University of Texas at Dallas（德克萨斯大学达拉斯分校） 纠错

专题命中 视觉定位与Grounding ：vision-language model(title)；visual language model(abstract)；分类 cs.CV

Comments Accepted by CIKM 2025

MedBLINK: Probing Basic Perception in Multimodal Language Models for Medicine

Mahtab Bigverdi, Wisdom Ikezogwo, Kevin Zhang, Hyewon Jeong, Mingyu Lu, Sungjae Cho, Linda Shapiro, Ranjay Krishna

机构 * University of Washington（华盛顿大学） ； Massachusetts Institute of Technology（麻省理工学院） ； Seoul National University（首尔国立大学） 纠错

专题命中 视觉定位与Grounding ：LLaVA(abstract)；grounding(abstract)；分类 cs.AI

A First-order Generative Bilevel Optimization Framework for Diffusion Models

Quan Xiao, Hui Yuan, A F M Saif, Gaowen Liu, Ramana Kompella, Mengdi Wang, Tianyi Chen

机构 * Rensselaer Polytechnic Institute（伦斯勒理工学院） ； Princeton University（普林斯顿大学） ； Cisco Research（思科研究） ； Cornell University（康奈尔大学） 纠错

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.LG

Comments Cameral-ready version: added experiments using the HPSv2 reward, improved notation consistency for the diffusion model, and added related works

GACL: Grounded Adaptive Curriculum Learning with Active Task and Performance Monitoring

Linji Wang, Zifan Xu, Peter Stone, Xuesu Xiao

机构 * Department of Computer Science, George Mason University（乔治·马歇尔大学计算机科学系） ； Department of Computer Science, The University of Texas at Austin（德克萨斯大学奥斯汀分校计算机科学系） ； Sony AI（索尼人工智能） 纠错

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

Comments 7 pages, IROS 2025

Diffusion Models with Adaptive Negative Sampling Without External Resources

Alakh Desai, Nuno Vasconcelos

机构 * University of California, San Diego（加州大学圣地亚哥分校） 纠错

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Key-Augmented Neural Triggers for Knowledge Sharing

Alex Wolf, Marco Edoardo Palma, Pooja Rani, Harald C. Gall

专题命中 视觉定位与Grounding ：grounding(abstract)

Document Haystack: A Long Context Multimodal Image/Document Understanding Vision LLM Benchmark

Goeric Huybrechts, Srikanth Ronanki, Sai Muralidhar Jayanthi, Jack Fitzgerald, Srinivasan Veeravanallur

机构 * Amazon AGI（亚马逊人工智能研究院） 纠错

专题命中 文档图表理解 ：vision language model(abstract)；multimodal large language model(abstract)；分类 cs.CV、cs.AI、cs.LG

LaTCoder: Converting Webpage Design to Code with Layout-as-Thought

Yi Gui, Zhen Li, Zhongyi Zhang, Guohao Wang, Tianpeng Lv, Gaoyang Jiang, Yi Liu, Dongping Chen, Yao Wan, Hongyu Zhang, Wenbin Jiang, Xuanhua Shi, Hai Jin

专题命中 文档图表理解 ：multimodal large language model(abstract)；MLLM(abstract)

Comments KDD 2025 v2

Are We on the Right Way for Assessing Document Retrieval-Augmented Generation?

Wenxuan Shen, Mingjia Wang, Yaochen Wang, Dongping Chen, Junjie Yang, Yao Wan, Weiwei Lin

机构 * South China University of Technology（华南理工大学） ； Huazhong University of Science and Technology（华中科技大学） ； University of Maryland（马里兰大学） 纠错

专题命中 文档图表理解 ：multimodal large language model(abstract)；分类 cs.CV

Comments In submission. Project website: https://double-bench.github.io/

Following Route Instructions using Large Vision-Language Models: A Comparison between Low-level and Panoramic Action Spaces

Vebjørn Haug Kåsene, Pierre Lison

机构 * University of Oslo（奥斯陆大学） ； Norwegian Computing Center（挪威计算中心） 纠错

专题命中 GUI与屏幕智能体 ：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV、cs.AI

Comments This paper has been accepted to ICNSLP 2025

Language as Cost: Proactive Hazard Mapping using VLM for Robot Navigation

Mintaek Oh, Chan Kim, Seung-Woo Seo, Seong-Woo Kim

机构 * Seoul National University（首尔国立大学） 纠错

专题命中 GUI与屏幕智能体 ：VLM(title)；vision-language model(abstract)

Comments Accepted at IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2025. 8 pages, 7 figures

GUI-ReRank: Enhancing GUI Retrieval with Multi-Modal LLM-based Reranking

Kristian Kolthoff, Felix Kretzer, Christian Bartelt, Alexander Maedche, Simone Paolo Ponzetto

专题命中 GUI与屏幕智能体 ：MLLM(abstract)

CookBench: A Long-Horizon Embodied Planning Benchmark for Complex Cooking Scenarios

Muzhen Cai, Xiubo Chen, Yining An, Jiaxin Zhang, Xuesong Wang, Wang Xu, Weinan Zhang, Ting Liu

专题命中 GUI与屏幕智能体 ：vision-language model(abstract)

Comments 9 pages, 5 figures

IKOD: Mitigating Visual Attention Degradation in Large Vision-Language Models

Jiabing Yang, Chenhang Cui, Yiyang Zhou, Yixiang Chen, Peng Xia, Ying Wei, Tao Yu, Yan Huang, Liang Wang

专题命中 幻觉与鲁棒性 ：vision-language model(title,abstract)；分类 cs.CV

ChartCap: Mitigating Hallucination of Dense Chart Captioning

Junyoung Lim, Jaewoo Ahn, Gunhee Kim

机构 * Seoul National University（首尔国立大学） 纠错

专题命中 幻觉与鲁棒性 ：vision language model(abstract)；分类 cs.CV、cs.AI

Comments ICCV 2025 (Highlight)

CutPaste&Find: Efficient Multimodal Hallucination Detector with Visual-aid Knowledge Base

Cong-Duy Nguyen, Xiaobao Wu, Duc Anh Vu, Shuai Zhao, Thong Nguyen, Anh Tuan Luu

机构 * Nanyang Technological University, Singapore（南洋理工大学） ； National University of Singapore, Singapore（国立新加坡大学） 纠错

专题命中 幻觉与鲁棒性 ：vision-language model(abstract)；分类 cs.CV

CHIRP: A Fine-Grained Benchmark for Open-Ended Response Evaluation in Vision-Language Models

Alexis Roger, Prateek Humane, Daniel Z. Kaplan, Kshitij Gupta, Qi Sun, George Adamopoulos, Jonathan Siu Chi Lim, Quentin Anthony, Edwin Fennell, Irina Rish

机构 * Mila - Quebec AI Institute（魁北克人工智能研究所） ； Université de Montréal（蒙特利尔大学） ； Tokyo Institute of Technology（东京技术大学） ； McGill University（麦吉尔大学） ； EleutherAI ； University College London（伦敦大学学院） 纠错

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV、cs.AI

Defining and Evaluating Visual Language Models' Basic Spatial Abilities: A Perspective from Psychometrics

Wenrui Xu, Dalin Lyu, Weihang Wang, Jie Feng, Chen Gao, Yong Li

机构 * School of Architecture, Tsinghua University（清华大学建筑学院） ； Department of Electronic Engineering, Tsinghua University（清华大学电子工程系） ； BNRist, Tsinghua University（清华大学BNRist） 纠错

专题命中 VLM训练与架构 ：visual language model(title,abstract)；VLM(abstract)；分类 cs.CV

Journal ref Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics. Volume 1: Long Papers (2025) 11571-11590

Causally Steered Diffusion for Automated Video Counterfactual Generation

Nikos Spyrou, Athanasios Vlontzos, Paraskevas Pegios, Thomas Melistas, Nefeli Gkouti, Yannis Panagakis, Giorgos Papanastasiou, Sotirios A. Tsaftaris

机构 * Spotify, UK（英国Spotify） 纠错

专题命中 VLM训练与架构 ：vision-language model(abstract)；VLM(abstract)；分类 cs.CV、cs.AI

DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework

Tongchun Zuo, Zaiyu Huang, Shuliang Ning, Ente Lin, Chao Liang, Zerong Zheng, Jianwen Jiang, Yuan Zhang, Mingyuan Gao, Xin Dong

机构 * ByteDance Intelligent Creation（字节跳动智能创作） 纠错

专题命中 VLM训练与架构 ：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

Comments 18 pages, 12 figures