视觉大模型 / VLM

Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis

Med3DVLM: 一种高效的视觉-语言模型用于3D医学图像分析

Yu Xin, Gorkem Can Ates, Kuang Gong, Wei Shao

机构 * University of Florida（佛罗里达大学） 纠错

专题命中 视觉问答 ：vision-language model(title,abstract)；VLM(abstract)；visual question answering(abstract)；分类 cs.CV

AI总结 Med3DVLM通过三个创新提出，实现了高效的3D医学图像分析，显著提升了图像-文本检索、报告生成和视觉问答的性能。

Vision Language Models Can Parse Floor Plan Maps

视觉语言模型可以解析平面图

David DeFazio, Hrudayangam Mehta, Meng Wang, Ping Yang, Jeremy Blackburn, Shiqi Zhang

机构 * School of Computing, Binghamton University（计算机学院，宾夕法尼亚州立大学） 纠错

专题命中 视觉问答 ：vision language model(title,abstract)；VLM(abstract)；visual question answering(abstract)；分类 cs.AI

AI总结 本文研究了视觉语言模型在地图解析任务中的性能，展示了其在复杂室内导航中的高成功率，并指出在大型开放区域中性能下降的问题。

CoTBox-TTT: Grounding Medical VQA with Visual Chain-of-Thought Boxes During Test-time Training

Jiahe Qian, Yuhao Shen, Zhangtianyi Chen, Juexiao Zhou, Peisong Wang

机构 * Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） ； School of Data Science, The Chinese University of Hong Kong, Shenzhen（香港大学深圳研究院数据科学学院） 纠错

专题命中 视觉问答 ：grounding(title)；vision-language model(abstract)；LLaVA(abstract)；visual question answering(abstract)

Evaluating Reasoning Faithfulness in Medical Vision-Language Models using Multimodal Perturbations

Johannes Moll, Markus Graf, Tristan Lemke, Nicolas Lenhart, Daniel Truhn, Jean-Benoit Delbrouck, Jiazhen Pan, Daniel Rueckert, Lisa C. Adams, Keno K. Bressem

机构 * Technical University of Munich (TUM)（慕尼黑技术大学） ； TUM University Hospital（慕尼黑技术大学医院） ； German Heart Center TUM University Hospital（慕尼黑技术大学医院德国心脏中心） ； Department of Radiology（放射科） ； Klinikum rechts der Isar TUM University Hospital（慕尼黑技术大学医院右岸诊所） ； Uniklinik RWTH Aachen（亚琛工业大学医院） ； HOPPR IL USA（HOPPR美国） ； University of Oxford（牛津大学） ； Imperial College London（伦敦帝国学院） 纠错

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；grounding(abstract)；分类 cs.CV

Comments Accepted to ML4H 2025 Proceedings

MOTOR: Multimodal Optimal Transport via Grounded Retrieval in Medical Visual Question Answering

Mai A. Shaaban, Tausifa Jan Saleem, Vijay Ram Papineni, Mohammad Yaqub

机构 * Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学） ； Department of Mathematics and Computer Science, Faculty of Science, Alexandria University（亚历山大大学数学与计算机科学系） ； Sheikh Shakhbout Medical City（谢赫·沙赫布OUT医疗城） 纠错

专题命中 视觉问答 ：visual question answering(title,abstract)；vision-language model(abstract)；VLM(abstract)；分类 cs.CV

QSVD: Efficient Low-rank Approximation for Unified Query-Key-Value Weight Compression in Low-Precision Vision-Language Models

Yutong Wang, Haiyu Wang, Sai Qian Zhang

机构 * Tandon School of Engineering, New York University（纽约大学工程学院） ； Courant Institute of Mathematical Sciences, New York University（纽约大学数学科学学院） 纠错

专题命中 视觉问答 ：vision-language model(title,abstract)；VLM(abstract)；visual question answering(abstract)；分类 cs.LG

Comments Accepted as Spotlight paper by NeurIPS 2025

MEGC2025: Micro-Expression Grand Challenge on Spot Then Recognize and Visual Question Answering

Xinqi Fan, Jingting Li, John See, Moi Hoon Yap, Wen-Huang Cheng, Xiaobai Li, Xiaopeng Hong, Su-Jing Wang, Adrian K. Davision

机构 * Department of Computing and Mathematics, Manchester Metropolitan University（计算与数学系，曼彻斯特 Metropolitan 大学） ； State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, Chinese Academy of Sciences（认知科学与心理健康国家重点实验室，心理学研究所，中国科学院） ； Department of Psychology, University of the Chinese Academy of Sciences（心理学系，中国科学院大学） ； National Taiwan University（台湾大学） ； Zhejiang University（浙江大学） ； University of Oulu（奥卢大学） ； Harbin Institute of Technology（哈尔滨工业大学） 纠错

专题命中 视觉问答 ：visual question answering(title,abstract)；vision-language model(abstract)；multimodal large language model(abstract)；分类 cs.CV

Comments Micro-Expression Grand Challenge (MEGC) at ACM MM 2025

Cross-Modal Attention Guided Unlearning in Vision-Language Models

Karuna Bhaila, Aneesh Komanduri, Minh-Hao Van, Xintao Wu

专题命中 视觉问答 ：vision-language model(title,abstract)；VLM(abstract)；visual question answering(abstract)；分类 cs.CV

Grounding Multilingual Multimodal LLMs With Cultural Knowledge

Jean de Dieu Nyandwi, Yueqi Song, Simran Khanuja, Graham Neubig

机构 * Carnegie Mellon University（卡内基梅隆大学） 纠错

专题命中 视觉问答 ：grounding(title)；visual question answering(abstract)；multimodal large language model(abstract)；MLLM(abstract)

RSVLM-QA: A Benchmark Dataset for Remote Sensing Vision Language Model-based Question Answering

Xing Zi, Jinghao Xiao, Yunxiao Shi, Xian Tao, Jun Li, Ali Braytee, Mukesh Prasad

机构 * School of Computer Science, University of Technology Sydney（技术悉尼大学计算机科学学院） ； SEDE, University of Technology Sydney（技术悉尼大学SEDE） ； Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） 纠错

专题命中 视觉问答 ：vision language model(title,abstract)；VLM(abstract)；visual question answering(abstract)；分类 cs.CV

Comments This paper has been accepted to the proceedings of the 33rd ACM International Multimedia Conference (ACM Multimedia 2025)

SynthVLM: Towards High-Quality and Efficient Synthesis of Image-Caption Datasets for Vision-Language Models

Zheng Liu, Hao Liang, Bozhou Li, Wentao Xiong, Chong Chen, Conghui He, Wentao Zhang, Bin Cui

机构 * Peking University Beijing China ； Huawei Technologies Ltd. Beijing China ； Shanghai AI Laboratory Shanghai China ； Peking University Center for Machine Learning Research Beijing China ； Peking University School of Computer Science \& Key Lab of High Confidence Software Technologies (MOE) Beijing China ； Peking University ； Huawei Technologies Ltd. ； Shanghai AI Laboratory 纠错

专题命中 视觉问答 ：vision-language model(title,abstract)；LLaVA(abstract)；multimodal large language model(abstract)；分类 cs.CV

A Multi-Agent System for Complex Reasoning in Radiology Visual Question Answering

Ziruo Yi, Jinyu Liu, Ting Xiao, Mark V. Albert

机构 * University of North Texas（北卡罗来纳州立大学） 纠错

专题命中 视觉问答 ：visual question answering(title,abstract)；multimodal large language model(abstract)；MLLM(abstract)；分类 cs.AI

Evaluating Variance in Visual Question Answering Benchmarks

Nikitha SR

机构 * Media and Data Science Research Lab, Adobe（媒体与数据科学研究实验室，Adobe） 纠错

专题命中 视觉问答 ：visual question answering(title,abstract)；visual reasoning(abstract)；multimodal large language model(abstract)；分类 cs.CV

Comments Accepted in ICCV 2025 Workshop on What's Next in Multimodal Foundational Models

TimeCausality: Evaluating the Causal Ability in Time Dimension for Vision Language Models

Zeqing Wang, Shiyuan Zhang, Chengpei Tang, Keze Wang

机构 * Sun Yat-sen University（中山大学） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 视觉问答 ：vision language model(title)；vision-language model(abstract)；VLM(abstract)；visual question answering(abstract)

Comments 17 pages, 6 figures, 3 tables

Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving

Yue Li, Meng Tian, Zhenyu Lin, Jiangtong Zhu, Dechang Zhu, Haiqiang Liu, Zining Wang, Yueyi Zhang, Zhiwei Xiong, Xinhai Zhao

专题命中 视觉问答 ：vision-language model(title,abstract)；VLM(abstract)；visual question answering(abstract)；分类 cs.CV

Grounded Chain-of-Thought for Multimodal Large Language Models

Qiong Wu, Xiangcong Yang, Yiyi Zhou, Chenxin Fang, Baiyang Song, Xiaoshuai Sun, Rongrong Ji

机构 * Xiamen University（厦门大学） 纠错

专题命中 视觉问答 ：multimodal large language model(title,abstract)；grounding(abstract)；MLLM(abstract)；分类 cs.CV

UMIT: Unifying Medical Imaging Tasks via Vision-Language Models

Haiyang Yu, Siyang Yi, Ke Niu, Minghan Zhuo, Bin Li

机构 * Shanghai Key Laboratory of Intelligent Information Processing（上海智能信息处理重点实验室） ； School of Computer Science, Fudan University（复旦大学计算机科学学院） 纠错

专题命中 视觉问答 ：vision-language model(title,abstract)；VLM(abstract)；visual question answering(abstract)；分类 cs.CV

UPME: An Unsupervised Peer Review Framework for Multimodal Large Language Model Evaluation

Qihui Zhang, Munan Ning, Zheyuan Liu, Yanbo Wang, Jiayi Ye, Yue Huang, Shuo Yang, Xiao Chen, Yibing Song, Li Yuan

机构 * School of Electrical and Computer Engineering, Peking University（北京大学电气与计算机工程学院） ； Hupan Lab（湖畔实验室） ； DAMO Academy, Alibaba Group（阿里巴巴达摩院） ； University of Notre Dame（圣母大学） ； Tsinghua University（清华大学） 纠错

专题命中 视觉问答 ：multimodal large language model(title,abstract)；visual question answering(abstract)；MLLM(abstract)；分类 cs.CV

Comments Accepted by CVPR 2025

Integrating Frequency-Domain Representations with Low-Rank Adaptation in Vision-Language Models

Md Azim Khan, Aryya Gangopadhyay, Jianwu Wang, Robert F. Erbacher

机构 * University of Maryland Baltimore County (UMBC)（马里兰大学巴尔的摩县分校） ； Center for Real-time Distributed Sensing and Autonomy (CARDS)（实时分布式感知与自主中心） ； DEVCOM Army Research Laboratory（DEVCOM陆军研究实验室） 纠错

专题命中 视觉问答 ：vision-language model(title)；vision language model(abstract)；VLM(abstract)；visual question answering(abstract)

Comments 8 pages, 4 figures

Towards Top-Down Reasoning: An Explainable Multi-Agent Approach for Visual Question Answering

Zeqing Wang, Wentao Wan, Qiqing Lao, Runmeng Chen, Minjie Lang, Xiao Wang, Keze Wang, Liang Lin

机构 * School of computer science and Engineering, Sun Yat-sen University（中山大学计算机科学与工程学院） ； South China Normal University（华南师范大学） ； Northeastern University（东北大学） ； Anhui University（安徽大学） 纠错

专题命中 视觉问答 ：visual question answering(title,abstract)；vision language model(abstract)；VLM(abstract)；分类 cs.CV

Comments 13 pages, 8 figures

Interpretable Face Anti-Spoofing: Enhancing Generalization with Multimodal Large Language Models

Guosheng Zhang, Keyao Wang, Haixiao Yue, Ajian Liu, Gang Zhang, Kun Yao, Errui Ding, Jingdong Wang

专题命中 视觉问答 ：multimodal large language model(title,abstract)；visual question answering(abstract)；MLLM(abstract)；分类 cs.CV

Comments Accepted to AAAI2025(Oral)

DriveLM: Driving with Graph Visual Question Answering

Chonghao Sima, Katrin Renz, Kashyap Chitta, Li Chen, Hanxue Zhang, Chengen Xie, Jens Beißwenger, Ping Luo, Andreas Geiger, Hongyang Li

专题命中 视觉问答 ：visual question answering(title,abstract)；vision-language model(abstract)；VLM(abstract)；分类 cs.CV

Comments Accepted to ECCV 2024 as Oral paper

UniRS: Unifying Multi-temporal Remote Sensing Tasks through Vision Language Models

Yujie Li, Wenjia Xu, Guangzuo Li, Zijian Yu, Zhiwei Wei, Jiuniu Wang, Mugen Peng

机构 * State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications（北京邮电大学） ； Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院空天信息创新研究院） ； School of Geographic Sciences, Hunan Normal University（湖南师范大学） ； City University of Hong Kong（香港城市大学） 纠错

专题命中 视觉问答 ：vision language model(title)；vision-language model(abstract)；VLM(abstract)；visual question answering(abstract)

Comments 12 pages, 5 figures

VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis

Chao Pang, Xingxing Weng, Jiang Wu, Jiayu Li, Yi Liu, Jiaxing Sun, Weijia Li, Shuai Wang, Litong Feng, Gui-Song Xia, Conghui He

专题命中 视觉问答 ：vision language model(title,abstract)；visual question answering(abstract)；grounding(abstract)；分类 cs.CV

Comments Equal contribution: Chao Pang, Xingxing Weng, Jiang Wu; Corresponding author: Gui-Song Xia, Conghui He

RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts

Xu Liu, Zhouhui Lian

机构 * Wangxuan Institute of Computer Technology（王选计算机技术学院） ； Peking University（北京大学） 纠错

专题命中 视觉问答 ：vision language model(title)；vision-language model(abstract)；VLM(abstract)；visual question answering(abstract)

A Visual Question Answering Method for SAR Ship: Breaking the Requirement for Multimodal Dataset Construction and Model Fine-Tuning

Fei Wang, Chengcheng Chen, Hongyu Chen, Yugang Chang, Weiming Zeng

专题命中 视觉问答 ：visual question answering(title,abstract)；vision-language model(abstract)；visual language model(abstract)；分类 cs.CV

Face-MLLM: A Large Face Perception Model

Haomiao Sun, Mingjie He, Tianheng Lian, Hu Han, Shiguang Shan

专题命中 视觉问答 ：MLLM(title,abstract)；visual question answering(abstract)；multimodal large language model(abstract)；分类 cs.CV

Order Matters: Exploring Order Sensitivity in Multimodal Large Language Models

Zhijie Tan, Xu Chu, Weiping Li, Tong Mo

专题命中 视觉问答 ：multimodal large language model(title,abstract)；visual question answering(abstract)；MLLM(abstract)；分类 cs.AI

MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models

Hang Hua, Yunlong Tang, Ziyun Zeng, Liangliang Cao, Zhengyuan Yang, Hangfeng He, Chenliang Xu, Jiebo Luo

专题命中 视觉问答 ：vision-language model(title,abstract)；VLM(abstract)；visual question answering(abstract)；分类 cs.CV

Comments 21 pages, 15 figures

MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integration

Lai Wei, Wenkai Wang, Xiaoyu Shen, Yu Xie, Zhihao Fan, Xiaojin Zhang, Zhongyu Wei, Wei Chen

专题命中 视觉问答 ：MLLM(title,abstract)；visual question answering(abstract)；multimodal large language model(abstract)；分类 cs.CV

Comments 21 pages, 14 figures, 6 tables