视觉大模型 / VLM - arXivDaily 专题

2506.19217 2025-06-25 cs.CV cs.AI 84%

MedErr-CT: A Visual Question Answering Benchmark for Identifying and Correcting Errors in CT Reports

Sunggu Kyung, Hyungbin Park, Jinyoung Seo, Jimin Sung, Jihyun Kim, Dongyeong Kim, Wooyoung Jo, Yoojin Nam, Sangah Park, Taehee Kwon, Sang Min Lee, Namkug Kim

机构 * Department of Biomedical Engineering, University of Ulsan College of Medicine（生物医学工程系，釜山大学医学院）

专题命中视觉问答：visual question answering(title,abstract)；multimodal large language model(abstract)；分类 cs.CV、cs.AI

Comments 14 pages, 5 figures, submitted to CVPR 2025

2506.06242 2025-06-09 cs.CV cs.AI 84%

Visual Graph Arena: Evaluating Visual Conceptualization of Vision and Multimodal Large Language Models

Zahra Babaiee, Peyman M. Kiasari, Daniela Rus, Radu Grosu

专题命中视觉问答：multimodal large language model(title,abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

2506.02615 2025-06-04 cs.CV cs.AI 84%

Hierarchical Question-Answering for Driving Scene Understanding Using Vision-Language Models

Safaa Abdullahi Moallim Mohamud, Minjin Baek, Dong Seog Han

机构 * Center for ICT and Automotive Convergence, Kyungpook National University（信息与汽车融合研究中心，庆北国立大学）； School of Electronic and Electrical Engineering, Kyungpook National University（电子电气工程学院，庆北国立大学）

专题命中视觉问答：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV、cs.AI

Comments This work has been submitted to the IEEE for possible publication

2505.19031 2025-05-27 cs.CV cs.AI 84%

Medical Large Vision Language Models with Multi-Image Visual Ability

Xikai Yang, Juzheng Miao, Yuchen Yuan, Jiaze Wang, Qi Dou, Jinpeng Li, Pheng-Ann Heng

机构 * Dept. of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China（计算机科学与工程系，香港中文大学，香港，中国）； Institute of Medical Intelligence and XR, The Chinese University of Hong Kong, Hong Kong, China（医学智能与XR研究所，香港中文大学，香港，中国）

专题命中视觉问答：vision language model(title)；vision-language model(abstract)；LLaVA(abstract)；分类 cs.CV、cs.AI

Comments 10 pages, 4 figures

2505.13973 2025-05-21 cs.CL cs.AI cs.CV 84%

Toward Effective Reinforcement Learning Fine-Tuning for Medical VQA in Vision-Language Models

Wenhui Zhu, Xuanzhao Dong, Xin Li, Peijie Qiu, Xiwen Chen, Abolfazl Razi, Aris Sotiras, Yi Su, Yalin Wang

机构 * Arizona State University（亚利桑那州立大学）； Clemson University（克莱姆森大学）； Washington University in St.Louis（华盛顿大学圣路易斯分校）； Banner Alzheimer’s Institute（Banner阿尔茨海默病研究所）

专题命中视觉问答：vision-language model(title)；visual question answering(abstract)；multimodal large language model(abstract)；分类 cs.CV、cs.AI

2505.06152 2025-05-12 cs.CV cs.AI 84%

MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from Textbooks

Wenqi Zeng, Yuqi Sun, Chenxi Ma, Weimin Tan, Bo Yan

机构 * Shanghai Key Laboratory of Intelligent Information Processing, School of Computer Science, Fudan University（上海智能信息处理关键实验室，计算机科学学院，复旦大学）

专题命中视觉问答：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV、cs.AI

2410.12705 2025-05-09 cs.CL cs.AI cs.CV 84%

WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines

Genta Indra Winata, Frederikus Hudi, Patrick Amadeus Irawan, David Anugraha, Rifki Afina Putri, Yutong Wang, Adam Nohejl, Ubaidillah Ariq Prathama, Nedjma Ousidhoum, Afifa Amriani, Anar Rzayev, Anirban Das, Ashmari Pramodya, Aulia Adila, Bryan Wilie, Candy Olivia Mawalim, Ching Lam Cheng, Daud Abolade, Emmanuele Chersoni, Enrico Santus, Fariz Ikhwantri, Garry Kuwanto, Hanyang Zhao, Haryo Akbarianto Wibowo, Holy Lovenia, Jan Christian Blaise Cruz, Jan Wira Gotama Putra, Junho Myung, Lucky Susanto, Maria Angelica Riera Machin, Marina Zhukova, Michael Anugraha, Muhammad Farid Adilazuarda, Natasha Santosa, Peerat Limkonchotiwat, Raj Dabre, Rio Alexander Audino, Samuel Cahyawijaya, Shi-Xiong Zhang, Stephanie Yulia Salim, Yi Zhou, Yinxuan Gui, David Ifeoluwa Adelani, En-Shiun Annie Lee, Shogo Okada, Ayu Purwarianti, Alham Fikri Aji, Taro Watanabe, Derry Tanti Wijaya, Alice Oh, Chong-Wah Ngo

机构 * Capital One ； SEACrowd ； NAIST ； ITB ； UofT ； KAIST ； JAIST ； Cardiff University ； Independent ； HKUST ； SMU ； Masakhane ； University of Lagos ； HK PolyU ； Boston University ； Columbia University ； MBZUAI ； Monash University ； UCSB ； Tokyo Tech ； AI Singapore ； NICT ； Cohere ； McGill ； MILA ； Canada CIFAR AI Chair ； Ontario Tech

专题命中视觉问答：visual question answering(title,abstract)；vision language model(abstract)；分类 cs.CV、cs.AI

Comments Best Theme Paper at NAACL 2025

2504.11038 2025-04-16 cs.CV cs.AI 84%

QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models

Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun, Zhanhui Kang, Yu Wang

机构 * Tsinghua University（清华大学）； Tencent（腾讯）； University of Science and Technology Beijing（北京科技大学）； University of Macau（澳门大学）

专题命中视觉问答：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

Comments Accepted by NAACL 2025 main

2504.01049 2025-04-03 cs.CV cs.LG 84%

SViQA: A Unified Speech-Vision Multimodal Model for Textless Visual Question Answering

Bingxin Li

机构 * School of Computer Science, Fudan University（复旦大学计算机科学学院）

专题命中视觉问答：visual question answering(title,abstract)；LLaVA(abstract)；分类 cs.CV、cs.LG

2503.12490 2025-03-18 cs.CV cs.AI 84%

GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing

Zilun Zhang, Haozhan Shen, Tiancheng Zhao, Bin Chen, Zian Guan, Yuhao Wang, Xu Jia, Yuxiang Cai, Yongheng Shang, Jianwei Yin

机构 * College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）； Binjiang Research Institute of Zhejiang University（浙江大学滨江研究院）

专题命中视觉问答：multimodal large language model(title)；vision-language model(abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

2503.09837 2025-03-17 cs.CV cs.AI cs.CL 84%

On the Limitations of Vision-Language Models in Understanding Image Transforms

Ahmad Mustafa Anis, Hasnain Ali, Saquib Sarfraz

机构 * Cohere for AI Community（Cohere AI社区）； Arbisoft（Arbisoft公司）； Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）

专题命中视觉问答：vision-language model(title)；vision language model(abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

Comments 8 pages, 15 images

2412.20622 2025-03-17 cs.CV cs.AI 84%

Towards a Systematic Evaluation of Hallucinations in Large-Vision Language Models

Ashish Seth, Dinesh Manocha, Chirag Agarwal

机构 * University of Maryland, College Park（马里兰大学帕克分校）； University of Virginia（弗吉尼亚大学）

专题命中视觉问答：vision language model(title)；vision-language model(abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

2410.20327 2025-03-11 cs.CV cs.AI 84%

R-LLaVA: Improving Med-VQA Understanding through Visual Region of Interest

Xupeng Chen, Zhixin Lai, Kangrui Ruan, Shichu Chen, Jiaxiang Liu, Zuozhu Liu

机构 * New York University（纽约大学）； Cornell University（康奈尔大学）； Columbia University（哥伦比亚大学）； Zhejiang University（浙江大学）

专题命中视觉问答：LLaVA(title,abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

2503.02358 2025-03-05 cs.CV cs.AI cs.CL 84%

Are Large Vision Language Models Good Game Players?

Xinyu Wang, Bohan Zhuang, Qi Wu

机构 * The University of Adelaide（阿德莱德大学）； Zhejiang University（浙江大学）

专题命中视觉问答：vision language model(title,abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

Comments ICLR2025

2502.14191 2025-02-21 cs.CV cs.AI 84%

Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Models

Michihiro Yasunaga, Luke Zettlemoyer, Marjan Ghazvininejad

机构 * FAIR at Meta（Meta FAIR实验室）

专题命中视觉问答：vision language model(title)；vision-language model(abstract)；VLM(abstract)；分类 cs.CV、cs.AI

Comments Dataset available at https://github.com/facebookresearch/multimodal_rewardbench

2405.14974 2025-02-21 cs.CV cs.AI cs.CL 84%

LOVA3: Learning to Visual Question Answering, Asking and Assessment

Henry Hengyuan Zhao, Pan Zhou, Difei Gao, Zechen Bai, Mike Zheng Shou

机构 * National University of Singapore（新加坡国立大学）； Singapore Management University（新加坡管理大学）

专题命中视觉问答：visual question answering(title,abstract)；multimodal large language model(abstract)；分类 cs.CV、cs.AI

Comments NeurIPS 2024. The code is available at https://github.com/showlab/LOVA3

2501.12751 2025-01-23 cs.IR cs.CV cs.LG 84%

Patent Figure Classification using Large Vision-language Models

Sushil Awale, Eric Müller-Budack, Ralph Ewerth

机构 * TIB – Leibniz Information Centre for Science and Technology（莱布尼茨科技信息中心（TIB））； L3S Research Center, Leibniz University（莱布尼茨大学L3S研究中心）

专题命中视觉问答：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV、cs.LG

2408.12763 2024-12-23 cs.LG cs.AI cs.CL 84%

Assessing Modality Bias in Video Question Answering Benchmarks with Multimodal Large Language Models

Jean Park, Kuk Jin Jang, Basam Alasaly, Sriharsha Mopidevi, Andrew Zolensky, Eric Eaton, Insup Lee, Kevin Johnson

专题命中视觉问答：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.AI、cs.LG

2408.04594 2024-12-20 cs.CV cs.AI 84%

Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Models

Qirui Jiao, Daoyuan Chen, Yilun Huang, Bolin Ding, Yaliang Li, Ying Shen

机构 * Sun Yat-Sen University（中山大学）； Alibaba Group（阿里巴巴集团）

专题命中视觉问答：multimodal large language model(title,abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

Comments 22 pages, 10 figures, 16 tables

2408.10072 2024-11-22 cs.CV cs.AI 84%

FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistant

Zhengchao Huang, Bin Xia, Zicheng Lin, Zhun Mou, Wenming Yang, Jiaya Jia

专题命中视觉问答：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV、cs.AI

Comments 23 pages, 21 figures; project page: https://ffaa-vl.github.io

2312.10104 2024-11-01 cs.CV cs.CL cs.LG 84%

Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models

Xu Yang, Yingzhe Peng, Haoxuan Ma, Shuo Xu, Chi Zhang, Yucheng Han, Hanwang Zhang

专题命中视觉问答：vision language model(title)；vision-language model(abstract)；visual question answering(abstract)；分类 cs.CV、cs.LG

Comments 17 pages, 6 figures

2410.13121 2024-10-18 cs.CV cs.AI 84%

Trust but Verify: Programmatic VLM Evaluation in the Wild

Viraj Prabhu, Senthil Purushwalkam, An Yan, Caiming Xiong, Ran Xu

专题命中视觉问答：VLM(title,abstract)；vision-language model(abstract)；分类 cs.CV、cs.AI

2408.11312 2024-10-16 cs.CV cs.AI 84%

Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework

Xiao Han, Chen Zhu, Xiangyu Zhao, Hengshu Zhu

专题命中视觉问答：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

Comments resubmit to www2025

2407.10920 2024-10-15 cs.CV cs.AI cs.CL 84%

Benchmarking Vision Language Models for Cultural Understanding

Shravan Nayak, Kanishk Jain, Rabiul Awal, Siva Reddy, Sjoerd van Steenkiste, Lisa Anne Hendricks, Karolina Stańczak, Aishwarya Agrawal

专题命中视觉问答：vision language model(title,abstract)；VLM(abstract)；分类 cs.CV、cs.AI

Comments Accepted to EMNLP 2024 Main Conference

2410.05928 2024-10-10 cs.CV cs.AI cs.CL 84%

Beyond Captioning: Task-Specific Prompting for Improved VLM Performance in Mathematical Reasoning

Ayush Singh, Mansi Gupta, Shivank Garg, Abhinav Kumar, Vansh Agrawal

专题命中视觉问答：VLM(title)；vision-language model(abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

2409.19330 2024-10-01 cs.CV cs.AI 84%

3D-CT-GPT: Generating 3D Radiology Reports through Integration of Large Vision-Language Models

Hao Chen, Wei Zhao, Yingli Li, Tianyang Zhong, Yisong Wang, Youlan Shang, Lei Guo, Junwei Han, Tianming Liu, Jun Liu, Tuo Zhang

专题命中视觉问答：vision-language model(title)；visual language model(abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

2312.14115 2024-09-27 cs.RO cs.AI cs.CV 84%

LingoQA: Visual Question Answering for Autonomous Driving

Ana-Maria Marcu, Long Chen, Jan Hünermann, Alice Karnsund, Benoit Hanotte, Prajwal Chidananda, Saurabh Nair, Vijay Badrinarayanan, Alex Kendall, Jamie Shotton, Elahe Arani, Oleg Sinavski

专题命中视觉问答：visual question answering(title,abstract)；vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted to ECCV 2024. Benchmark and dataset are available at https://github.com/wayveai/LingoQA/

2408.08632 2024-09-09 cs.CL cs.AI cs.CV 84%

A Survey on Benchmarks of Multimodal Large Language Models

Jian Li, Weiheng Lu, Hao Fei, Meng Luo, Ming Dai, Min Xia, Yizhang Jin, Zhenye Gan, Ding Qi, Chaoyou Fu, Ying Tai, Wankou Yang, Yabiao Wang, Chengjie Wang

专题命中视觉问答：multimodal large language model(title,abstract)；visual question answering(abstract)；分类 cs.CV、cs.AI

2408.11742 2024-08-22 cs.CV cs.AI 84%

CluMo: Cluster-based Modality Fusion Prompt for Continual Learning in Visual Question Answering

Yuliang Cai, Mohammad Rostami

专题命中视觉问答：visual question answering(title)；vision-language model(abstract)；VLM(abstract)；分类 cs.CV、cs.AI

2407.20174 2024-08-13 cs.CV cs.AI 84%

Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning

Xingchen Zeng, Haichuan Lin, Yilin Ye, Wei Zeng

专题命中视觉问答：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV、cs.AI

Comments 11 pages, 7 figures

1. 视觉问答 3164 篇

MedErr-CT: A Visual Question Answering Benchmark for Identifying and Correcting Errors in CT Reports

Visual Graph Arena: Evaluating Visual Conceptualization of Vision and Multimodal Large Language Models

Hierarchical Question-Answering for Driving Scene Understanding Using Vision-Language Models

Medical Large Vision Language Models with Multi-Image Visual Ability

Toward Effective Reinforcement Learning Fine-Tuning for Medical VQA in Vision-Language Models

MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from Textbooks

WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines

QAVA: Query-Agnostic Visual Attack to Large Vision-Language Models

SViQA: A Unified Speech-Vision Multimodal Model for Textless Visual Question Answering

GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing

On the Limitations of Vision-Language Models in Understanding Image Transforms

Towards a Systematic Evaluation of Hallucinations in Large-Vision Language Models

R-LLaVA: Improving Med-VQA Understanding through Visual Region of Interest

Are Large Vision Language Models Good Game Players?

Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Models

LOVA3: Learning to Visual Question Answering, Asking and Assessment

Patent Figure Classification using Large Vision-language Models

Assessing Modality Bias in Video Question Answering Benchmarks with Multimodal Large Language Models

Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Models

FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistant

Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models

Trust but Verify: Programmatic VLM Evaluation in the Wild

Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework

Benchmarking Vision Language Models for Cultural Understanding

Beyond Captioning: Task-Specific Prompting for Improved VLM Performance in Mathematical Reasoning

3D-CT-GPT: Generating 3D Radiology Reports through Integration of Large Vision-Language Models

LingoQA: Visual Question Answering for Autonomous Driving

A Survey on Benchmarks of Multimodal Large Language Models

CluMo: Cluster-based Modality Fusion Prompt for Continual Learning in Visual Question Answering

Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning