视觉大模型 / VLM

MAVIS: A Benchmark for Multimodal Source Attribution in Long-form Visual Question Answering

MAVIS：多模态来源归因的长形式视觉问答基准

Seokwon Song, Minsu Park, Gunhee Kim

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

AI总结 MAVIS基准旨在评估多模态来源归因系统，通过多模态文档检索和长形式答案生成，揭示多模态设置下信息量、 groundedness 和流畅性之间的权衡与改进方向。

Comments AAAI 2026; code is available at https://github.com/seokwon99/MAVIS

Mined Prompting and Metadata-Guided Generation for Wound Care Visual Question Answering

Bavana Durgapraveen, Sornaraj Sivasankaran, Abhinand Balachandran, Sriram Rajkumar

机构 * EXL Health AI Lab at MEDIQA-WV 2025（EXL健康AI实验室） 纠错

专题命中 视觉问答 ：visual question answering(title)；分类 cs.AI

Comments 2 figures, 11 pages

Lost in Embeddings: Information Loss in Vision-Language Models

Wenyan Li, Raphael Tang, Chengzu Li, Caiqi Zhang, Ivan Vulić, Anders Søgaard

机构 * University of Copenhagen（哥本哈根大学） ； Microsoft（微软） ； University of Cambridge（剑桥大学） 纠错

专题命中 视觉问答 ：vision-language model(title)；分类 cs.CV

ConSens: Assessing context grounding in open-book question answering

Ivan Vankov, Matyo Ivanov, Adriana Correia, Victor Botev

机构 * Iris.ai BG 纠错

专题命中 视觉问答 ：grounding(title)；分类 cs.LG

Comments 9 pages, 3 figures, 3 tables

Beyond Text: Implementing Multimodal Large Language Model-Powered Multi-Agent Systems Using a No-Code Platform

Cheonsu Jeong

专题命中 视觉问答 ：multimodal large language model(title)；分类 cs.AI

Comments 22 pages, 27 figures

Journal ref 2025 Journal of Intelligence and Information Systems

Patch-level Sounding Object Tracking for Audio-Visual Question Answering

Zhangbin Li, Jinxing Zhou, Jing Zhang, Shengeng Tang, Kun Li, Dan Guo

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Accepted by AAAI 2025

ViConsFormer: Constituting Meaningful Phrases of Scene Texts using Transformer-based Method in Vietnamese Text-based Visual Question Answering

Nghia Hieu Nguyen, Tho Thanh Quan, Ngan Luu-Thuy Nguyen

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments PACLIC 2024

StackOverflowVQA: Stack Overflow Visual Question Answering Dataset

Motahhare Mirzaei, Mohammad Javad Pirhadi, Sauleh Eetemadi

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

PDF-MVQA: A Dataset for Multimodal Information Retrieval in PDF-based Visual Question Answering

Yihao Ding, Kaixuan Ren, Jiabin Huang, Siwen Luo, Soyeon Caren Han

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Accepted by IJCAI 2024

Detect2Interact: Localizing Object Key Field in Visual Question Answering (VQA) with LLMs

Jialou Wang, Manli Zhu, Yulei Li, Honglei Li, Longzhi Yang, Wai Lok Woo

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Accepted to IEEE Intelligent Systems

EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answering

Junjue Wang, Zhuo Zheng, Zihang Chen, Ailong Ma, Yanfei Zhong

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Accepted By AAAI 2024

PSYCHIC: A Neuro-Symbolic Framework for Knowledge Graph Question-Answering Grounding

Hanna Abi Akl

专题命中 视觉问答 ：grounding(title)；分类 cs.AI

Comments 10 pages, 3 figures, 2 tables, accepted for the Scholarly-QALD challenge at the International Semantic Web Conference (ISWC) 2023

Compressing And Debiasing Vision-Language Pre-Trained Models for Visual Question Answering

Qingyi Si, Yuanxin Liu, Zheng Lin, Peng Fu, Weiping Wang

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments EMNLP 2023

SceneGATE: Scene-Graph based co-Attention networks for TExt visual question answering

Feiqi Cao, Siwen Luo, Felipe Nunez, Zean Wen, Josiah Poon, Caren Han

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Published in Robotics (Q1, SCI indexed Journal): https://www.mdpi.com/2218-6581/12/4/114

Unveiling Cross Modality Bias in Visual Question Answering: A Causal View with Possible Worlds VQA

Ali Vosoughi, Shijian Deng, Songyang Zhang, Yapeng Tian, Chenliang Xu, Jiebo Luo

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments 22 pages

Toward Unsupervised Realistic Visual Question Answering

Yuwei Zhang, Chih-Hui Ho, Nuno Vasconcelos

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Yuwei Zhang and Chih-Hui Ho contributed equally to this work

Knowing Earlier what Right Means to You: A Comprehensive VQA Dataset for Grounding Relative Directions via Multi-Task Learning

Kyra Ahrens, Matthias Kerzel, Jae Hee Lee, Cornelius Weber, Stefan Wermter

专题命中 视觉问答 ：grounding(title)；分类 cs.CV

Journal ref IJCAI 2022 Workshop on Spatio-Temporal Reasoning and Learning

Good, Better, Best: Textual Distractors Generation for Multiple-Choice Visual Question Answering via Reinforcement Learning

Jiaying Lu, Xin Ye, Yi Ren, Yezhou Yang

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Journal ref CVPR'2022 Workshop on Open-Domain Retrieval Under a Multi-Modal Setting

SimVQA: Exploring Simulated Environments for Visual Question Answering

Paola Cascante-Bonilla, Hui Wu, Letao Wang, Rogerio Feris, Vicente Ordonez

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Accepted to CVPR 2022. Camera-Ready version. Project page: https://simvqa.github.io/

A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models

Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, Xiang Ren

专题命中 视觉问答 ：vision-language model(title)；分类 cs.CV

Comments Accepted to ACL 2022

GraghVQA: Language-Guided Graph Neural Networks for Graph-based Visual Question Answering

Weixin Liang, Yanhao Jiang, Zixuan Liu

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments NAACL 2021 MAI-Workshop. Code available at https://github.com/codexxxl/GraphVQA

Knowledge-Based Visual Question Answering in Videos

Noa Garcia, Mayu Otani, Chenhui Chu, Yuta Nakashima

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:1910.10706

Learning Rich Image Region Representation for Visual Question Answering

Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Rank 2 in VQA Challenge 2019

IQA: Visual Question Answering in Interactive Environments

Daniel Gordon, Aniruddha Kembhavi, Mohammad Rastegari, Joseph Redmon, Dieter Fox, Ali Farhadi

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Published in CVPR 2018

Reproducibility Report for "Learning To Count Objects In Natural Images For Visual Question Answering"

Shagun Sodhani, Vardaan Pahuja

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Submitted to Reproducibility in ML Workshop, ICML'18

Differential Attention for Visual Question Answering

Badri Patro, Vinay P. Namboodiri

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Accepted to CVPR 2018

Learning to Reason: End-to-End Module Networks for Visual Question Answering

Ronghang Hu, Jacob Andreas, Marcus Rohrbach, Trevor Darrell, Kate Saenko

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

A Focused Dynamic Attention Model for Visual Question Answering

Ilija Ilievski, Shuicheng Yan, Jiashi Feng

专题命中 视觉问答 ：visual question answering(title)；分类 cs.CV

Comments Submitted to ECCV 2016

Llama-Mobile: Efficient 2.7-Bit Quantization of VLMs

Llama-Mobile：视觉语言模型的高效2.7位量化

Luka Ribar, Jeevan Bhoot, Douglas Orr

机构 * Graphcore Research（Graphcore研究院） ； Arm（Arm公司） 纠错

专题命中 视觉问答 ：vision-language model(abstract)；visual question answering(abstract)；分类 cs.CV、cs.LG

AI总结 针对VLMs部署于移动设备的资源瓶颈，提出结合自生成训练数据的量化流水线与2.7位参数格式的框架，将Llama 3.2 11B Vision Instruct模型压缩至3.7 GB且保留视觉问答任务性能。

A Pathway to General-Purpose Scientific AI: Multimodal Comprehension of Scientific Images

通用科学人工智能的实现路径：科学图像的多模态理解

Jennifer D'Souza, Fahad Ahmed, Cecilia Andrea Bustamante Andrade, Lina Frolova, Poorani Gnanasambandan, Dilshad Hussain, Muhammad Uzair Khan, Nkembeng Kevin Nkengfoa, Paul Praveen J., Fabio Priante, Sjoerd Franciscus van der Werf, Thomas Frederik Jan van Roeden

机构 * TIB Leibniz Information Centre for Science and Technology（莱布尼茨科学与技术信息中心（TIB）） ； Eindhoven University of Technology（埃因霍温理工大学） ； Freie Universität Berlin（柏林自由大学） ； International Center for Chemical and Biological Sciences, University of Karachi（卡拉奇大学国际化学与生物科学中心） ； National University of Sciences and Technology（国家科技大学） ； University of Warwick（华威大学） ； PSG College of Technology（PSG理工学院） ； Aalto University（阿尔托大学） 纠错

专题命中 视觉问答 ：visual question answering(abstract)；grounding(abstract)；分类 cs.CV、cs.AI

AI总结 该研究提出以科学图像多模态理解构建通用科学AI的路径，依托ALD/E-ImageMiner基准与2026年ICDAR竞赛，明确相关任务能力检验维度及长期研究方向，推动可机器执行的科学视觉知识与可验证多模态科学AI发展。

Comments 15 pages, 1 figure