视觉大模型 / VLM

Beyond Retrieval: Joint Supervision and Multimodal Document Ranking for Textbook Question Answering

Hessa Alawwad, Usman Naseem, Areej Alhothali, Ali Alkhathlan, Amani Jamal

机构 * Faculty of Computing and Information Technology, King Abdulaziz University（计算机与信息科技学院，国王阿卜杜勒阿齐兹大学） ； College of Computer and Information Science, Imam Mohammad Ibn Saud Islamic University (IMSIU)（计算机与信息科学学院，伊玛目穆罕默德·本·萨乌德伊斯兰大学） ； School of Computing, Macquarie University（计算学院，麦考瑞大学） 纠错

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.AI

Comments 14 pages, 16 figure

Understanding Complexity in VideoQA via Visual Program Generation

Cristobal Eyzaguirre, Igor Vasiljevic, Achal Dave, Jiajun Wu, Rares Andrei Ambrus, Thomas Kollar, Juan Carlos Niebles, Pavel Tokmakov

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

SurveillanceVQA-589K: A Benchmark for Comprehensive Surveillance Video-Language Understanding with Large Models

Bo Liu, Pengfei Qiao, Minhan Ma, Xuange Zhang, Yinan Tang, Peng Xu, Kun Liu, Tongtong Yuan

机构 * Department of Computer Science, Beijing University of Technology（北京理工大学计算机科学系） ； Inspur Electronic Information Industry Co., Ltd（Inspur电子信息产业有限公司） ； Department of Electronic Engineering, Tsinghua University（清华大学电子工程系） ； JD Explore Academy（京东探索研究院） 纠错

专题命中 视觉问答 ：vision-language model(abstract)；分类 cs.CV

Comments The dataset and code are publicly available at: https://huggingface.co/datasets/fei213/SurveillanceVQA-589K

End-to-End Vision Tokenizer Tuning

Wenxuan Wang, Fan Zhang, Yufeng Cui, Haiwen Diao, Zhuoyan Luo, Huchuan Lu, Jing Liu, Xinlong Wang

机构 * Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； Beijing Academy of Artificial Intelligence（北京人工智能研究院） ； Dalian University of Technology（大连理工大学） ； Tsinghua University（清华大学） 纠错

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Multi-Modal Explainable Medical AI Assistant for Trustworthy Human-AI Collaboration

Honglong Yang, Shanshan Song, Yi Qin, Lehan Wang, Haonan Wang, Xinpeng Ding, Qixiang Zhang, Bodong Du, Xiaomeng Li

机构 * Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology（电子与计算机工程系，香港科学与技术大学） ； Department of Computer Science and Engineering, The Hong Kong University of Science and Technology（计算机科学与工程系，香港科学与技术大学） 纠错

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

A Grounded Memory System For Smart Personal Assistants

Felix Ocker, Jörg Deigmöller, Pavel Smirnov, Julian Eggert

机构 * Honda Research Institute Europe（本田研究院欧洲分部） 纠错

专题命中 视觉问答 ：vision language model(abstract)；分类 cs.AI

Comments 8 pages, 5 figures, accepted for the ESWC 2025 TEXT2KG workshop

Sim2Real Transfer for Vision-Based Grasp Verification

Pau Amargant, Peter Hönig, Markus Vincze

机构 * Faculty of Electrical Engineering, Technical University of Vienna（维也纳技术大学电子工程学院） ； Polytechnic University of Catalonia（加泰罗尼亚理工大学） 纠错

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted at Austrian Robotics Workshop 2025

Knowledge-Augmented Language Models Interpreting Structured Chest X-Ray Findings

Alexander Davis, Rafael Souza, Jia-Hao Lim

机构 * University of Brasilia（巴西大学） 纠错

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

HierarQ: Task-Aware Hierarchical Q-Former for Enhanced Video Understanding

Shehreen Azad, Vibhav Vineet, Yogesh Singh Rawat

机构 * Center for Research in Computer Vision, University of Central Florida（计算机视觉研究中心，中央佛罗里达大学） ； Microsoft Research（微软研究院） 纠错

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

Comments Accepted in CVPR 2025

KGMEL: Knowledge Graph-Enhanced Multimodal Entity Linking

Juyeon Kim, Geon Lee, Taeuk Kim, Kijung Shin

机构 * KAIST（韩国科学技术院） ； Hanyang University（翰林大学） 纠错

专题命中 视觉问答 ：vision-language model(abstract)；分类 cs.AI

Comments SIGIR 2025 (Short)

MMKB-RAG: A Multi-Modal Knowledge-Based Retrieval-Augmented Generation Framework

Zihan Ling, Zhiyao Guo, Yixuan Huang, Yi An, Shuai Xiao, Jinsong Lan, Xiaoyong Zhu, Bo Zheng

机构 * Peking University（北京大学） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 视觉问答 ：MLLM(abstract)；分类 cs.AI

Hadamard product in deep learning: Introduction, Advances and Challenges

Grigorios G Chrysos, Yongtao Wu, Razvan Pascanu, Philip Torr, Volkan Cevher

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.LG

Comments Accepted in IEEE T-PAMI

SEAL: Semantic Attention Learning for Long Video Representation

Lan Wang, Yujia Chen, Du Tran, Vishnu Naresh Boddeti, Wen-Sheng Chu

专题命中 视觉问答 ：grounding(abstract)；分类 cs.CV

EmbodiedEval: Evaluate Multimodal LLMs as Embodied Agents

Zhili Cheng, Yuge Tu, Ran Li, Shiqi Dai, Jinyi Hu, Shengding Hu, Jiahao Li, Yang Shi, Tianyu Yu, Weize Chen, Lei Shi, Maosong Sun

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

REVEAL: Relation-based Video Representation Learning for Video-Question-Answering

Sofian Chaybouti, Walid Bousselham, Moritz Wolter, Hilde Kuehne

专题命中 视觉问答 ：VLM(abstract)；分类 cs.CV

Comments 18 pages, 7 figures

MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models

Wulin Xie, Yi-Fan Zhang, Chaoyou Fu, Yang Shi, Bingyan Nie, Hongkai Chen, Zhang Zhang, Liang Wang, Tieniu Tan

专题命中 视觉问答 ：MLLM(abstract)；分类 cs.CV

Comments Project page: https://mme-unify.github.io/

Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Making

Zhuoning Xu, Jian Xu, Mingqing Zhang, Peijie Wang, Chao Deng, Cheng-Lin Liu

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

Can DeepSeek Reason Like a Surgeon? An Empirical Evaluation for Vision-Language Understanding in Robotic-Assisted Surgery

Boyi Ma, Yanguang Zhao, Jie Wang, Guankun Wang, Kun Yuan, Tong Chen, Long Bai, Hongliang Ren

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

Comments Technical Report

FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal Reasoning

Jie Ma, Zhitao Gao, Qi Chai, Jun Liu, Pinghui Wang, Jing Tao, Zhou Su

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Under Review

Scaling Language-Free Visual Representation Learning

David Fan, Shengbang Tong, Jiachen Zhu, Koustuv Sinha, Zhuang Liu, Xinlei Chen, Michael Rabbat, Nicolas Ballas, Yann LeCun, Amir Bar, Saining Xie

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Project page at https://davidfan.io/webssl/

MPDrive: Improving Spatial Understanding with Marker-Based Prompt Learning for Autonomous Driving

Zhiyuan Zhang, Xiaofan Li, Zhihao Xu, Wenjie Peng, Zijian Zhou, Miaojing Shi, Shuangping Huang

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted by CVPR 2025

Unveiling the Mist over 3D Vision-Language Understanding: Object-centric Evaluation with Chain-of-Analysis

Jiangyong Huang, Baoxiong Jia, Yan Wang, Ziyu Zhu, Xiongkun Linghu, Qing Li, Song-Chun Zhu, Siyuan Huang

专题命中 视觉问答 ：grounding(abstract)；分类 cs.CV

Comments CVPR 2025. Project page: https://beacon-3d.github.io

Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields

Shijie Zhou, Hui Ren, Yijia Weng, Shuwang Zhang, Zhen Wang, Dejia Xu, Zhiwen Fan, Suya You, Zhangyang Wang, Leonidas Guibas, Achuta Kadambi

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Where is this coming from? Making groundedness count in the evaluation of Document VQA models

Armineh Nourbakhsh, Siddharth Parekh, Pranav Shetty, Zhao Jin, Sameena Shah, Carolyn Rose

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

Comments Accepted to NAACL Findings 2025

DiN: Diffusion Model for Robust Medical VQA with Semantic Noisy Labels

Erjian Guo, Zhen Zhao, Zicheng Wang, Tong Chen, Yunyi Liu, Luping Zhou

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Attention Overlap Is Responsible for The Entity Missing Problem in Text-to-image Diffusion Models!

Arash Marioriyad, Mohammadali Banayeeanzade, Reza Abbasi, Mohammad Hossein Rohban, Mahdieh Soleymani Baghshah

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments TMLR - 2025

Journal ref Transactions on Machine Learning Research, 2025, 2835-8856

4D-Bench: Benchmarking Multi-modal Large Language Models for 4D Object Understanding

Wenxuan Zhu, Bing Li, Cheng Zheng, Jinjie Mai, Jun Chen, Letian Jiang, Abdullah Hamdi, Sara Rojas Martinez, Chia-Wen Lin, Mohamed Elhoseiny, Bernard Ghanem

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

Agentic Keyframe Search for Video Question Answering

Sunqi Fan, Meng-Hao Guo, Shuojin Yang

专题命中 视觉问答 ：visual reasoning(abstract)；分类 cs.CV

DocVideoQA: Towards Comprehensive Understanding of Document-Centric Videos through Question Answering

Haochen Wang, Kai Hu, Liangcai Gao

专题命中 视觉问答 ：MLLM(abstract)；分类 cs.CV

Unlock the Power of Unlabeled Data in Language Driving Model

Chaoqun Wang, Jie Yang, Xiaobin Hong, Ruimao Zhang

专题命中 视觉问答 ：InternVL(abstract)；分类 cs.CV

Comments Accepted by ICRA2025