视觉大模型 / VLM

4D-Bench: Benchmarking Multi-modal Large Language Models for 4D Object Understanding

Wenxuan Zhu, Bing Li, Cheng Zheng, Jinjie Mai, Jun Chen, Letian Jiang, Abdullah Hamdi, Sara Rojas Martinez, Chia-Wen Lin, Mohamed Elhoseiny, Bernard Ghanem

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

Agentic Keyframe Search for Video Question Answering

Sunqi Fan, Meng-Hao Guo, Shuojin Yang

专题命中 视觉问答 ：visual reasoning(abstract)；分类 cs.CV

DocVideoQA: Towards Comprehensive Understanding of Document-Centric Videos through Question Answering

Haochen Wang, Kai Hu, Liangcai Gao

专题命中 视觉问答 ：MLLM(abstract)；分类 cs.CV

Unlock the Power of Unlabeled Data in Language Driving Model

Chaoqun Wang, Jie Yang, Xiaobin Hong, Ruimao Zhang

专题命中 视觉问答 ：InternVL(abstract)；分类 cs.CV

Comments Accepted by ICRA2025

T2I-FineEval: Fine-Grained Compositional Metric for Text-to-Image Evaluation

Seyed Mohammad Hadi Hosseini, Amir Mohammad Izadi, Ali Abdollahi, Armin Saghafian, Mahdieh Soleymani Baghshah

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted at ECCV 2024 Workshop EVAL-FoMo

BIMBA: Selective-Scan Compression for Long-Range Video Question Answering

Md Mohaiminul Islam, Tushar Nagarajan, Huiyu Wang, Gedas Bertasius, Lorenzo Torresani

专题命中 视觉问答 ：MLLM(abstract)；分类 cs.CV

Comments Accepted by CVPR 2025

Breaking Neural Network Scaling Laws with Modularity

Akhilan Boopathy, Sunshine Jiang, William Yue, Jaedong Hwang, Abhiram Iyer, Ila Fiete

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.LG

Comments ICLR 2025

From Text to Visuals: Using LLMs to Generate Math Diagrams with Vector Graphics

Jaewook Lee, Jeongah Lee, Wanyong Feng, Andrew Lan

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

TI-JEPA: An Innovative Energy-based Joint Embedding Strategy for Text-Image Multimodal Systems

Khang H. N. Vo, Duc P. T. Nguyen, Thong Nguyen, Tho T. Quan

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

MoEMoE: Question Guided Dense and Scalable Sparse Mixture-of-Expert for Multi-source Multi-modal Answering

Vinay Kumar Verma, Shreyas Sunil Kulkarni, Happy Mittal, Deepak Gupta

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.LG

Comments To appear at NAACL Industry Track

Chart-HQA: A Benchmark for Hypothetical Question Answering in Charts

Xiangnan Chen, Yuancheng Fang, Qian Xiao, Juncheng Li, Jun Lin, Siliang Tang, Yi Yang, Yueting Zhuang

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.AI

Comments Under review

BackdoorMBTI: A Backdoor Learning Multimodal Benchmark Tool Kit for Backdoor Defense Evaluation

Haiyang Yu, Tian Xie, Jiaping Gui, Pengyang Wang, Ping Yi, Yue Wu

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

MQADet: A Plug-and-Play Paradigm for Enhancing Open-Vocabulary Object Detection via Multimodal Question Answering

Caixiong Li, Xiongwei Zhao, Jinhang Zhang, Xing Zhang, Qihao Sun, Zhou Wu

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

Insect-Foundation: A Foundation Model and Large Multimodal Dataset for Vision-Language Insect Understanding

Thanh-Dat Truong, Hoang-Quan Nguyen, Xuan-Bac Nguyen, Ashley Dowling, Xin Li, Khoa Luu

专题命中 视觉问答 ：LLaVA(abstract)；分类 cs.CV

EmoAssist: Emotional Assistant for Visual Impairment Community

Xingyu Qi, He Li, Linjie Li, Zhenyu Wu

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Performance Analysis of Traditional VQA Models Under Limited Computational Resources

Jihao Gu

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments 6 pages, 1 figure, 5 tabels, the paper has been accepted by the PRML'25 conference

CROPE: Evaluating In-Context Adaptation of Vision and Language Models to Culture-Specific Concepts

Malvina Nikandrou, Georgios Pantazopoulos, Nikolas Vitsakis, Ioannis Konstas, Alessandro Suglia

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

TUMTraffic-VideoQA: A Benchmark for Unified Spatio-Temporal Video Understanding in Traffic Scenes

Xingcheng Zhou, Konstantinos Larintzakis, Hao Guo, Walter Zimmer, Mingyu Liu, Hu Cao, Jiajie Zhang, Venkatnarayanan Lakshminarasimhan, Leah Strand, Alois C. Knoll

专题命中 视觉问答 ：grounding(abstract)；分类 cs.CV

LSceneLLM: Enhancing Large 3D Scene Understanding Using Adaptive Visual Preferences

Hongyan Zhi, Peihao Chen, Junyan Li, Shuailei Ma, Xinyu Sun, Tianhang Xiang, Yinjie Lei, Mingkui Tan, Chuang Gan

专题命中 视觉问答 ：vision-language model(abstract)；分类 cs.CV

Scene Understanding Enabled Semantic Communication with Open Channel Coding

Zhe Xiang, Fei Yu, Quan Deng, Yuandi Li, Zhiguo Wan

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

TimeLogic: A Temporal Logic Benchmark for Video QA

Sirnam Swetha, Hilde Kuehne, Mubarak Shah

专题命中 视觉问答 ：vision-language model(abstract)；分类 cs.CV

A Multimodal Social Agent

Athina Bikaki, Ioannis A. Kakadiaris

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

Comments 9 pages

MM-PhyRLHF: Reinforcement Learning Framework for Multimodal Physics Question-Answering

Janak Kapuriya, Chhavi Kirtani, Apoorv Singh, Jay Saraf, Naman Lal, Jatin Kumar, Adarsh Raj Shivam, Astha Verma, Avinash Anand, Rajiv Ratn Shah

专题命中 视觉问答 ：LLaVA(abstract)；分类 cs.AI

Perceive, Query & Reason: Enhancing Video QA with Question-Guided Temporal Queries

Roberto Amoroso, Gengyuan Zhang, Rajat Koner, Lorenzo Baraldi, Rita Cucchiara, Volker Tresp

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

Comments WACV 2025

J-EDI QA: Benchmark for deep-sea organism-specific multimodal LLM

Takero Yoshida, Yuikazu Ito, Yoshihiro Fujiwara, Shinji Tsuchida, Daisuke Sugiyama, Daisuke Matsuoka

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

PolySmart @ TRECVid 2024 Medical Video Question Answering

Jiaxin Wu, Yiyang Jiang, Xiao-Yong Wei, Qing Li

专题命中 视觉问答 ：LLaVA(abstract)；分类 cs.CV

Multimodal Hypothetical Summary for Retrieval-based Multi-image Question Answering

Peize Li, Qingyi Si, Peng Fu, Zheng Lin, Yan Wang

专题命中 视觉问答 ：multimodal large language model(abstract)；分类 cs.CV

Comments AAAI 2025

MedCoT: Medical Chain of Thought via Hierarchical Expert

Jiaxiang Liu, Yuan Wang, Jiawei Du, Joey Tianyi Zhou, Zuozhu Liu

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Journal ref EMNLP 2024

Track the Answer: Extending TextVQA from Image to Video with Spatio-Temporal Clues

Yan Zhang, Gangyan Zeng, Huawen Shen, Daiqing Wu, Yu Zhou, Can Ma

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathology

Yuxuan Sun, Yixuan Si, Chenglu Zhu, Xuan Gong, Kai Zhang, Pingyi Chen, Ye Zhang, Zhongyi Shui, Tao Lin, Lin Yang

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments 22 pages, 13 figures