视觉大模型 / VLM

Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective

Meiqi Chen, Yixin Cao, Yan Zhang, Chaochao Lu

专题命中 视觉问答 ：multimodal large language model(title)；visual question answering(abstract)；MLLM(abstract)；分类 cs.CV

Multimodal Commonsense Knowledge Distillation for Visual Question Answering

Shuo Yang, Siwen Luo, Soyeon Caren Han

专题命中 视觉问答 ：visual question answering(title,abstract)；multimodal large language model(abstract)；分类 cs.AI

Comments AAAI 2025 (Accepted, Oral)

E3D-GPT: Enhanced 3D Visual Foundation for Medical Vision-Language Model

Haoran Lai, Zihang Jiang, Qingsong Yao, Rongsheng Wang, Zhiyang He, Xiaodong Tao, Wei Wei, Weifu Lv, S. Kevin Zhou

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

ERVQA: A Dataset to Benchmark the Readiness of Large Vision Language Models in Hospital Environments

Sourjyadip Ray, Kushal Gupta, Soumi Kundu, Payal Arvind Kasat, Somak Aditya, Pawan Goyal

专题命中 视觉问答 ：vision language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments Accepted at EMNLP 2024

MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale

Xiaotang Gai, Chenyi Zhou, Jiaxiang Liu, Yang Feng, Jian Wu, Zuozhu Liu

专题命中 视觉问答 ：visual question answering(title,abstract)；multimodal large language model(abstract)；分类 cs.CV

TUBench: Benchmarking Large Vision-Language Models on Trustworthiness with Unanswerable Questions

Xingwei He, Qianru Zhang, A-Long Jin, Yuan Yuan, Siu-Ming Yiu

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

FMBench: Benchmarking Fairness in Multimodal Large Language Models on Medical Tasks

Peiran Wu, Che Liu, Canyu Chen, Jun Li, Cosmin I. Bercea, Rossella Arcucci

专题命中 视觉问答 ：multimodal large language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

TrojVLM: Backdoor Attack Against Vision Language Models

Weimin Lyu, Lu Pang, Tengfei Ma, Haibin Ling, Chao Chen

专题命中 视觉问答 ：vision language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments ECCV 2024

Enhancing Explainability in Multimodal Large Language Models Using Ontological Context

Jihen Amara, Birgitta König-Ries, Sheeba Samuel

专题命中 视觉问答 ：multimodal large language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

CAST: Cross-modal Alignment Similarity Test for Vision Language Models

Gautier Dagan, Olga Loginova, Anil Batra

专题命中 视觉问答 ：vision language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Evaluating Attribute Comprehension in Large Vision-Language Models

Haiwen Zhang, Zixi Yang, Yuanzhi Liu, Xinran Wang, Zheqi He, Kongming Liang, Zhanyu Ma

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments 15 pages, 4 figures

Vintern-1B: An Efficient Multimodal Large Language Model for Vietnamese

Khang T. Doan, Bao G. Huynh, Dung T. Hoang, Thuc D. Pham, Nhat H. Pham, Quan T. M. Nguyen, Bang Q. Vo, Suong N. Hoang

专题命中 视觉问答 ：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.LG

Generalizing Visual Question Answering from Synthetic to Human-Written Questions via a Chain of QA with a Large Language Model

Taehee Kim, Yeongjae Cho, Heejun Shin, Yohan Jo, Dongmyung Shin

专题命中 视觉问答 ：visual question answering(title,abstract)；vision-language model(abstract)；分类 cs.CV

AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectors

You-Ming Chang, Chen Yeh, Wei-Chen Chiu, Ning Yu

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Targeted Visual Prompting for Medical Visual Question Answering

Sergio Tascon-Morales, Pablo Márquez-Neila, Raphael Sznitman

专题命中 视觉问答 ：visual question answering(title,abstract)；multimodal large language model(abstract)；分类 cs.CV

Comments Accepted at the MICCAI AMAI Workshop 2024

Towards Flexible Evaluation for Generative Visual Question Answering

Huishan Ji, Qingyi Si, Zheng Lin, Weiping Wang

专题命中 视觉问答 ：visual question answering(title,abstract)；multimodal large language model(abstract)；分类 cs.CV

Realizing Visual Question Answering for Education: GPT-4V as a Multimodal AI

Gyeong-Geon Lee, Xiaoming Zhai

专题命中 视觉问答 ：visual question answering(title,abstract)；visual language model(abstract)；分类 cs.AI

CLEVR-POC: Reasoning-Intensive Visual Question Answering in Partially Observable Environments

Savitha Sam Abraham, Marjan Alirezaie, Luc De Raedt

专题命中 视觉问答 ：visual question answering(title,abstract)；vision language model(abstract)；分类 cs.AI

Comments 17 pages, 10 images, Accepted at LREC-COLING 2024 - The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation

Enhancing Generalization in Medical Visual Question Answering Tasks via Gradient-Guided Model Perturbation

Gang Liu, Hongyang Li, Zerui He, Shenjun Zhong

专题命中 视觉问答 ：visual question answering(title,abstract)；visual language model(abstract)；分类 cs.CV

Examining Gender and Racial Bias in Large Vision-Language Models Using a Novel Dataset of Parallel Images

Kathleen C. Fraser, Svetlana Kiritchenko

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments To appear at EACL 2024

VQA4CIR: Boosting Composed Image Retrieval with Visual Question Answering

Chun-Mei Feng, Yang Bai, Tao Luo, Zhen Li, Salman Khan, Wangmeng Zuo, Xinxing Xu, Rick Siow Mong Goh, Yong Liu

专题命中 视觉问答 ：visual question answering(title,abstract)；LLaVA(abstract)；分类 cs.CV

p-Laplacian Adaptation for Generative Pre-trained Vision-Language Models

Haoyuan Wu, Xinyun Zhang, Peng Xu, Peiyu Liao, Xufeng Yao, Bei Yu

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments Accepted by AAAI24. The first two authors contributed equally to this paper

ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraints

Elad Richardson, Kfir Goldberg, Yuval Alaluf, Daniel Cohen-Or

专题命中 视觉问答 ：VLM(title,abstract)；vision-language model(abstract)；分类 cs.CV

Comments Project page: https://kfirgoldberg.github.io/ConceptLab/

Improving mitosis detection on histopathology images using large vision-language models

Ruiwen Ding, James Hall, Neil Tenenholtz, Kristen Severson

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments Submitted to IEEE ISBI 2024. Under review

Sentence Attention Blocks for Answer Grounding

Seyedalireza Khoshsirat, Chandra Kambhamettu

专题命中 视觉问答 ：grounding(title,abstract)；visual question answering(abstract)；分类 cs.CV

Visual Question Answering in the Medical Domain

Louisa Canepa, Sonit Singh, Arcot Sowmya

专题命中 视觉问答 ：visual question answering(title,abstract)；visual reasoning(abstract)；分类 cs.CV

Comments 8 pages, 7 figures, Accepted to DICTA 2023 Conference

Interpretable Visual Question Answering via Reasoning Supervision

Maria Parelli, Dimitrios Mallis, Markos Diomataris, Vassilis Pitsikalis

专题命中 视觉问答 ：visual question answering(title,abstract)；grounding(abstract)；分类 cs.CV

VQA Therapy: Exploring Answer Differences by Visually Grounding Answers

Chongyan Chen, Samreen Anjum, Danna Gurari

专题命中 视觉问答 ：grounding(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments IEEE/CVF International Conference on Computer Vision

Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detection

Rui Cao, Ming Shan Hee, Adriel Kuek, Wen-Haw Chong, Roy Ka-Wei Lee, Jing Jiang

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)；分类 cs.CV

Comments Camera-ready for 23, ACM MM

MixPHM: Redundancy-Aware Parameter-Efficient Tuning for Low-Resource Visual Question Answering

Jingjing Jiang, Nanning Zheng

专题命中 视觉问答 ：visual question answering(title,abstract)；vision-language model(abstract)；分类 cs.CV

Comments 13 pages, 6 figures, 9 tables. Accepted to CVPR 2023