视觉大模型 / VLM

RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-training

Zheng Yuan, Qiao Jin, Chuanqi Tan, Zhengyun Zhao, Hongyi Yuan, Fei Huang, Songfang Huang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learning

Xinyue Hu, Lin Gu, Kazuma Kobayashi, Qiyuan An, Qingyu Chen, Zhiyong Lu, Chang Su, Tatsuya Harada, Yingying Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Bridge Damage Cause Estimation Using Multiple Images Based on Visual Question Answering

Tatsuro Yamane, Pang-jo Chun, Ji Dang, Takayuki Okatani

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

HRVQA: A Visual Question Answering Benchmark for High-Resolution Aerial Images

Kun Li, George Vosselman, Michael Ying Yang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images

Ryota Tanaka, Kyosuke Nishida, Kosuke Nishida, Taku Hasegawa, Itsumi Saito, Kuniko Saito

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by AAAI2023

Multimodal Inverse Cloze Task for Knowledge-based Visual Question Answering

Paul Lerner, Olivier Ferret, Camille Guinaudeau

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.LG

Comments Accepted at ECIR 2023

Change Detection Meets Visual Question Answering

Zhenghang Yuan, Lichao Mou, Zhitong Xiong, Xiaoxiang Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

CL-CrossVQA: A Continual Learning Benchmark for Cross-Domain Visual Question Answering

Yao Zhang, Haokun Chen, Ahmed Frikha, Yezi Yang, Denis Krompass, Gengyuan Zhang, Jindong Gu, Volker Tresp

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 10 pages, 6 figures

VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge

Sahithya Ravi, Aditya Chinchure, Leonid Sigal, Renjie Liao, Vered Shwartz

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at WACV 2023. For code and supplementary material, see https://github.com/aditya10/VLC-BERT

Entity-Focused Dense Passage Retrieval for Outside-Knowledge Visual Question Answering

Jialin Wu, Raymond J. Mooney

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments EMNLP 2022

Reliable Visual Question Answering: Abstain Rather Than Answer Incorrectly

Spencer Whitehead, Suzanne Petryk, Vedaad Shakib, Joseph Gonzalez, Trevor Darrell, Anna Rohrbach, Marcus Rohrbach

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments ECCV 2022. Code and models are available here: https://github.com/facebookresearch/reliable_vqa

REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering

Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2022

Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline

Lichen Zhao, Daigang Cai, Jing Zhang, Lu Sheng, Dong Xu, Rui Zheng, Yinjie Zhao, Lipeng Wang, Xibo Fan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 13 pages, 10 figures

Overcoming Language Priors in Visual Question Answering via Distinguishing Superficially Similar Instances

Yike Wu, Yu Zhao, Shiwan Zhao, Ying Zhang, Xiaojie Yuan, Guoqing Zhao, Ning Jiang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Published in COLING 2022

Aesthetic Visual Question Answering of Photographs

Xin Jin, Wu Zhou, Xinghui Zhou, Shuai Cui, Le Zhang, Jianwen Lv, Shu Zhao

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 13 pages, 7 figures, on going research

Semantic-aware Modular Capsule Routing for Visual Question Answering

Yudong Han, Jianhua Yin, Jianlong Wu, Yinwei Wei, Liqiang Nie

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 12 pages, 4 figures, submitted to IEEE Transactions on Image Processing

From Easy to Hard: Learning Language-guided Curriculum for Visual Question Answering on Remote Sensing Data

Zhenghang Yuan, Lichao Mou, Qi Wang, Xiao Xiang Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Invariant Grounding for Video Question Answering

Yicong Li, Xiang Wang, Junbin Xiao, Wei Ji, Tat-Seng Chua

专题命中 视觉问答 ：grounding(title,abstract)；分类 cs.CV

Comments CVPR2022 Oral

From Pixels to Objects: Cubic Visual Attention for Visual Question Answering

Jingkuan Song, Pengpeng Zeng, Lianli Gao, Heng Tao Shen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Gender and Racial Bias in Visual Question Answering Datasets

Yusuke Hirota, Yuta Nakashima, Noa Garcia

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments ACM Conference on Fairness, Accountability, and Transparency (FAccT 2022)

Joint learning of object graph and relation graph for visual question answering

Hao Li, Xu Li, Belhal Karimi, Jie Chen, Mingming Sun

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 6 pages, 4 figures, Accepted by ICME 2022

MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding

Revanth Gangi Reddy, Xilin Rui, Manling Li, Xudong Lin, Haoyang Wen, Jaemin Cho, Lifu Huang, Mohit Bansal, Avirup Sil, Shih-Fu Chang, Alexander Schwing, Heng Ji

专题命中 视觉问答 ：grounding(title,abstract)；分类 cs.CV

Comments Accepted at AAAI 2022

Dual-Key Multimodal Backdoors for Visual Question Answering

Matthew Walmer, Karan Sikka, Indranil Sur, Abhinav Shrivastava, Susmit Jha

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Published as conference paper at CVPR 2022. 22 pages, 11 figures, 12 tables

Coarse-to-Fine Reasoning for Visual Question Answering

Binh X. Nguyen, Tuong Do, Huy Tran, Erman Tjiputra, Quang D. Tran, Anh Nguyen

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted in CVPR 2022 Workshops

MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering

Yang Ding, Jing Yu, Bang Liu, Yue Hu, Mingxin Cui, Qi Wu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted by CVPR2022

Barlow constrained optimization for Visual Question Answering

Abhishek Jha, Badri N. Patro, Luc Van Gool, Tinne Tuytelaars

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Assessing the Robustness of Visual Question Answering Models

Jia-Hong Huang, Modar Alfadly, Bernard Ghanem, Marcel Worring

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 24 pages, 13 figures, International Journal of Computer Vision (IJCV) [under review]. arXiv admin note: substantial text overlap with arXiv:1711.06232, arXiv:1709.04625

Point and Ask: Incorporating Pointing into Visual Question Answering

Arjun Mani, Nobline Yoo, Will Hinthorn, Olga Russakovsky

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Privacy Preserving Visual Question Answering

Cristian-Paul Bara, Qing Ping, Abhinav Mathur, Govind Thattai, Rohith MV, Gaurav S. Sukhatme

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

MGA-VQA: Multi-Granularity Alignment for Visual Question Answering

Peixi Xiong, Yilin Shen, Hongxia Jin

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV