视觉大模型 / VLM

MF2-MVQA: A Multi-stage Feature Fusion method for Medical Visual Question Answering

Shanshan Song, Jiangyun Li, Jing Wang, Yuanxiu Cai, Wenkai Dong

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

What's Different between Visual Question Answering for Machine "Understanding" Versus for Accessibility?

Yang Trista Cao, Kyle Seelman, Kyungjun Lee, Hal Daumé

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Journal ref AACL-IJCNLP 2022 The 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing

Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning

Qingyi Si, Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Findings of EMNLP-2022

Multi-Modal Fusion Transformer for Visual Question Answering in Remote Sensing

Tim Siebert, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted in SPIE Remote Sensing (ESI22R)

Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering

Ander Salaberria, Gorka Azkune, Oier Lopez de Lacalle, Aitor Soroa, Eneko Agirre

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Under review. 25 pages with 4 figures

Journal ref Expert Systems with Applications, Volume 212, 2023, 118669

Recent, rapid advancement in visual question answering architecture: a review

Venkat Kodali, Daniel Berleant

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 8 pages. Accepted to EIT2022 conference and posted on ArXiv in accordance with IEEE policy

EBMs vs. CL: Exploring Self-Supervised Visual Pretraining for Visual Question Answering

Violetta Shevchenko, Ehsan Abbasnejad, Anthony Dick, Anton van den Hengel, Damien Teney

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Consistency-preserving Visual Question Answering in Medical Imaging

Sergio Tascon-Morales, Pablo Márquez-Neila, Raphael Sznitman

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Appears in Medical Image Computing and Computer Assisted Interventions (MICCAI), 2022

Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection

Diego Garcia-Olano, Yasumasa Onoe, Joydeep Ghosh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Journal ref Proceedings of the 1st International Workshop on Multimodal Understanding for the Web and Social Media, co-located with the Web Conference 2022 (WWW '22 Companion), April 25--29, 2022, Virtual Event, Lyon, France

A Neuro-Symbolic ASP Pipeline for Visual Question Answering

Thomas Eiter, Nelson Higuera, Johannes Oetsch, Michael Pritz

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Paper presented at the 38th International Conference on Logic Programming (ICLP 2022), 15 pages

Declaration-based Prompt Tuning for Visual Question Answering

Yuhang Liu, Wei Wei, Daowan Peng, Feida Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to IJCAI2022, data and codes are available at https://github.com/CCIIPLab/DPT

Regularizing Attention Networks for Anomaly Detection in Visual Question Answering

Doyup Lee, Yeongjae Cheon, Wook-Shin Han

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments 16 pages, 7 figures, Accepted by AAAI-21

SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answering

Vipul Gupta, Zhuowan Li, Adam Kortylewski, Chenyu Zhang, Yingwei Li, Alan Yuille

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments 11 pages, Computer Vision and Pattern Recognition 2022

Dynamic Key-value Memory Enhanced Multi-step Graph Reasoning for Knowledge-based Visual Question Answering

Mingxiao Li, Marie-Francine Moens

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

On the Efficacy of Co-Attention Transformer Layers in Visual Question Answering

Ankur Sikarwar, Gabriel Kreiman

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Language bias in Visual Question Answering: A Survey and Taxonomy

Desen Yuan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 10 pages

Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking

Dirk Väth, Pascal Tilli, Ngoc Thang Vu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 6.5 pages, 9 figures

Latent Variable Models for Visual Question Answering

Zixu Wang, Yishu Miao, Lucia Specia

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments ICCV21 CLVL: 4th Workshop on Closing the Loop Between Vision and Language

Improved RAMEN: Towards Domain Generalization for Visual Question Answering

Bhanuka Manesha Samarasekara Vitharana Gamage, Lim Chern Hong

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments 11 pages, 3 figures, 2 tables

Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering

Corentin Dancette, Remi Cadene, Damien Teney, Matthieu Cord

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted at ICCV 2021. Code is available at https://github.com/cdancette/detect-shortcuts

Reciprocal Attention Fusion for Visual Question Answering

Moshiur R Farazi, Salman H Khan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments To appear in the British Machine Vision Conference (BMVC), September 2018

Journal ref Proceedings of the British Machine Vision Conference (250) 2018

Greedy Gradient Ensemble for Robust Visual Question Answering

Xinzhe Han, Shuhui Wang, Chi Su, Qingming Huang, Qi Tian

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted by ICCV 2021. Code: https://github.com/GeraldHan/GGE

Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering

Aman Jain, Mayank Kothyari, Vishwajeet Kumar, Preethi Jyothi, Ganesh Ramakrishnan, Soumen Chakrabarti

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted at SIGIR 2021

REXUP: I REason, I EXtract, I UPdate with Structured Compositional Reasoning for Visual Question Answering

Siwen Luo, Soyeon Caren Han, Kaiyuan Sun, Josiah Poon

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ICONIP 2020

Visual Question Answering Using Semantic Information from Image Descriptions

Tasmia Tasrin, Md Sultan Al Nahian, Brent Harrison

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 6 pages, 5 figures, The 34th International FLAIRS Conference

Analysis on Image Set Visual Question Answering

Abhinav Khattar, Aviral Joshi, Har Simrat Singh, Pulkit Goel, Rohit Prakash Barnwal

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answering

Bo Liu, Li-Ming Zhan, Li Xu, Lin Ma, Yan Yang, Xiao-Ming Wu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments ISBI 2021

Understanding the Role of Scene Graphs in Visual Question Answering

Vinay Damodaran, Sharanya Chakravarthy, Akshay Kumar, Anjana Umapathy, Teruko Mitamura, Yuta Nakashima, Noa Garcia, Chenhui Chu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Visual Question Answering using Deep Learning: A Survey and Performance Analysis

Yash Srivastava, Vaishnav Murali, Shiv Ram Dubey, Snehasis Mukherjee

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted in Fifth IAPR International Conference on Computer Vision and Image Processing (CVIP), 2020

Logically Consistent Loss for Visual Question Answering

Anh-Cat Le-Ngo, Truyen Tran, Santu Rana, Sunil Gupta, Svetha Venkatesh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 10 pages, 6 figure, 9 tables