视觉大模型 / VLM

Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection

Diego Garcia-Olano, Yasumasa Onoe, Joydeep Ghosh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Journal ref Proceedings of the 1st International Workshop on Multimodal Understanding for the Web and Social Media, co-located with the Web Conference 2022 (WWW '22 Companion), April 25--29, 2022, Virtual Event, Lyon, France

A Neuro-Symbolic ASP Pipeline for Visual Question Answering

Thomas Eiter, Nelson Higuera, Johannes Oetsch, Michael Pritz

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Paper presented at the 38th International Conference on Logic Programming (ICLP 2022), 15 pages

Declaration-based Prompt Tuning for Visual Question Answering

Yuhang Liu, Wei Wei, Daowan Peng, Feida Zhu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted to IJCAI2022, data and codes are available at https://github.com/CCIIPLab/DPT

Regularizing Attention Networks for Anomaly Detection in Visual Question Answering

Doyup Lee, Yeongjae Cheon, Wook-Shin Han

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments 16 pages, 7 figures, Accepted by AAAI-21

SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answering

Vipul Gupta, Zhuowan Li, Adam Kortylewski, Chenyu Zhang, Yingwei Li, Alan Yuille

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments 11 pages, Computer Vision and Pattern Recognition 2022

Dynamic Key-value Memory Enhanced Multi-step Graph Reasoning for Knowledge-based Visual Question Answering

Mingxiao Li, Marie-Francine Moens

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

On the Efficacy of Co-Attention Transformer Layers in Visual Question Answering

Ankur Sikarwar, Gabriel Kreiman

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Language bias in Visual Question Answering: A Survey and Taxonomy

Desen Yuan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 10 pages

Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking

Dirk Väth, Pascal Tilli, Ngoc Thang Vu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 6.5 pages, 9 figures

Latent Variable Models for Visual Question Answering

Zixu Wang, Yishu Miao, Lucia Specia

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments ICCV21 CLVL: 4th Workshop on Closing the Loop Between Vision and Language

Improved RAMEN: Towards Domain Generalization for Visual Question Answering

Bhanuka Manesha Samarasekara Vitharana Gamage, Lim Chern Hong

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments 11 pages, 3 figures, 2 tables

Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering

Corentin Dancette, Remi Cadene, Damien Teney, Matthieu Cord

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted at ICCV 2021. Code is available at https://github.com/cdancette/detect-shortcuts

Reciprocal Attention Fusion for Visual Question Answering

Moshiur R Farazi, Salman H Khan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments To appear in the British Machine Vision Conference (BMVC), September 2018

Journal ref Proceedings of the British Machine Vision Conference (250) 2018

Greedy Gradient Ensemble for Robust Visual Question Answering

Xinzhe Han, Shuhui Wang, Chi Su, Qingming Huang, Qi Tian

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted by ICCV 2021. Code: https://github.com/GeraldHan/GGE

Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering

Aman Jain, Mayank Kothyari, Vishwajeet Kumar, Preethi Jyothi, Ganesh Ramakrishnan, Soumen Chakrabarti

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted at SIGIR 2021

REXUP: I REason, I EXtract, I UPdate with Structured Compositional Reasoning for Visual Question Answering

Siwen Luo, Soyeon Caren Han, Kaiyuan Sun, Josiah Poon

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ICONIP 2020

Visual Question Answering Using Semantic Information from Image Descriptions

Tasmia Tasrin, Md Sultan Al Nahian, Brent Harrison

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 6 pages, 5 figures, The 34th International FLAIRS Conference

Analysis on Image Set Visual Question Answering

Abhinav Khattar, Aviral Joshi, Har Simrat Singh, Pulkit Goel, Rohit Prakash Barnwal

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answering

Bo Liu, Li-Ming Zhan, Li Xu, Lin Ma, Yan Yang, Xiao-Ming Wu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments ISBI 2021

Understanding the Role of Scene Graphs in Visual Question Answering

Vinay Damodaran, Sharanya Chakravarthy, Akshay Kumar, Anjana Umapathy, Teruko Mitamura, Yuta Nakashima, Noa Garcia, Chenhui Chu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Visual Question Answering using Deep Learning: A Survey and Performance Analysis

Yash Srivastava, Vaishnav Murali, Shiv Ram Dubey, Snehasis Mukherjee

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted in Fifth IAPR International Conference on Computer Vision and Image Processing (CVIP), 2020

Logically Consistent Loss for Visual Question Answering

Anh-Cat Le-Ngo, Truyen Tran, Santu Rana, Sunil Gupta, Svetha Venkatesh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments 10 pages, 6 figure, 9 tables

Cross-modal Knowledge Reasoning for Knowledge-based Visual Question Answering

Jing Yu, Zihao Zhu, Yujing Wang, Weifeng Zhang, Yue Hu, Jianlong Tan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted at Pattern Recognition. arXiv admin note: substantial text overlap with arXiv:2006.09073

RUArt: A Novel Text-Centered Solution for Text-Based Visual Question Answering

Zan-Xia Jin, Heran Wu, Chun Yang, Fang Zhou, Jingyan Qin, Lei Xiao, Xu-Cheng Yin

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Attention Guided Semantic Relationship Parsing for Visual Question Answering

Moshiur Farazi, Salman Khan, Nick Barnes

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Hierarchical Deep Multi-modal Network for Medical Visual Question Answering

Deepak Gupta, Swati Suman, Asif Ekbal

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments Accepted for publication at Expert Systems with Applications

Component Analysis for Visual Question Answering Architectures

Camila Kolling, Jônatas Wehrmann, Rodrigo C. Barros

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Journal ref 2020 - The International Joint Conference on Neural Networks (IJCNN)

Applying recent advances in Visual Question Answering to Record Linkage

Marko Smilevski

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.AI、cs.LG

Comments 48 pages, 15 figures, 6 tables

Visual Question Answering as a Multi-Task Problem

Amelia Elizabeth Pollard, Jonathan L. Shapiro

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI

Scene Graph Reasoning for Visual Question Answering

Marcel Hildebrandt, Hang Li, Rajat Koner, Volker Tresp, Stephan Günnemann

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.LG

Comments ICML Workshop Graph Representation Learning and Beyond (GRL+)