视觉大模型 / VLM

Gemini Goes to Med School: Exploring the Capabilities of Multimodal Large Language Models on Medical Challenge Problems & Hallucinations

Ankit Pal, Malaikannan Sankarasubbu

专题命中 视觉问答 ：multimodal large language model(title)；visual question answering(abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Preprint version, Under Review

Semantic Scene Difference Detection in Daily Life Patroling by Mobile Robots using Pre-Trained Large-Scale Vision-Language Model

Yoshiki Obinata, Kento Kawaharazuka, Naoaki Kanazawa, Naoya Yamaguchi, Naoto Tsukamoto, Iori Yanokura, Shingo Kitagawa, Koki Shinjo, Kei Okada, Masayuki Inaba

专题命中 视觉问答 ：vision-language model(title,abstract)；visual question answering(abstract)

Comments Accepted to 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023)

Prompting Vision Language Model with Knowledge from Large Language Model for Knowledge-Based VQA

Yang Zhou, Pengfei Cao, Yubo Chen, Kang Liu, Jun Zhao

专题命中 视觉问答 ：vision language model(title,abstract)；visual question answering(abstract)

Answer Mining from a Pool of Images: Towards Retrieval-Based Visual Question Answering

Abhirama Subramanyam Penamakuri, Manish Gupta, Mithun Das Gupta, Anand Mishra

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted to IJCAI 2023

Visual Question Answering: A Survey on Techniques and Common Trends in Recent Literature

Ana Cláudia Akemi Matsuki de Faria, Felype de Castro Bastos, José Victor Nogueira Alves da Silva, Vitor Lopes Fabris, Valeska de Sousa Uchoa, Décio Gonçalves de Aguiar Neto, Claudio Filipi Goncalves dos Santos

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments 30 pages. arXiv admin note: text overlap with arXiv:2104.00926, arXiv:2110.02526, arXiv:2108.02059, arXiv:1908.01801 by other authors

Analysis of Visual Question Answering Algorithms with attention model

Param Ahir, Hiteishi M. Diwanji

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Journal ref GIT Journal of Engineering and Technology, 2020

Reassessing Evaluation Practices in Visual Question Answering: A Case Study on Out-of-Distribution Generalization

Aishwarya Agrawal, Ivana Kajić, Emanuele Bugliarello, Elnaz Davoodi, Anita Gergely, Phil Blunsom, Aida Nematzadeh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Findings of EACL 2023. Aishwarya, Ivana, Emanuele and Aida had equal first author contributions. Elnaz and Anita had equal contributions. Aida and Aishwarya had equal senior contributions

Generative Bias for Robust Visual Question Answering

Jae Won Cho, Dong-jin Kim, Hyeonggon Ryu, In So Kweon

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments CVPR 2023

Improving the Cross-Lingual Generalisation in Visual Question Answering

Farhad Nooralahzadeh, Rico Sennrich

专题命中 视觉问答 ：visual question answering(title,abstract)；vision-language model(abstract)

Comments This work is accepted by the AAAI 2023

Uncertainty-based Visual Question Answering: Estimating Semantic Inconsistency between Image and Knowledge Base

Jinyeong Chae, Jihie Kim

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted by the 2022 International Joint Conference on Neural Networks (IJCNN 2022)

Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformer

Lalithkumar Seenivasan, Mobarakol Islam, Adithya K Krishna, Hongliang Ren

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Code: https://github.com/lalithjets/Surgical_VQA.git

Hypergraph Transformer: Weakly-supervised Multi-hop Reasoning for Knowledge-based Visual Question Answering

Yu-Jung Heo, Eun-Sol Kim, Woo Suk Choi, Byoung-Tak Zhang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted at ACL 2022

Multi-Image Visual Question Answering

Harsh Raj, Janhavi Dadhania, Akhilesh Bhardwaj, Prabuchandran KJ

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?

Sedigheh Eslami, Gerard de Melo, Christoph Meinel

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Single-Modal Entropy based Active Learning for Visual Question Answering

Dong-Jin Kim, Jae Won Cho, Jinsoo Choi, Yunjae Jung, In So Kweon

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted to BMVC 2021

Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering

Siddharth Karamcheti, Ranjay Krishna, Li Fei-Fei, Christopher D. Manning

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted at ACL-IJCNLP 2021. 17 pages, 16 Figures

Inverse Visual Question Answering with Multi-Level Attentions

Yaser Alwattar, Yuhong Guo

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

LRTA: A Transparent Neural-Symbolic Reasoning Framework with Modular Supervision for Visual Question Answering

Weixin Liang, Feiyang Niu, Aishwarya Reganti, Govind Thattai, Gokhan Tur

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments NeurIPS KR2ML 2020

Mucko: Multi-Layer Cross-Modal Knowledge Reasoning for Fact-based Visual Question Answering

Zihao Zhu, Jing Yu, Yujing Wang, Yajing Sun, Yue Hu, Qi Wu

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Augmenting Visual Question Answering with Semantic Frame Information in a Multitask Learning Approach

Mehrdad Alizadeh, Barbara Di Eugenio

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments 14th IEEE International Conference on SEMANTIC COMPUTING, 8 Pages, February 2020, San Diego CA USA

Robust Explanations for Visual Question Answering

Badri N. Patro, Shivansh Pate, Vinay P. Namboodiri

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments WACV-2020 (Accepted)

Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering

Ramakrishna Vedantam, Karan Desai, Stefan Lee, Marcus Rohrbach, Dhruv Batra, Devi Parikh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments ICML 2019 Camera Ready + Appendix

The meaning of "most" for visual question answering models

Alexander Kuhnle, Ann Copestake

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

MUREL: Multimodal Relational Reasoning for Visual Question Answering

Remi Cadene, Hedi Ben-younes, Matthieu Cord, Nicolas Thome

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments CVPR2019 accepted paper

Learning Visual Question Answering by Bootstrapping Hard Attention

Mateusz Malinowski, Carl Doersch, Adam Santoro, Peter Battaglia

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments ECCV 2018

R-VQA: Learning Visual Relation Facts with Semantic Attention for Visual Question Answering

Pan Lu, Lei Ji, Wei Zhang, Nan Duan, Ming Zhou, Jianyong Wang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments 10 pages, 5 figures, accepted as an oral paper in SIGKDD 2018

Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets

Wei-Lun Chao, Hexiang Hu, Fei Sha

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments Accepted for Oral Presentation at NAACL-HLT 2018

High-Order Attention Models for Visual Question Answering

Idan Schwartz, Alexander G. Schwing, Tamir Hazan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

Comments 9 pages, 8 figures, NIPS 2017

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, Devi Parikh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG

C-VQA: A Compositional Split of the Visual Question Answering (VQA) v1.0 Dataset

Aishwarya Agrawal, Aniruddha Kembhavi, Dhruv Batra, Devi Parikh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV、cs.AI、cs.LG