视觉大模型 / VLM

Dynamic Fusion with Intra- and Inter- Modality Attention Flow for Visual Question Answering

Gao Peng, Zhengkai Jiang, Haoxuan You, Pan Lu, Steven Hoi, Xiaogang Wang, Hongsheng Li

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments CVPR 2019 ORAL

Multi-modality Latent Interaction Network for Visual Question Answering

Peng Gao, Haoxuan You, Zhanpeng Zhang, Xiaogang Wang, Hongsheng Li

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

An Empirical Study on Leveraging Scene Graphs for Visual Question Answering

Cheng Zhang, Wei-Lun Chao, Dong Xuan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted as oral presentation at BMVC 2019

ICDAR 2019 Competition on Scene Text Visual Question Answering

Ali Furkan Biten, Rubèn Tito, Andres Mafla, Lluis Gomez, Marçal Rusiñol, Minesh Mathew, C. V. Jawahar, Ernest Valveny, Dimosthenis Karatzas

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 15th International Conference on Document Analysis and Recognition (ICDAR 2019)

Deep Modular Co-Attention Networks for Visual Question Answering

Zhou Yu, Jun Yu, Yuhao Cui, Dacheng Tao, Qi Tian

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2019

Faithful Multimodal Explanation for Visual Question Answering

Jialin Wu, Raymond J. Mooney

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments In ACL 2019 BlackboxNLP workshop

Focal Visual-Text Attention for Visual Question Answering

Junwei Liang, Lu Jiang, Liangliang Cao, Li-Jia Li, Alexander Hauptmann

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments In CVPR 2018. Code, models and dataset are available here: https://memexqa.cs.cmu.edu/

Beyond Bilinear: Generalized Multimodal Factorized High-order Pooling for Visual Question Answering

Zhou Yu, Jun Yu, Chenchao Xiang, Jianping Fan, Dacheng Tao

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 13 pages, 9 figures. arXiv admin note: substantial text overlap with arXiv:1708.01471

Journal ref IEEE Transactions On Neural Networks And Learning Systems, Vol. 26, No. 10, October 2015, Pp. 2275-2290

Quantifying and Alleviating the Language Prior Problem in Visual Question Answering

Yangyang Guo, Zhiyong Cheng, Liqiang Nie, Yibing Liu, Yinglong Wang, Mohan Kankanhalli

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Answer Them All! Toward Universal Visual Question Answering Models

Robik Shrestha, Kushal Kafle, Christopher Kanan

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 8 pages

Generating Natural Language Explanations for Visual Question Answering using Scene Graphs and Visual Attention

Shalini Ghosh, Giedrius Burachas, Arijit Ray, Avi Ziskind

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.AI

Cycle-Consistency for Robust Visual Question Answering

Meet Shah, Xinlei Chen, Marcus Rohrbach, Devi Parikh

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Technical Report

BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection

Hedi Ben-younes, Rémi Cadene, Nicolas Thome, Matthieu Cord

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Improved Fusion of Visual and Language Representations by Dense Symmetric Co-Attention for Visual Question Answering

Duy-Kien Nguyen, Takayuki Okatani

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments In Proceeding of CVPR'2018

Visual Question Answering as Reading Comprehension

Hui Li, Peng Wang, Chunhua Shen, Anton van den Hengel

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Explicit Bias Discovery in Visual Question Answering Models

Varun Manjunatha, Nirat Saini, Larry S. Davis

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering

Medhini Narasimhan, Svetlana Lazebnik, Alexander G. Schwing

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted to NIPS 2018

Learning Conditioned Graph Structures for Interpretable Visual Question Answering

Will Norcliffe-Brown, Efstathios Vafeias, Sarah Parisot

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments NIPS 2018 (13 pages, 7 figures)

Knowing Where to Look? Analysis on Attention of Visual Question Answering System

Wei Li, Zehuan Yuan, Xiangzhong Fang, Changhu Wang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments ECCV SiVL Workshop paper

Textually Enriched Neural Module Networks for Visual Question Answering

Khyathi Raghavi Chandu, Mary Arpita Pyreddy, Matthieu Felix, Narendra Nath Joshi

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Learning Convolutional Text Representations for Visual Question Answering

Zhengyang Wang, Shuiwang Ji

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.LG

Comments Conference paper at SDM 2018. https://github.com/divelab/svae

Journal ref In proceedings of the 2018 SIAM International Conference on Data Mining (pp. 594-602). 2018

On the Flip Side: Identifying Counterexamples in Visual Question Answering

Gabriel Grand, Aron Szanto, Yoon Kim, Alexander Rush

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments KDD 2018 conference version

Question Relevance in Visual Question Answering

Prakruthi Prabhakar, Nitish Kulkarni, Linghao Zhang

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Question Type Guided Attention in Visual Question Answering

Yang Shi, Tommaso Furlanello, Sheng Zha, Animashree Anandkumar

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Learning Visual Knowledge Memory Networks for Visual Question Answering

Zhou Su, Chen Zhu, Yinpeng Dong, Dongqi Cai, Yurong Chen, Jianguo Li

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Supplementary to CVPR 2018 version

Cross-Dataset Adaptation for Visual Question Answering

Wei-Lun Chao, Hexiang Hu, Fei Sha

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2018

Learning Answer Embeddings for Visual Question Answering

Hexiang Hu, Wei-Lun Chao, Fei Sha

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments Accepted at CVPR 2018

Visual Question Answering with Memory-Augmented Networks

Chao Ma, Chunhua Shen, Anthony Dick, Qi Wu, Peng Wang, Anton van den Hengel, Ian Reid

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments CVPR 2018

Explicit Reasoning over End-to-End Neural Architectures for Visual Question Answering

Somak Aditya, Yezhou Yang, Chitta Baral

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments 9 pages, 3 figures, AAAI 2018

Inverse Visual Question Answering: A New Benchmark and VQA Diagnosis Tool

Feng Liu, Tao Xiang, Timothy M. Hospedales, Wankou Yang, Changyin Sun

专题命中 视觉问答 ：visual question answering(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:1710.03370