视觉大模型 / VLM

Visual Entailment Task for Visually-Grounded Language Learning

Ning Xie, Farley Lai, Derek Doran, Asim Kadav

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments 4 pages, accepted by Visually Grounded Interaction and Language (ViGIL) workshop in NeurIPS 2018

A Novel Framework for Robustness Analysis of Visual QA Models

Jia-Hong Huang, Cuong Duc Dao, Modar Alfadly, Bernard Ghanem

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted by the Thirty-Third AAAI Conference on Artificial Intelligence, (AAAI-19), as an oral paper

From Known to the Unknown: Transferring Knowledge to Answer Questions about Novel Visual and Semantic Concepts

Moshiur R Farazi, Salman H Khan, Nick Barnes

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Large Scale Scene Text Verification with Guided Attention

Dafang He, Yeqing Li, Alexander Gorban, Derrall Heath, Julian Ibarz, Qian Yu, Daniel Kifer, C. Lee Giles

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments 18 pages, ACCV 2019

Zero-Shot Transfer VQA Dataset

Yuanpeng Li, Yi Yang, Jianyu Wang, Wei Xu

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

TallyQA: Answering Complex Counting Questions

Manoj Acharya, Kushal Kafle, Christopher Kanan

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments To appear in AAAI 2019 ( To download the dataset please go to http://www.manojacharya.com/ )

VQA-E: Explaining, Elaborating, and Enhancing Your Answers for Visual Questions

Qing Li, Qingyi Tao, Shafiq Joty, Jianfei Cai, Jiebo Luo

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments ECCV 2018 Camera ready

End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features

Chiori Hori, Huda Alamri, Jue Wang, Gordon Wichern, Takaaki Hori, Anoop Cherian, Tim K. Marks, Vincent Cartillier, Raphael Gontijo Lopes, Abhishek Das, Irfan Essa, Dhruv Batra, Devi Parikh

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments A prototype system for the Audio Visual Scene-aware Dialog (AVSD) at DSTC7

Robustness Analysis of Visual QA Models by Basic Questions

Jia-Hong Huang, Cuong Duc Dao, Modar Alfadly, C. Huck Yang, Bernard Ghanem

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted by CVPR 2018 VQA Challenge and Visual Dialog Workshop. (Acknowledgement updating)

VizWiz Grand Challenge: Answering Visual Questions from Blind People

Danna Gurari, Qing Li, Abigale J. Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, Jeffrey P. Bigham

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Did the Model Understand the Question?

Pramod Kaushik Mudrakarta, Ankur Taly, Mukund Sundararajan, Kedar Dhamdhere

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

Comments ACL 2018 long paper

Visual Question Reasoning on General Dependency Tree

Qingxing Cao, Xiaodan Liang, Bailing Li, Guanbin Li, Liang Lin

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted as spotlight at CVPR 2018

Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering

Unnat Jain, Svetlana Lazebnik, Alexander Schwing

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted to CVPR 2018

DVQA: Understanding Data Visualizations via Question Answering

Kushal Kafle, Brian Price, Scott Cohen, Christopher Kanan

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments CVPR 2018 Camera Ready Version

Object-based reasoning in VQA

Mikyas T. Desta, Larry Chen, Tomasz Kornuta

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments 10 pages, 15 figures, published as a conference paper at 2018 IEEE Winter Conf. on Applications of Computer Vision (WACV'2018)

Incorporating External Knowledge to Answer Open-Domain Visual Questions with Dynamic Memory Networks

Guohao Li, Hang Su, Wenwu Zhu

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Hyper-dimensional computing for a visual question-answering system that is trainable end-to-end

Guglielmo Montone, J. Kevin O'Regan, Alexander V. Terekhov

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.AI

Locally Smoothed Neural Networks

Liang Pang, Yanyan Lan, Jun Xu, Jiafeng Guo, Xueqi Cheng

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.LG

Comments In Proceedings of 9th Asian Conference on Machine Learning (ACML2017)

Learning to Disambiguate by Asking Discriminative Questions

Yining Li, Chen Huang, Xiaoou Tang, Chen-Change Loy

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments 14 pages, 12 figures, ICCV2017

Effective Approaches to Batch Parallelization for Dynamic Neural Network Architectures

Joseph Suarez, Clare Zhu

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Code at https://github.com/jsuarez5341/Efficient-Dynamic-Batching

Counting Everyday Objects in Everyday Scenes

Prithvijit Chattopadhyay, Ramakrishna Vedantam, Ramprasaath R. Selvaraju, Dhruv Batra, Devi Parikh

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

The Forgettable-Watcher Model for Video Question Answering

Hongyang Xue, Zhou Zhao, Deng Cai

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

What's in a Question: Using Visual Questions as a Form of Supervision

Siddha Ganju, Olga Russakovsky, Abhinav Gupta

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments CVPR 2017 Spotlight paper and supplementary

Dual Attention Networks for Multimodal Reasoning and Matching

Hyeonseob Nam, Jung-Woo Ha, Jeonghee Kim

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

The VQA-Machine: Learning How to Use Existing Vision Algorithms to Answer New Questions

Peng Wang, Qi Wu, Chunhua Shen, Anton van den Hengel

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Open-Ended Visual Question-Answering

Issey Masuda, Santiago Pascual de la Puente, Xavier Giro-i-Nieto

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments Bachelor thesis report graded with A with honours at ETSETB Telecom BCN school, Universitat Politècnica de Catalunya (UPC). June 2016. Source code and models are publicly available at http://imatge-upc.github.io/vqa-2016-cvprw/

Training Recurrent Answering Units with Joint Loss Minimization for VQA

Hyeonwoo Noh, Bohyung Han

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Solving Visual Madlibs with Multiple Cues

Tatiana Tommasi, Arun Mallya, Bryan Plummer, Svetlana Lazebnik, Alexander C. Berg, Tamara L. Berg

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

Comments accepted at BMVC 2016

Learning Models for Actions and Person-Object Interactions with Transfer to Question Answering

Arun Mallya, Svetlana Lazebnik

专题命中 视觉问答 ：visual question answering(abstract)；分类 cs.CV

A Hybrid Approach to Query Answering under Expressive Datalog+/-

Mostafa Milani, Andrea Cali, Leopoldo Bertossi

专题命中 视觉问答 ：grounding(abstract)；分类 cs.AI

Comments Extended version of RR'16 paper, to appear