视觉大模型 / VLM

Attention in Reasoning: Dataset, Analysis, and Modeling

Shi Chen, Ming Jiang, Jinhui Yang, Qi Zhao

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments To be published in TPAMI. arXiv admin note: substantial text overlap with arXiv:2007.14419

A Comprehensive Survey of Scene Graphs: Generation and Application

Xiaojun Chang, Pengzhen Ren, Pengfei Xu, Zhihui Li, Xiaojiang Chen, Alex Hauptmann

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments 25 pages

Journal ref IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021

Data augmentation by morphological mixup for solving Raven's Progressive Matrices

Wentao He, Jianfeng Ren, Ruibin Bai

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Under review

Calibrating Concepts and Operations: Towards Symbolic Reasoning on Real Images

Zhuowan Li, Elias Stengel-Eskin, Yixiao Zhang, Cihang Xie, Quan Tran, Benjamin Van Durme, Alan Yuille

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments To appear in ICCV2021; Code at https://github.com/Lizw14/CaliCO.git

Understanding and Evaluating Racial Biases in Image Captioning

Dora Zhao, Angelina Wang, Olga Russakovsky

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments ICCV 2021

SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environments

Muhammad Zubair Irshad, Niluthpol Chowdhury Mithun, Zachary Seymour, Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments 10 pages, 4 figures

Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Models

Zheyuan Liu, Cristian Rodriguez-Opazo, Damien Teney, Stephen Gould

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments ICCV 2021. Dataset, code, and pre-trained models are released at https://cuberick-orion.github.io/CIRR/

AGQA: A Benchmark for Compositional Spatio-Temporal Reasoning

Madeleine Grunde-McLaughlin, Ranjay Krishna, Maneesh Agrawala

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments 8 pages, 15 pages supplementary, 12 figures. To be published in CVPR 2021

Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA

Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted to NAACL 2021

Odd-One-Out Representation Learning

Salman Mohammadi, Anders Kirk Uhrenholt, Bjørn Sand Jensen

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.LG

Knowledge-Routed Visual Question Reasoning: Challenges for Deep Representation Embedding

Qingxing Cao, Bailin Li, Xiaodan Liang, Keze Wang, Liang Lin

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments To appear in TNNLS 2021. Considering that a desirable VQA model should correctly perceive the image context, understand the question, and incorporate its learned knowledge, our proposed dataset aims to cutoff the shortcut learning exploited by the current deep embedding models and push the research boundary of the knowledge-based visual question reasoning

Assisting Scene Graph Generation with Self-Supervision

Sandeep Inuganti, Vineeth N Balasubramanian

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

TextCaps: a Dataset for Image Captioning with Reading Comprehension

Oleksii Sidorov, Ronghang Hu, Marcus Rohrbach, Amanpreet Singh

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments To appear in ECCV 2020 (oral) Project page: https://textvqa.org/textcaps

VisualCOMET: Reasoning about the Dynamic Context of a Still Image

Jae Sung Park, Chandra Bhagavatula, Roozbeh Mottaghi, Ali Farhadi, Yejin Choi

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments Project Page: http://visualcomet.xyz (ECCV 2020 Spotlight)

Comprehensive Image Captioning via Scene Graph Decomposition

Yiwu Zhong, Liwei Wang, Jianshu Chen, Dong Yu, Yin Li

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments Accepted to ECCV 2020

Abstract Diagrammatic Reasoning with Multiplex Graph Networks

Duo Wang, Mateja Jamnik, Pietro Lio

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.LG

On the Possibilities and Limitations of Multi-hop Reasoning Under Linguistic Imperfections

Daniel Khashabi, Erfan Sadeqi Azer, Tushar Khot, Ashish Sabharwal, Dan Roth

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning

Wenhe Zhang, Chi Zhang, Yixin Zhu, Song-Chun Zhu

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments AAAI 2020 Oral. Project page: https://sites.google.com/view/number-sense/home Code: https://github.com/zwh1999anne/Machine-Number-Sense-Dataset Dataset: https://drive.google.com/file/d/17KuL8KOIDAeRL-lD418oiDEm8bE6TEFb/view

Weakly Supervised Visual Semantic Parsing

Alireza Zareian, Svebor Karaman, Shih-Fu Chang

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments To be presented at CVPR 2020 (oral paper)

Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks

Fengda Zhu, Yi Zhu, Xiaojun Chang, Xiaodan Liang

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Linguistically Driven Graph Capsule Network for Visual Question Reasoning

Qingxing Cao, Xiaodan Liang, Keze Wang, Liang Lin

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments Submitted to TPAMI 2020. We have achieved an end-to-end interpretable structural reasoning for general images without the requirement of layout annotations

Differentiable Scene Graphs

Moshiko Raboh, Roei Herzig, Gal Chechik, Jonathan Berant, Amir Globerson

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Winter Conference on Applications of Computer Vision (WACV), 2020

Smart Home Appliances: Chat with Your Fridge

Denis Gudovskiy, Gyuri Han, Takuya Yamaguchi, Sotaro Tsukizawa

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments NeurIPS 2019 demo track

Explainable High-order Visual Question Reasoning: A New Benchmark and Knowledge-routed Network

Qingxing Cao, Bailin Li, Xiaodan Liang, Liang Lin

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Triplet-Aware Scene Graph Embeddings

Brigit Schroeder, Subarna Tripathi, Hanlin Tang

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted to Scene Graph Representation Learning workshop at ICCV 2019

Procedural Reasoning Networks for Understanding Multimodal Procedures

Mustafa Sercan Amac, Semih Yagcioglu, Aykut Erdem, Erkut Erdem

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Accepted to CoNLL 2019. The project website with code and demo is available at https://hucvl.github.io/prn/

A Corpus for Reasoning About Natural Language Grounded in Photographs

Alane Suhr, Stephanie Zhou, Ally Zhang, Iris Zhang, Huajun Bai, Yoav Artzi

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments ACL 2019 Long Paper

Learning to Collocate Neural Modules for Image Captioning

Xu Yang, Hanwang Zhang, Jianfei Cai

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

From Recognition to Cognition: Visual Commonsense Reasoning

Rowan Zellers, Yonatan Bisk, Ali Farhadi, Yejin Choi

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments CVPR 2019 oral. Project page at https://visualcommonsense.com

Can We Automate Diagrammatic Reasoning?

Sk. Arif Ahmed, Debi Prosad Dogra, Samarjit Kar, Partha Pratim Roy, Dilip K. Prasad

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV