视觉大模型 / VLM

VisualCOMET: Reasoning about the Dynamic Context of a Still Image

Jae Sung Park, Chandra Bhagavatula, Roozbeh Mottaghi, Ali Farhadi, Yejin Choi

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments Project Page: http://visualcomet.xyz (ECCV 2020 Spotlight)

Comprehensive Image Captioning via Scene Graph Decomposition

Yiwu Zhong, Liwei Wang, Jianshu Chen, Dong Yu, Yin Li

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments Accepted to ECCV 2020

Abstract Diagrammatic Reasoning with Multiplex Graph Networks

Duo Wang, Mateja Jamnik, Pietro Lio

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.LG

On the Possibilities and Limitations of Multi-hop Reasoning Under Linguistic Imperfections

Daniel Khashabi, Erfan Sadeqi Azer, Tushar Khot, Ashish Sabharwal, Dan Roth

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning

Wenhe Zhang, Chi Zhang, Yixin Zhu, Song-Chun Zhu

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments AAAI 2020 Oral. Project page: https://sites.google.com/view/number-sense/home Code: https://github.com/zwh1999anne/Machine-Number-Sense-Dataset Dataset: https://drive.google.com/file/d/17KuL8KOIDAeRL-lD418oiDEm8bE6TEFb/view

Weakly Supervised Visual Semantic Parsing

Alireza Zareian, Svebor Karaman, Shih-Fu Chang

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments To be presented at CVPR 2020 (oral paper)

Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks

Fengda Zhu, Yi Zhu, Xiaojun Chang, Xiaodan Liang

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Linguistically Driven Graph Capsule Network for Visual Question Reasoning

Qingxing Cao, Xiaodan Liang, Keze Wang, Liang Lin

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments Submitted to TPAMI 2020. We have achieved an end-to-end interpretable structural reasoning for general images without the requirement of layout annotations

Differentiable Scene Graphs

Moshiko Raboh, Roei Herzig, Gal Chechik, Jonathan Berant, Amir Globerson

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Winter Conference on Applications of Computer Vision (WACV), 2020

Smart Home Appliances: Chat with Your Fridge

Denis Gudovskiy, Gyuri Han, Takuya Yamaguchi, Sotaro Tsukizawa

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments NeurIPS 2019 demo track

Explainable High-order Visual Question Reasoning: A New Benchmark and Knowledge-routed Network

Qingxing Cao, Bailin Li, Xiaodan Liang, Liang Lin

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Triplet-Aware Scene Graph Embeddings

Brigit Schroeder, Subarna Tripathi, Hanlin Tang

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted to Scene Graph Representation Learning workshop at ICCV 2019

Procedural Reasoning Networks for Understanding Multimodal Procedures

Mustafa Sercan Amac, Semih Yagcioglu, Aykut Erdem, Erkut Erdem

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Accepted to CoNLL 2019. The project website with code and demo is available at https://hucvl.github.io/prn/

A Corpus for Reasoning About Natural Language Grounded in Photographs

Alane Suhr, Stephanie Zhou, Ally Zhang, Iris Zhang, Huajun Bai, Yoav Artzi

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments ACL 2019 Long Paper

Learning to Collocate Neural Modules for Image Captioning

Xu Yang, Hanwang Zhang, Jianfei Cai

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

From Recognition to Cognition: Visual Commonsense Reasoning

Rowan Zellers, Yonatan Bisk, Ali Farhadi, Yejin Choi

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments CVPR 2019 oral. Project page at https://visualcommonsense.com

Can We Automate Diagrammatic Reasoning?

Sk. Arif Ahmed, Debi Prosad Dogra, Samarjit Kar, Partha Pratim Roy, Dilip K. Prasad

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Learning to Compose Dynamic Tree Structures for Visual Contexts

Kaihua Tang, Hanwang Zhang, Baoyuan Wu, Wenhan Luo, Wei Liu

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

CLEAR: A Dataset for Compositional Language and Elementary Acoustic Reasoning

Jerome Abdelnour, Giampiero Salvi, Jean Rouat

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.LG

Comments NeurIPS 2018 Visually Grounded Interaction and Language (ViGIL) Workshop

Complete 3D Scene Parsing from an RGBD Image

Chuhang Zou, Ruiqi Guo, Zhizhong Li, Derek Hoiem

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Accepted to International Journal of Computer Vision (IJCV), 2018 arXiv admin note: text overlap with arXiv:1504.02437

Modularity Matters: Learning Invariant Relational Reasoning Tasks

Jason Jo, Vikas Verma, Yoshua Bengio

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.LG

Comments Modified abstract to fit arXiv character limit

Learning to Act Properly: Predicting and Explaining Affordances from Images

Ching-Yao Chuang, Jiaman Li, Antonio Torralba, Sanja Fidler

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Multi-Label Zero-Shot Learning with Structured Knowledge Graphs

Chung-Wei Lee, Wei Fang, Chih-Kuan Yeh, Yu-Chiang Frank Wang

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments CVPR 2018

Compositional Attention Networks for Machine Reasoning

Drew A. Hudson, Christopher D. Manning

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments Published as a conference paper at ICLR 2018

DDRprog: A CLEVR Differentiable Dynamic Reasoning Programmer

Joseph Suarez, Justin Johnson, Fei-Fei Li

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Generating Triples with Adversarial Networks for Scene Graph Construction

Matthew Klawonn, Eric Heim

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted to AAAI 2018

Benchmark Visual Question Answer Models by using Focus Map

Wenda Qiu, Yueyang Xianzang, Zhekai Zhang

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments A group project paper for course CS348. arXiv admin note: text overlap with arXiv:1705.03633 by other authors

End-to-End Learning of Semantic Grasping

Eric Jang, Sudheendra Vijayanarasimhan, Peter Pastor, Julian Ibarz, Sergey Levine

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.LG

Comments 14 pages

Predicting Complete 3D Models of Indoor Scenes

Ruiqi Guo, Chuhang Zou, Derek Hoiem

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

A simple neural network module for relational reasoning

Adam Santoro, David Raposo, David G. T. Barrett, Mateusz Malinowski, Razvan Pascanu, Peter Battaglia, Timothy Lillicrap

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.LG