视觉大模型 / VLM

Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoning

Ke Liang, Sihang Zhou, Yue Liu, Lingyuan Meng, Meng Liu, Xinwang Liu

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.AI

Comments This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessed

A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models

Alessandro Stolfo, Zhijing Jin, Kumar Shridhar, Bernhard Schölkopf, Mrinmaya Sachan

专题命中 视觉推理 ：grounding(abstract)；分类 cs.LG

Comments ACL 2023. A shorter version of the paper was accepted at the MATH-AI Workshop at NeurIPS 2022. 15 pages, 8 figures

Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL Models

Sivan Doveh, Assaf Arbelle, Sivan Harary, Roei Herzig, Donghyun Kim, Paola Cascante-bonilla, Amit Alfassy, Rameswar Panda, Raja Giryes, Rogerio Feris, Shimon Ullman, Leonid Karlinsky

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Learning to Collocate Visual-Linguistic Neural Modules for Image Captioning

Xu Yang, Hanwang Zhang, Chongyang Gao, Jianfei Cai

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Accepted to IJCV. Codes are available at https://github.com/GCYZSL/CVLMN

Navigating to Objects Specified by Images

Jacob Krantz, Theophile Gervet, Karmesh Yadav, Austin Wang, Chris Paxton, Roozbeh Mottaghi, Dhruv Batra, Jitendra Malik, Stefan Lee, Devendra Singh Chaplot

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Divide and Conquer: Answering Questions with Object Factorization and Compositional Reasoning

Shi Chen, Qi Zhao

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments To appear in CVPR 2023

Implicit Temporal Reasoning for Evidence-Based Fact-Checking

Liesbeth Allein, Marlon Saelens, Ruben Cartuyvels, Marie-Francine Moens

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Comments The 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2023, Findings)

Learning to Agree on Vision Attention for Visual Commonsense Reasoning

Zhenyang Li, Yangyang Guo, Kejie Wang, Fan Liu, Liqiang Nie, Mohan Kankanhalli

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Neuro-Symbolic Spatio-Temporal Reasoning

Jae Hee Lee, Michael Sioutis, Kyra Ahrens, Marjan Alirezaie, Matthias Kerzel, Stefan Wermter

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.AI

Comments Contribution to the book "A Compendium of Neuro-Symbolic Artificial Intelligence", which is to appear in the first half of 2023

TRAC: A Textual Benchmark for Reasoning about Actions and Change

Weinan He, Canming Huang, Zhanhao Xiao, Yongmei Liu

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

One for All: One-stage Referring Expression Comprehension with Dynamic Reasoning

Zhipeng Zhang, Zhimin Wei, Zhongzhen Huang, Rui Niu, Peng Wang

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments 27 pages, 6 figures

Swift Markov Logic for Probabilistic Reasoning on Knowledge Graphs

Luigi Bellomarini, Eleonora Laurenza, Emanuel Sallinger, Evgeny Sherkhonov

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Comments Under consideration in Theory and Practice of Logic Programming (TPLP)

Integrating Object-aware and Interaction-aware Knowledge for Weakly Supervised Scene Graph Generation

Xingchen Li, Long Chen, Wenbo Ma, Yi Yang, Jun Xiao

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

The Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoning

Jack Hessel, Jena D. Hwang, Jae Sung Park, Rowan Zellers, Chandra Bhagavatula, Anna Rohrbach, Kate Saenko, Yejin Choi

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments code, data, models at http://visualabduction.com/

Journal ref ECCV 2022

A Distance-preserving Matrix Sketch

Leland Wilkinson, Hengrui Luo

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.LG

Comments 38 pages, 13 figures

Journal ref Journal of Computational and Graphical Statistics, 2022

Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships

Chao Lou, Wenjuan Han, Yuhuan Lin, Zilong Zheng

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments Updated

Introduction to Soar

John E. Laird

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments 29 pages

Attention in Reasoning: Dataset, Analysis, and Modeling

Shi Chen, Ming Jiang, Jinhui Yang, Qi Zhao

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments To be published in TPAMI. arXiv admin note: substantial text overlap with arXiv:2007.14419

A Comprehensive Survey of Scene Graphs: Generation and Application

Xiaojun Chang, Pengzhen Ren, Pengfei Xu, Zhihui Li, Xiaojiang Chen, Alex Hauptmann

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments 25 pages

Journal ref IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021

Data augmentation by morphological mixup for solving Raven's Progressive Matrices

Wentao He, Jianfeng Ren, Ruibin Bai

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Under review

Calibrating Concepts and Operations: Towards Symbolic Reasoning on Real Images

Zhuowan Li, Elias Stengel-Eskin, Yixiao Zhang, Cihang Xie, Quan Tran, Benjamin Van Durme, Alan Yuille

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments To appear in ICCV2021; Code at https://github.com/Lizw14/CaliCO.git

Understanding and Evaluating Racial Biases in Image Captioning

Dora Zhao, Angelina Wang, Olga Russakovsky

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments ICCV 2021

SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environments

Muhammad Zubair Irshad, Niluthpol Chowdhury Mithun, Zachary Seymour, Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments 10 pages, 4 figures

Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Models

Zheyuan Liu, Cristian Rodriguez-Opazo, Damien Teney, Stephen Gould

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments ICCV 2021. Dataset, code, and pre-trained models are released at https://cuberick-orion.github.io/CIRR/

AGQA: A Benchmark for Compositional Spatio-Temporal Reasoning

Madeleine Grunde-McLaughlin, Ranjay Krishna, Maneesh Agrawala

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments 8 pages, 15 pages supplementary, 12 figures. To be published in CVPR 2021

Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA

Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted to NAACL 2021

Odd-One-Out Representation Learning

Salman Mohammadi, Anders Kirk Uhrenholt, Bjørn Sand Jensen

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.LG

Knowledge-Routed Visual Question Reasoning: Challenges for Deep Representation Embedding

Qingxing Cao, Bailin Li, Xiaodan Liang, Keze Wang, Liang Lin

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments To appear in TNNLS 2021. Considering that a desirable VQA model should correctly perceive the image context, understand the question, and incorporate its learned knowledge, our proposed dataset aims to cutoff the shortcut learning exploited by the current deep embedding models and push the research boundary of the knowledge-based visual question reasoning

Assisting Scene Graph Generation with Self-Supervision

Sandeep Inuganti, Vineeth N Balasubramanian

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

TextCaps: a Dataset for Image Captioning with Reading Comprehension

Oleksii Sidorov, Ronghang Hu, Marcus Rohrbach, Amanpreet Singh

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments To appear in ECCV 2020 (oral) Project page: https://textvqa.org/textcaps