视觉大模型 / VLM

Cognitive Visual Commonsense Reasoning Using Dynamic Working Memory

Xuejiao Tang, Xin Huang, Wenbin Zhang, Travers B. Child, Qiong Hu, Zhen Liu, Ji Zhang

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments DaWaK 2021

InfiMM-Eval: Complex Open-Ended Reasoning Evaluation For Multi-Modal Large Language Models

Xiaotian Han, Quanzeng You, Yongfei Liu, Wentao Chen, Huangjie Zheng, Khalil Mrini, Xudong Lin, Yiqi Wang, Bohan Zhai, Jianbo Yuan, Heng Wang, Hongxia Yang

专题命中 视觉推理 ：MLLM(abstract)；分类 cs.CV

LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning

Sijin Chen, Xin Chen, Chi Zhang, Mingsheng Li, Gang Yu, Hao Fei, Hongyuan Zhu, Jiayuan Fan, Tao Chen

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments Project Page: https://ll3da.github.io/

COLA: A Benchmark for Compositional Text-to-image Retrieval

Arijit Ray, Filip Radenovic, Abhimanyu Dubey, Bryan A. Plummer, Ranjay Krishna, Kate Saenko

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2023. Webpage: https://cs-people.bu.edu/array/research/cola/

Weakly Supervised Semantic Parsing with Execution-based Spurious Program Filtering

Kang-il Lee, Segwang Kim, Kyomin Jung

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments EMNLP 2023

Enhancing the Spatial Awareness Capability of Multi-Modal Large Language Model

Yongqiang Zhao, Zhenyu Li, Zhi Jin, Feng Zhang, Haiyan Zhao, Chengfeng Dou, Zhengwei Tao, Xinhai Xu, Donghong Liu

专题命中 视觉推理 ：MLLM(abstract)；分类 cs.AI

Learning to reason over visual objects

Shanka Subhra Mondal, Taylor Webb, Jonathan D. Cohen

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments ICLR 2023

Lang3DSG: Language-based contrastive pre-training for 3D Scene Graph prediction

Sebastian Koch, Pedro Hermosilla, Narunas Vaskevicius, Mirco Colosi, Timo Ropinski

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments 3DV 2024. Project page: https://kochsebastian.com/lang3dsg

Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality

Harman Singh, Pengchuan Zhang, Qifan Wang, Mengjiao Wang, Wenhan Xiong, Jingfei Du, Yu Chen

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments EMNLP 2023 (long paper, main conference)

SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables

Xinyuan Lu, Liangming Pan, Qian Liu, Preslav Nakov, Min-Yen Kan

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Comments Accepted at EMNLP 2023 (main conference, long paper)

Interpreting and Controlling Vision Foundation Models via Text Explanations

Haozhe Chen, Junfeng Yang, Carl Vondrick, Chengzhi Mao

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning

Qiao Gu, Alihusein Kuwajerwala, Sacha Morin, Krishna Murthy Jatavallabhula, Bipasha Sen, Aditya Agarwal, Corban Rivera, William Paul, Kirsty Ellis, Rama Chellappa, Chuang Gan, Celso Miguel de Melo, Joshua B. Tenenbaum, Antonio Torralba, Florian Shkurti, Liam Paull

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments Project page: https://concept-graphs.github.io/ Explainer video: https://youtu.be/mRhNkQwRYnc

Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problems

Fan Shi, Bin Li, Xiangyang Xue

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Structure Guided Multi-modal Pre-trained Transformer for Knowledge Graph Reasoning

Ke Liang, Sihang Zhou, Yue Liu, Lingyuan Meng, Meng Liu, Xinwang Liu

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.AI

Comments This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessed

A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models

Alessandro Stolfo, Zhijing Jin, Kumar Shridhar, Bernhard Schölkopf, Mrinmaya Sachan

专题命中 视觉推理 ：grounding(abstract)；分类 cs.LG

Comments ACL 2023. A shorter version of the paper was accepted at the MATH-AI Workshop at NeurIPS 2022. 15 pages, 8 figures

Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL Models

Sivan Doveh, Assaf Arbelle, Sivan Harary, Roei Herzig, Donghyun Kim, Paola Cascante-bonilla, Amit Alfassy, Rameswar Panda, Raja Giryes, Rogerio Feris, Shimon Ullman, Leonid Karlinsky

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Learning to Collocate Visual-Linguistic Neural Modules for Image Captioning

Xu Yang, Hanwang Zhang, Chongyang Gao, Jianfei Cai

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments Accepted to IJCV. Codes are available at https://github.com/GCYZSL/CVLMN

Navigating to Objects Specified by Images

Jacob Krantz, Theophile Gervet, Karmesh Yadav, Austin Wang, Chris Paxton, Roozbeh Mottaghi, Dhruv Batra, Jitendra Malik, Stefan Lee, Devendra Singh Chaplot

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Divide and Conquer: Answering Questions with Object Factorization and Compositional Reasoning

Shi Chen, Qi Zhao

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments To appear in CVPR 2023

Implicit Temporal Reasoning for Evidence-Based Fact-Checking

Liesbeth Allein, Marlon Saelens, Ruben Cartuyvels, Marie-Francine Moens

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Comments The 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2023, Findings)

Learning to Agree on Vision Attention for Visual Commonsense Reasoning

Zhenyang Li, Yangyang Guo, Kejie Wang, Fan Liu, Liqiang Nie, Mohan Kankanhalli

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Neuro-Symbolic Spatio-Temporal Reasoning

Jae Hee Lee, Michael Sioutis, Kyra Ahrens, Marjan Alirezaie, Matthias Kerzel, Stefan Wermter

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.AI

Comments Contribution to the book "A Compendium of Neuro-Symbolic Artificial Intelligence", which is to appear in the first half of 2023

TRAC: A Textual Benchmark for Reasoning about Actions and Change

Weinan He, Canming Huang, Zhanhao Xiao, Yongmei Liu

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

One for All: One-stage Referring Expression Comprehension with Dynamic Reasoning

Zhipeng Zhang, Zhimin Wei, Zhongzhen Huang, Rui Niu, Peng Wang

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments 27 pages, 6 figures

Swift Markov Logic for Probabilistic Reasoning on Knowledge Graphs

Luigi Bellomarini, Eleonora Laurenza, Emanuel Sallinger, Evgeny Sherkhonov

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Comments Under consideration in Theory and Practice of Logic Programming (TPLP)

Integrating Object-aware and Interaction-aware Knowledge for Weakly Supervised Scene Graph Generation

Xingchen Li, Long Chen, Wenbo Ma, Yi Yang, Jun Xiao

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

The Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoning

Jack Hessel, Jena D. Hwang, Jae Sung Park, Rowan Zellers, Chandra Bhagavatula, Anna Rohrbach, Kate Saenko, Yejin Choi

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments code, data, models at http://visualabduction.com/

Journal ref ECCV 2022

A Distance-preserving Matrix Sketch

Leland Wilkinson, Hengrui Luo

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.LG

Comments 38 pages, 13 figures

Journal ref Journal of Computational and Graphical Statistics, 2022

Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships

Chao Lou, Wenjuan Han, Yuhuan Lin, Zilong Zheng

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments Updated

Introduction to Soar

John E. Laird

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments 29 pages