视觉大模型 / VLM

Generating Human Motion in 3D Scenes from Text Descriptions

Zhi Cen, Huaijin Pi, Sida Peng, Zehong Shen, Minghui Yang, Shuai Zhu, Hujun Bao, Xiaowei Zhou

专题命中 视觉推理 ：grounding(abstract)；分类 cs.CV

Comments Project page: https://zju3dv.github.io/text_scene_motion

Discovering Novel Actions from Open World Egocentric Videos with Object-Grounded Visual Commonsense Reasoning

Sanjoy Kundu, Shubham Trehan, Sathyanarayanan N. Aakur

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments 25 Pages, 4 figures, 3 tables

LISA: Reasoning Segmentation via Large Language Model

Xin Lai, Zhuotao Tian, Yukang Chen, Yanwei Li, Yuhui Yuan, Shu Liu, Jiaya Jia

专题命中 视觉推理 ：multimodal large language model(abstract)；分类 cs.CV

Comments Code, models, and data are available at https://github.com/dvlab-research/LISA

Think-Program-reCtify: 3D Situated Reasoning with Large Language Models

Qingrong He, Kejun Lin, Shizhe Chen, Anwen Hu, Qin Jin

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Geometrically-driven Aggregation for Zero-shot 3D Point Cloud Understanding

Guofeng Mei, Luigi Riz, Yiming Wang, Fabio Poiesi

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments CVPR 2024

Tri-modal Confluence with Temporal Dynamics for Scene Graph Generation in Operating Rooms

Diandian Guo, Manxi Lin, Jialun Pei, He Tang, Yueming Jin, Pheng-Ann Heng

专题命中 视觉推理 ：LLaVA(abstract)；分类 cs.CV

Comments 10 pages, 4 figures, 3 tables

Towards Generative Abstract Reasoning: Completing Raven's Progressive Matrix via Rule Abstraction and Selection

Fan Shi, Bin Li, Xiangyang Xue

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain

Wei Zhang, Miaoxin Cai, Tong Zhang, Yin Zhuang, Xuerui Mao

专题命中 视觉推理 ：MLLM(abstract)；分类 cs.CV

From GPT-4 to Gemini and Beyond: Assessing the Landscape of MLLMs on Generalizability, Trustworthiness and Causality through Four Modalities

Chaochao Lu, Chen Qian, Guodong Zheng, Hongxing Fan, Hongzhi Gao, Jie Zhang, Jing Shao, Jingyi Deng, Jinlan Fu, Kexin Huang, Kunchang Li, Lijun Li, Limin Wang, Lu Sheng, Meiqi Chen, Ming Zhang, Qibing Ren, Sirui Chen, Tao Gui, Wanli Ouyang, Yali Wang, Yan Teng, Yaru Wang, Yi Wang, Yinan He, Yingchun Wang, Yixu Wang, Yongting Zhang, Yu Qiao, Yujiong Shen, Yurong Mou, Yuxi Chen, Zaibin Zhang, Zhelun Shi, Zhenfei Yin, Zhipin Wang

专题命中 视觉推理 ：MLLM(abstract)；分类 cs.CV

KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoning

Debjyoti Mondal, Suraj Modi, Subhadarshi Panda, Rituraj Singh, Godawari Sudhakar Rao

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Comments AAAI 2024

LMaaS: Exploring Pricing Strategy of Large Model as a Service for Communication

Panlong Wu, Qi Liu, Yanjie Dong, Fangxin Wang

专题命中 视觉推理 ：multimodal large language model(abstract)；分类 cs.LG

Tracking with Human-Intent Reasoning

Jiawen Zhu, Zhi-Qi Cheng, Jun-Yan He, Chenyang Li, Bin Luo, Huchuan Lu, Yifeng Geng, Xuansong Xie

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments 8 pages, 4 figures

V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs

Penghao Wu, Saining Xie

专题命中 视觉推理 ：MLLM(abstract)；分类 cs.CV

Comments Project page with code: https://vstar-seal.github.io/

Multi-modal Large Language Model Enhanced Pseudo 3D Perception Framework for Visual Commonsense Reasoning

Jian Zhu, Hanli Wang, Miaojing Shi

专题命中 视觉推理 ：MLLM(abstract)；分类 cs.CV

GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning

Mehran Kazemi, Hamidreza Alvari, Ankit Anand, Jialin Wu, Xi Chen, Radu Soricut

专题命中 视觉推理 ：vision language model(abstract)；分类 cs.CV

Delving into Multimodal Prompting for Fine-grained Visual Classification

Xin Jiang, Hao Tang, Junyao Gao, Xiaoyu Du, Shengfeng He, Zechao Li

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments This paper is accepted by AAAI 2024

Image Content Generation with Causal Reasoning

Xiaochuan Li, Baoyu Fan, Runze Zhang, Liang Jin, Di Wang, Zhenhua Guo, Yaqian Zhao, Rengang Li

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments Accepted by the 38th Annual AAAI Conference on Artificial Intelligence (AAAI 2024) in December 2023

Cognitive Visual Commonsense Reasoning Using Dynamic Working Memory

Xuejiao Tang, Xin Huang, Wenbin Zhang, Travers B. Child, Qiong Hu, Zhen Liu, Ji Zhang

专题命中 视觉推理 ：visual question answering(abstract)；分类 cs.CV

Comments DaWaK 2021

InfiMM-Eval: Complex Open-Ended Reasoning Evaluation For Multi-Modal Large Language Models

Xiaotian Han, Quanzeng You, Yongfei Liu, Wentao Chen, Huangjie Zheng, Khalil Mrini, Xudong Lin, Yiqi Wang, Bohan Zhai, Jianbo Yuan, Heng Wang, Hongxia Yang

专题命中 视觉推理 ：MLLM(abstract)；分类 cs.CV

LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning

Sijin Chen, Xin Chen, Chi Zhang, Mingsheng Li, Gang Yu, Hao Fei, Hongyuan Zhu, Jiayuan Fan, Tao Chen

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments Project Page: https://ll3da.github.io/

COLA: A Benchmark for Compositional Text-to-image Retrieval

Arijit Ray, Filip Radenovic, Abhimanyu Dubey, Bryan A. Plummer, Ranjay Krishna, Kate Saenko

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2023. Webpage: https://cs-people.bu.edu/array/research/cola/

Weakly Supervised Semantic Parsing with Execution-based Spurious Program Filtering

Kang-il Lee, Segwang Kim, Kyomin Jung

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI

Comments EMNLP 2023

Enhancing the Spatial Awareness Capability of Multi-Modal Large Language Model

Yongqiang Zhao, Zhenyu Li, Zhi Jin, Feng Zhang, Haiyan Zhao, Chengfeng Dou, Zhengwei Tao, Xinhai Xu, Donghong Liu

专题命中 视觉推理 ：MLLM(abstract)；分类 cs.AI

Learning to reason over visual objects

Shanka Subhra Mondal, Taylor Webb, Jonathan D. Cohen

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

Comments ICLR 2023

Lang3DSG: Language-based contrastive pre-training for 3D Scene Graph prediction

Sebastian Koch, Pedro Hermosilla, Narunas Vaskevicius, Mirco Colosi, Timo Ropinski

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments 3DV 2024. Project page: https://kochsebastian.com/lang3dsg

Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality

Harman Singh, Pengchuan Zhang, Qifan Wang, Mengjiao Wang, Wenhan Xiong, Jingfei Du, Yu Chen

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments EMNLP 2023 (long paper, main conference)

SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables

Xinyuan Lu, Liangming Pan, Qian Liu, Preslav Nakov, Min-Yen Kan

专题命中 视觉推理 ：grounding(abstract)；分类 cs.AI

Comments Accepted at EMNLP 2023 (main conference, long paper)

Interpreting and Controlling Vision Foundation Models via Text Explanations

Haozhe Chen, Junfeng Yang, Carl Vondrick, Chengzhi Mao

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.CV

ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning

Qiao Gu, Alihusein Kuwajerwala, Sacha Morin, Krishna Murthy Jatavallabhula, Bipasha Sen, Aditya Agarwal, Corban Rivera, William Paul, Kirsty Ellis, Rama Chellappa, Chuang Gan, Celso Miguel de Melo, Joshua B. Tenenbaum, Antonio Torralba, Florian Shkurti, Liam Paull

专题命中 视觉推理 ：vision-language model(abstract)；分类 cs.CV

Comments Project page: https://concept-graphs.github.io/ Explainer video: https://youtu.be/mRhNkQwRYnc

Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problems

Fan Shi, Bin Li, Xiangyang Xue

专题命中 视觉推理 ：visual reasoning(abstract)；分类 cs.AI