视觉大模型 / VLM - arXivDaily 专题

2411.01756 2024-12-17 cs.CV 83%

ChatTracker: Enhancing Visual Tracking Performance via Chatting with Multimodal Large Language Model

Yiming Sun, Fan Yu, Shaoxiang Chen, Yu Zhang, Junwei Huang, Chenhui Li, Yang Li, Changbo Wang

专题命中视觉定位与Grounding ：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

2409.16278 2024-12-10 cs.CV 83%

Adapting Vision-Language Model with Fine-grained Semantics for Open-Vocabulary Segmentation

Yong Xien Chng, Xuchong Qiu, Yizeng Han, Kai Ding, Wan Ding, Gao Huang

专题命中视觉定位与Grounding ：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments 13 pages, 10 figures

2411.11362 2024-11-19 cs.CV cs.CL 83%

MAIRA-Seg: Enhancing Radiology Report Generation with Segmentation-Aware Multimodal Large Language Models

Harshita Sharma, Valentina Salvatelli, Shaury Srivastav, Kenza Bouzid, Shruthi Bannur, Daniel C. Castro, Maximilian Ilse, Sam Bond-Taylor, Mercy Prasanna Ranjit, Fabian Falck, Fernando Pérez-García, Anton Schwaighofer, Hannah Richardson, Maria Teodora Wetscherek, Stephanie L. Hyland, Javier Alvarez-Valle

专题命中视觉定位与Grounding ：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

Comments Accepted as Proceedings Paper at ML4H 2024

2411.10922 2024-11-19 cs.CV 83%

Exploiting VLM Localizability and Semantics for Open Vocabulary Action Detection

Wentao Bao, Kai Li, Yuxiao Chen, Deep Patel, Martin Renqiang Min, Yu Kong

专题命中视觉定位与Grounding ：VLM(title,abstract)；vision-language model(abstract)；分类 cs.CV

Comments WACV 2025 Accepted

2410.24148 2024-11-01 cs.CV 83%

Exploring Vision Language Models for Facial Attribute Recognition: Emotion, Race, Gender, and Age

Nouar AlDahoul, Myles Joshua Toledo Tan, Harishwar Reddy Kasireddy, Yasir Zaki

专题命中视觉定位与Grounding ：vision language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

Comments 52 pages, 13 figures

2410.08021 2024-10-28 cs.CV 83%

OneRef: Unified One-tower Expression Grounding and Segmentation with Mask Referring Modeling

Linhui Xiao, Xiaoshan Yang, Fang Peng, Yaowei Wang, Changsheng Xu

专题命中视觉定位与Grounding ：grounding(title,abstract)；visual language model(abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2024. The project page: https://github.com/linhuixiao/OneRef

2410.11404 2024-10-16 cs.CV 83%

MoChat: Joints-Grouped Spatio-Temporal Grounding LLM for Multi-Turn Motion Comprehension and Description

Jiawei Mo, Yixuan Chen, Rifen Lin, Yongkang Ni, Min Zeng, Xiping Hu, Min Li

专题命中视觉定位与Grounding ：grounding(title,abstract)；multimodal large language model(abstract)；分类 cs.CV

2406.18722 2024-10-15 cs.RO cs.CV 83%

Towards Open-World Grasping with Large Vision-Language Models

Georgios Tziafas, Hamidreza Kasaei

专题命中视觉定位与Grounding ：vision-language model(title,abstract)；grounding(abstract)；分类 cs.CV

Comments 8th Conference on Robot Learning (CoRL 2024), Munich, Germany

2410.03054 2024-10-07 cs.CV cs.RO 83%

CLIP-Clique: Graph-based Correspondence Matching Augmented by Vision Language Models for Object-based Global Localization

Shigemichi Matsuzaki, Kazuhito Tanaka, Kazuhiro Shintani

专题命中视觉定位与Grounding ：vision language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments IEEE Robotics and Automation Letters

2307.00329 2024-09-17 cs.RO cs.AI 83%

DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignment

Yanjiang Guo, Yen-Jen Wang, Lihan Zha, Jianyu Chen

专题命中视觉定位与Grounding ：grounding(title,abstract)；vision language model(abstract)；分类 cs.AI

Comments Published in IROS 2024

2409.06210 2024-09-11 cs.CV 83%

INTRA: Interaction Relationship-aware Weakly Supervised Affordance Grounding

Ji Ha Jang, Hoigi Seo, Se Young Chun

专题命中视觉定位与Grounding ：grounding(title,abstract)；vision-language model(abstract)；分类 cs.CV

2403.08108 2024-09-09 cs.CV 83%

TaskCLIP: Extend Large Vision-Language Model for Task Oriented Object Detection

Hanning Chen, Wenjun Huang, Yang Ni, Sanggeon Yun, Yezi Liu, Fei Wen, Alvaro Velasquez, Hugo Latapie, Mohsen Imani

专题命中视觉定位与Grounding ：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

2408.16500 2024-08-30 cs.CV 83%

CogVLM2: Visual Language Models for Image and Video Understanding

Wenyi Hong, Weihan Wang, Ming Ding, Wenmeng Yu, Qingsong Lv, Yan Wang, Yean Cheng, Shiyu Huang, Junhui Ji, Zhao Xue, Lei Zhao, Zhuoyi Yang, Xiaotao Gu, Xiaohan Zhang, Guanyu Feng, Da Yin, Zihan Wang, Ji Qi, Xixuan Song, Peng Zhang, Debing Liu, Bin Xu, Juanzi Li, Yuxiao Dong, Jie Tang

专题命中视觉定位与Grounding ：visual language model(title,abstract)；grounding(abstract)；分类 cs.CV

2408.16219 2024-08-30 cs.CV 83%

Training-free Video Temporal Grounding using Large-scale Pre-trained Models

Minghang Zheng, Xinhao Cai, Qingchao Chen, Yuxin Peng, Yang Liu

专题命中视觉定位与Grounding ：grounding(title,abstract)；visual language model(abstract)；分类 cs.CV

Comments Accepted by ECCV 2024

2403.15952 2024-08-12 cs.CV cs.CL 83%

IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models

Haz Sameen Shahgir, Khondker Salman Sayeed, Abhik Bhattacharjee, Wasi Uddin Ahmad, Yue Dong, Rifat Shahriyar

专题命中视觉定位与Grounding ：vision language model(title,abstract)；VLM(abstract)；分类 cs.CV

2407.14563 2024-07-23 cs.CV 83%

Learning Visual Grounding from Generative Vision and Language Model

Shijie Wang, Dahun Kim, Ali Taalimi, Chen Sun, Weicheng Kuo

专题命中视觉定位与Grounding ：grounding(title,abstract)；VLM(abstract)；分类 cs.CV

2403.16528 2024-07-22 cs.CV 83%

Open-Set Recognition in the Age of Vision-Language Models

Dimity Miller, Niko Sünderhauf, Alex Kenna, Keita Mason

专题命中视觉定位与Grounding ：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments 29 pages, Accepted for publication in ECCV 2024

2406.13898 2024-06-21 cs.CV cs.CL cs.CY 83%

The Use of Multimodal Large Language Models to Detect Objects from Thermal Images: Transportation Applications

Huthaifa I. Ashqar, Taqwa I. Alhadidi, Mohammed Elhenawy, Nour O. Khanfar

专题命中视觉定位与Grounding ：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

2312.04016 2024-04-17 cs.CV 83%

PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillation

Ardian Umam, Cheng-Kun Yang, Min-Hung Chen, Jen-Hui Chuang, Yen-Yu Lin

专题命中视觉定位与Grounding ：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments CVPR 2024 Accepted

2311.02612 2024-04-17 cs.CV 83%

GPT-4V-AD: Exploring Grounding Potential of VQA-oriented GPT-4V for Zero-shot Anomaly Detection

Jiangning Zhang, Haoyang He, Xuhai Chen, Zhucun Xue, Yabiao Wang, Chengjie Wang, Lei Xie, Yong Liu

专题命中视觉定位与Grounding ：grounding(title,abstract)；visual question answering(abstract)；分类 cs.CV

2404.05955 2024-04-10 cs.CL cs.AI 83%

VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?

Junpeng Liu, Yifan Song, Bill Yuchen Lin, Wai Lam, Graham Neubig, Yuanzhi Li, Xiang Yue

专题命中视觉定位与Grounding ：grounding(title,abstract)；multimodal large language model(abstract)；分类 cs.AI

2404.00419 2024-04-02 cs.CV cs.CL 83%

Do Vision-Language Models Understand Compound Nouns?

Sonal Kumar, Sreyan Ghosh, S Sakshi, Utkarsh Tyagi, Dinesh Manocha

专题命中视觉定位与Grounding ：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments Accepted to NAACL 2024 Main Conference

2401.07764 2024-02-20 cs.AI cs.NI 83%

When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment

Minrui Xu, Dusit Niyato, Jiawen Kang, Zehui Xiong, Shiwen Mao, Zhu Han, Dong In Kim, Khaled B. Letaief

专题命中视觉定位与Grounding ：grounding(title,abstract)；multimodal large language model(abstract)；分类 cs.AI

2401.07803 2024-02-16 cs.CV 83%

Uncovering the Full Potential of Visual Grounding Methods in VQA

Daniel Reich, Tanja Schultz

专题命中视觉定位与Grounding ：grounding(title,abstract)；visual question answering(abstract)；分类 cs.CV

2401.13307 2024-01-25 cs.CV 83%

ChatterBox: Multi-round Multimodal Referring and Grounding

Yunjie Tian, Tianren Ma, Lingxi Xie, Jihao Qiu, Xi Tang, Yuan Zhang, Jianbin Jiao, Qi Tian, Qixiang Ye

专题命中视觉定位与Grounding ：grounding(title,abstract)；vision-language model(abstract)；分类 cs.CV

Comments 17 pages, 6 tables, 9 figurs. Code, data, and model are available at: https://github.com/sunsmarterjie/ChatterBox

2305.15015 2024-01-17 cs.CV 83%

Measuring Faithful and Plausible Visual Grounding in VQA

Daniel Reich, Felix Putze, Tanja Schultz

专题命中视觉定位与Grounding ：grounding(title,abstract)；visual question answering(abstract)；分类 cs.CV

Journal ref EMNLP 2023 Findings

2308.15366 2023-12-29 cs.CV 83%

AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models

Zhaopeng Gu, Bingke Zhu, Guibo Zhu, Yingying Chen, Ming Tang, Jinqiao Wang

专题命中视觉定位与Grounding ：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

Comments Accepted by AAAI 2024; Project page: https://anomalygpt.github.io

2311.13194 2023-12-18 cs.CV 83%

Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs

Yonghui Wang, Wengang Zhou, Hao Feng, Keyi Zhou, Houqiang Li

专题命中视觉定位与Grounding ：grounding(title,abstract)；multimodal large language model(abstract)；分类 cs.CV

2311.06737 2023-11-14 cs.CL cs.AI 83%

Detecting and Correcting Hate Speech in Multimodal Memes with Large Visual Language Model

Minh-Hao Van, Xintao Wu

专题命中视觉定位与Grounding ：visual language model(title,abstract)；LLaVA(abstract)；分类 cs.AI

2308.12966 2023-10-16 cs.CV cs.CL 83%

Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond

Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, Jingren Zhou

专题命中视觉定位与Grounding ：vision-language model(title,abstract)；grounding(abstract)；分类 cs.CV

Comments Code, demo and models are available at https://github.com/QwenLM/Qwen-VL

1. 视觉定位与Grounding 7441 篇

ChatTracker: Enhancing Visual Tracking Performance via Chatting with Multimodal Large Language Model

Adapting Vision-Language Model with Fine-grained Semantics for Open-Vocabulary Segmentation

MAIRA-Seg: Enhancing Radiology Report Generation with Segmentation-Aware Multimodal Large Language Models

Exploiting VLM Localizability and Semantics for Open Vocabulary Action Detection

Exploring Vision Language Models for Facial Attribute Recognition: Emotion, Race, Gender, and Age

OneRef: Unified One-tower Expression Grounding and Segmentation with Mask Referring Modeling

MoChat: Joints-Grouped Spatio-Temporal Grounding LLM for Multi-Turn Motion Comprehension and Description

Towards Open-World Grasping with Large Vision-Language Models

CLIP-Clique: Graph-based Correspondence Matching Augmented by Vision Language Models for Object-based Global Localization

DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignment

INTRA: Interaction Relationship-aware Weakly Supervised Affordance Grounding

TaskCLIP: Extend Large Vision-Language Model for Task Oriented Object Detection

CogVLM2: Visual Language Models for Image and Video Understanding

Training-free Video Temporal Grounding using Large-scale Pre-trained Models

IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models

Learning Visual Grounding from Generative Vision and Language Model

Open-Set Recognition in the Age of Vision-Language Models

The Use of Multimodal Large Language Models to Detect Objects from Thermal Images: Transportation Applications

PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillation

GPT-4V-AD: Exploring Grounding Potential of VQA-oriented GPT-4V for Zero-shot Anomaly Detection

VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?

Do Vision-Language Models Understand Compound Nouns?

When Large Language Model Agents Meet 6G Networks: Perception, Grounding, and Alignment

Uncovering the Full Potential of Visual Grounding Methods in VQA

ChatterBox: Multi-round Multimodal Referring and Grounding

Measuring Faithful and Plausible Visual Grounding in VQA

AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models

Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs

Detecting and Correcting Hate Speech in Multimodal Memes with Large Visual Language Model

Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond