视觉大模型 / VLM

Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection

Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, Jun Zhu, Lei Zhang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Code will be available at https://github.com/IDEA-Research/GroundingDINO

Multi-sentence Video Grounding for Long Video Generation

Wei Feng, Xin Wang, Hong Chen, Zeyang Zhang, Wenwu Zhu

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Four Ways to Improve Verbo-visual Fusion for Dense 3D Visual Grounding

Ozan Unal, Christos Sakaridis, Suman Saha, Luc Van Gool

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted at ECCV 2024. Winner of the ICCV 2023 ScanRefer Challenge

SHINE: Saliency-aware HIerarchical NEgative Ranking for Compositional Temporal Grounding

Zixu Cheng, Yujiang Pu, Shaogang Gong, Parisa Kordjamshidi, Yu Kong

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted to ECCV 2024

RGNet: A Unified Clip Retrieval and Grounding Network for Long Videos

Tanveer Hannan, Md Mohaiminul Islam, Thomas Seidl, Gedas Bertasius

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments The code is released at https://github.com/Tanveer81/RGNet

AddressCLIP: Empowering Vision-Language Models for City-wide Image Address Localization

Shixiong Xu, Chenghao Zhang, Lubin Fan, Gaofeng Meng, Shiming Xiang, Jieping Ye

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted at ECCV 2024

Multi-modal Attribute Prompting for Vision-Language Models

Xin Liu, Jiamin Wu, and Wenfei Yang, Xu Zhou, Tianzhu Zhang

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted for Publication in IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)

Grounding Language about Belief in a Bayesian Theory-of-Mind

Lance Ying, Tan Zhi-Xuan, Lionel Wong, Vikash Mansinghka, Joshua Tenenbaum

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.AI

Comments Published at CogSci 2024

Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model

Danni Yang, Ruohan Dong, Jiayi Ji, Yiwei Ma, Haowei Wang, Xiaoshuai Sun, Rongrong Ji

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted by ECCV2024

ACTRESS: Active Retraining for Semi-supervised Visual Grounding

Weitai Kang, Mengxue Qu, Yunchao Wei, Yan Yan

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Visual Grounding with Attention-Driven Constraint Balancing

Weitai Kang, Luowei Zhou, Junyi Wu, Changchang Sun, Yan Yan

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

SegVG: Transferring Object Bounding Box to Segmentation for Visual Grounding

Weitai Kang, Gaowen Liu, Mubarak Shah, Yan Yan

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted to ECCV 2024

Multi-Task Domain Adaptation for Language Grounding with 3D Objects

Penglei Sun, Yaoxian Song, Xinglin Pan, Peijie Dong, Xiaofei Yang, Qiang Wang, Zhixu Li, Tiefeng Li, Xiaowen Chu

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding

WonJun Moon, Sangeek Hyun, SuBeen Lee, Jae-Pil Heo

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments 29 pages, 15 figures, 14 tables, Code is available at https://github.com/wjun0830/CGDETR

A Refer-and-Ground Multimodal Large Language Model for Biomedicine

Xiaoshuang Huang, Haifeng Huang, Lingdong Shen, Yehui Yang, Fangxin Shang, Junwei Liu, Jia Liu

专题命中 视觉定位与Grounding ：multimodal large language model(title,abstract)；分类 cs.CV

Comments Accepted by MICCAI2024

On the Role of Visual Grounding in VQA

Daniel Reich, Tanja Schultz

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

MLLM as Video Narrator: Mitigating Modality Imbalance in Video Moment Retrieval

Weitong Cai, Jiabo Huang, Shaogang Gong, Hailin Jin, Yang Liu

专题命中 视觉定位与Grounding ：MLLM(title,abstract)；分类 cs.CV

Comments Under review

Simplify Implant Depth Prediction as Video Grounding: A Texture Perceive Implant Depth Prediction Network

Xinquan Yang, Xuguang Li, Xiaoling Luo, Leilei Zeng, Yudi Zhang, Linlin Shen, Yongqiang Deng

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Journal ref MICCAI'2024

PUMGPT: A Large Vision-Language Model for Product Understanding

Wei Xue, Zongyi Guo, Baoliang Cui, Zheng Xing, Xiaoyi Zeng, Xiufei Wang, Shuhui Wu, Weiming Lu

专题命中 视觉定位与Grounding ：vision-language model(title)；vision language model(abstract)；分类 cs.CV

CARLOR @ Ego4D Step Grounding Challenge: Bayesian temporal-order priors for test time refinement

Carlos Plou, Lorenzo Mur-Labadia, Ruben Martinez-Cantin, Ana C. Murillo

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Dual Attribute-Spatial Relation Alignment for 3D Visual Grounding

Yue Xu, Kaizhi Yang, Jiebo Luo, Xuejin Chen

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

AutoTVG: A New Vision-language Pre-training Paradigm for Temporal Video Grounding

Xing Zhang, Jiaxi Gu, Haoyu Zhao, Shicong Wang, Hang Xu, Renjing Pei, Songcen Xu, Zuxuan Wu, Yu-Gang Jiang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Technique Report

Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics

Shan Jia, Reilin Lyu, Kangran Zhao, Yize Chen, Zhiyuan Yan, Yan Ju, Chuanbo Hu, Xin Li, Baoyuan Wu, Siwei Lyu

专题命中 视觉定位与Grounding ：multimodal large language model(title,abstract)；分类 cs.AI

DARA: Domain- and Relation-aware Adapters Make Parameter-efficient Tuning for Visual Grounding

Ting Liu, Xuyang Liu, Siteng Huang, Honggang Chen, Quanjun Yin, Long Qin, Donglin Wang, Yue Hu

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments Accepted by ICME 2024 (Oral)

Text Promptable Surgical Instrument Segmentation with Vision-Language Models

Zijian Zhou, Oluwatosin Alabi, Meng Wei, Tom Vercauteren, Miaojing Shi

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；分类 cs.CV

Comments NeurIPS 2023

Journal ref https://proceedings.neurips.cc/paper_files/paper/2023/hash/5af741d487c5f0b08bfe56e11d1883e4-Abstract-Conference.html

Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detection

Tianhe Ren, Qing Jiang, Shilong Liu, Zhaoyang Zeng, Wenlong Liu, Han Gao, Hongjie Huang, Zhengyu Ma, Xiaoke Jiang, Yihao Chen, Yuda Xiong, Hao Zhang, Feng Li, Peijun Tang, Kent Yu, Lei Zhang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments homepage: https://deepdataspace.com/home

Video sentence grounding with temporally global textual knowledge

Cai Chen, Runzhong Zhang, Jianjun Gao, Kejun Wu, Kim-Hui Yap, Yi Wang

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

A Joint Study of Phrase Grounding and Task Performance in Vision and Language Models

Noriyuki Kojima, Hadar Averbuch-Elor, Yoav Artzi

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments This was published in TMLR in 2024, on January 24th

What, when, and where? -- Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions

Brian Chen, Nina Shvetsova, Andrew Rouditchenko, Daniel Kondermann, Samuel Thomas, Shih-Fu Chang, Rogerio Feris, James Glass, Hilde Kuehne

专题命中 视觉定位与Grounding ：grounding(title,abstract)；分类 cs.CV

Comments To be presented at CVPR 2024. Project page: https://brian7685.github.io/STG/

Exploring Interactive Semantic Alignment for Efficient HOI Detection with Vision-language Model

Jihao Dong, Renjie Pan, Hua Yang

专题命中 视觉定位与Grounding ：vision-language model(title,abstract)；分类 cs.CV