视觉大模型 / VLM

Textual Query-Driven Mask Transformer for Domain Generalized Segmentation

Byeonghyun Pak, Byeongju Woo, Sunghwan Kim, Dae-hwan Kim, Hoseong Kim

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments ECCV 2024

A Plug-and-Play Method for Rare Human-Object Interactions Detection by Bridging Domain Gap

Lijun Zhang, Wei Suo, Peng Wang, Yanning Zhang

专题命中 视觉定位与Grounding ：visual reasoning(abstract)；分类 cs.CV

AM-RADIO: Agglomerative Vision Foundation Model -- Reduce All Domains Into One

Mike Ranzinger, Greg Heinrich, Jan Kautz, Pavlo Molchanov

专题命中 视觉定位与Grounding ：LLaVA(abstract)；分类 cs.CV

Comments CVPR 2024 Version 3: CVPR Camera Ready, reconfigured full paper, table 1 is now more comprehensive Version 2: Added more acknowledgements and updated table 7 with more recent results. Ensured that the link in the abstract to our code is working properly Version 3: Fix broken hyperlinks

Journal ref Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, pp. 12490-12500

C-RAG: Certified Generation Risks for Retrieval-Augmented Language Models

Mintong Kang, Nezihe Merve Gürel, Ning Yu, Dawn Song, Bo Li

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

Comments Accepted to ICML 2024

Normality Addition via Normality Detection in Industrial Image Anomaly Detection Models

Jihun Yi, Dahuin Jung, Sungroh Yoon

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Large Language Models as Co-Pilots for Causal Inference in Medical Studies

Ahmed Alaa, Rachael V. Phillips, Emre Kıcıman, Laura B. Balzer, Mark van der Laan, Maya Petersen

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

RefMask3D: Language-Guided Transformer for 3D Referring Segmentation

Shuting He, Henghui Ding

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments ACM MM 2024, Code: https://github.com/heshuting555/RefMask3D

PartGLEE: A Foundation Model for Recognizing and Parsing Any Objects

Junyi Li, Junfeng Wu, Weizhi Zhao, Song Bai, Xiang Bai

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments Accepted by ECCV2024, homepage: https://provencestar.github.io/PartGLEE-Vision/

Unveiling and Mitigating Bias in Audio Visual Segmentation

Peiwen Sun, Honggang Zhang, Di Hu

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments Accepted by ACM MM 24 (ORAL)

Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completion

Yang Liu, Xiaobin Tian, Zequn Sun, Wei Hu

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

Comments Accepted in the 23rd International Semantic Web Conference (ISWC 2024)

FINEMATCH: Aspect-based Fine-grained Image and Text Mismatch Detection and Correction

Hang Hua, Jing Shi, Kushal Kafle, Simon Jenni, Daoan Zhang, John Collomosse, Scott Cohen, Jiebo Luo

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments ECCV 2024

Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Models

Xiaoyu Zhu, Hao Zhou, Pengfei Xing, Long Zhao, Hao Xu, Junwei Liang, Alexander Hauptmann, Ting Liu, Andrew Gallagher

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments ECCV 2024

LaMI-DETR: Open-Vocabulary Detection with Language Model Instruction

Penghui Du, Yu Wang, Yifan Sun, Luting Wang, Yue Liao, Gang Zhang, Errui Ding, Yan Wang, Jingdong Wang, Si Liu

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments ECCV2024

When Do We Not Need Larger Vision Models?

Baifeng Shi, Ziyang Wu, Maolin Mao, Xin Wang, Trevor Darrell

专题命中 视觉定位与Grounding ：MLLM(abstract)；分类 cs.CV

Comments Code: https://github.com/bfshi/scaling_on_scales

ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inference

Mengcheng Lan, Chaofeng Chen, Yiping Ke, Xinjiang Wang, Litong Feng, Wayne Zhang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments Accepted to ECCV 2024. code available at https://github.com/mc- lan/ClearCLIP

VCP-CLIP: A visual context prompting model for zero-shot anomaly segmentation

Zhen Qu, Xian Tao, Mukesh Prasad, Fei Shen, Zhengtao Zhang, Xinyi Gong, Guiguang Ding

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

LLM-based Frameworks for API Argument Filling in Task-Oriented Conversational Systems

Jisoo Mok, Mohammad Kachuee, Shuyang Dai, Shayan Ray, Tara Taghavi, Sungroh Yoon

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

Beyond Mask: Rethinking Guidance Types in Few-shot Segmentation

Shijie Chang, Youwei Pang, Xiaoqi Zhao, Lihe Zhang, Huchuan Lu

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments Preprint under review

Learning Modality-agnostic Representation for Semantic Segmentation from Any Modalities

Xu Zheng, Yuanhuiyi Lyu, Lin Wang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments Accepted to ECCV 2024

Does ChatGPT Have a Mind?

Simon Goldstein, Benjamin A. Levinstein

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly Detection

Xiaofan Li, Zhizhong Zhang, Xin Tan, Chengwei Chen, Yanyun Qu, Yuan Xie, Lizhuang Ma

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments Accepted by CVPR2024

Understanding the Importance of Evolutionary Search in Automated Heuristic Design with Large Language Models

Rui Zhang, Fei Liu, Xi Lin, Zhenkun Wang, Zhichao Lu, Qingfu Zhang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

Comments Accepted by the 18th International Conference on Parallel Problem Solving From Nature (PPSN 2024)

WildRefer: 3D Object Localization in Large-scale Dynamic Scenes with Multi-modal Visual Data and Natural Language

Zhenxiang Lin, Xidong Peng, Peishan Cong, Ge Zheng, Yujin Sun, Yuenan Hou, Xinge Zhu, Sibei Yang, Yuexin Ma

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Dense Multimodal Alignment for Open-Vocabulary 3D Scene Understanding

Ruihuang Li, Zhengqiang Zhang, Chenhang He, Zhiyuan Ma, Vishal M. Patel, Lei Zhang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments Accepted by ECCV 2024

Compositional Structures in Neural Embedding and Interaction Decompositions

Matthew Trager, Alessandro Achille, Pramuditha Perera, Luca Zancato, Stefano Soatto

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.LG

Comments 15 pages, 3 figures

Unified Embedding Alignment for Open-Vocabulary Video Instance Segmentation

Hao Fang, Peng Wu, Yawei Li, Xinxin Zhang, Xiankai Lu

专题命中 视觉定位与Grounding ：VLM(abstract)；分类 cs.CV

Comments ECCV 2024

Explore the Potential of CLIP for Training-Free Open Vocabulary Semantic Segmentation

Tong Shao, Zhuotao Tian, Hang Zhao, Jingyong Su

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments ECCV24 accepted

CoLA: Conditional Dropout and Language-driven Robust Dual-modal Salient Object Detection

Shuang Hao, Chunlin Zhong, He Tang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Described Spatial-Temporal Video Detection

Wei Ji, Xiangyan Liu, Yingfei Sun, Jiajun Deng, You Qin, Ammar Nuwanna, Mengyao Qiu, Lina Wei, Roger Zimmermann

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

CLIP-DR: Textual Knowledge-Guided Diabetic Retinopathy Grading with Ranking-aware Prompting

Qinkai Yu, Jianyang Xie, Anh Nguyen, He Zhao, Jiong Zhang, Huazhu Fu, Yitian Zhao, Yalin Zheng, Yanda Meng

专题命中 视觉定位与Grounding ：visual language model(abstract)；分类 cs.CV

Comments Accepted by MICCAI 2024