视觉大模型 / VLM

Toward the Identifiability of Comparative Deep Generative Models

Romain Lopez, Jan-Christian Huetter, Ehsan Hajiramezanali, Jonathan Pritchard, Aviv Regev

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.LG

Comments 45 pages, 3 figures

Journal ref Causal Learning and Reasoning 2024

Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks

Tianhe Ren, Shilong Liu, Ailing Zeng, Jing Lin, Kunchang Li, He Cao, Jiayu Chen, Xinyu Huang, Yukang Chen, Feng Yan, Zhaoyang Zeng, Hao Zhang, Feng Li, Jie Yang, Hongyang Li, Qing Jiang, Lei Zhang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Efficient kernel surrogates for neural network-based regression

Saad Qadeer, Andrew Engel, Amanda Howard, Adam Tsou, Max Vargas, Panos Stinis, Tony Chiang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.LG

Comments 35 pages. software used to reach results available upon request, approved for release by Pacific Northwest National Laboratory

Small Language Model Meets with Reinforced Vision Vocabulary

Haoran Wei, Lingyu Kong, Jinyue Chen, Liang Zhao, Zheng Ge, En Yu, Jianjian Sun, Chunrui Han, Xiangyu Zhang

专题命中 视觉定位与Grounding ：vision language model(abstract)；分类 cs.CV

VGDiffZero: Text-to-image Diffusion Models Can Be Zero-shot Visual Grounders

Xuyang Liu, Siteng Huang, Yachen Kang, Honggang Chen, Donglin Wang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments Accepted by ICASSP 2024

Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings

Daniel Rose, Vaishnavi Himakunthala, Andy Ouyang, Ryan He, Alex Mei, Yujie Lu, Michael Saxon, Chinmay Sonar, Diba Mirza, William Yang Wang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Unifying Visual and Vision-Language Tracking via Contrastive Learning

Yinchao Ma, Yuyang Tang, Wenfei Yang, Tianzhu Zhang, Jinpeng Zhang, Mengxue Kang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Local-Global Context Aware Transformer for Language-Guided Video Segmentation

Chen Liang, Wenguan Wang, Tianfei Zhou, Jiaxu Miao, Yawei Luo, Yi Yang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments Accepted by TPAMI. Code, data: https://github.com/leonnnop/Locater

Rethinking Cross-modal Interaction from a Top-down Perspective for Referring Video Object Segmentation

Chen Liang, Yu Wu, Tianfei Zhou, Wenguan Wang, Zongxin Yang, Yunchao Wei, Yi Yang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments Champion solution in YouTube-VOS 2021 Track 3. Extended version published in https://ieeexplore.ieee.org/abstract/document/10083244

Multi-scale 2D Temporal Map Diffusion Models for Natural Language Video Localization

Chongzhi Zhang, Mingyuan Zhang, Zhiyang Teng, Jiayi Li, Xizhou Zhu, Lewei Lu, Ziwei Liu, Aixin Sun

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly

Yi R. Fung, Tuhin Chakraborty, Hao Guo, Owen Rambow, Smaranda Muresan, Heng Ji

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledge

Rishi Hazra, Pedro Zuidberg Dos Martires, Luc De Raedt

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

Comments Accepted in AAAI 2024. Website: https://rishihazra.github.io/SayCanPay/

Towards Learning Geometric Eigen-Lengths Crucial for Fitting Tasks

Yijia Weng, Kaichun Mo, Ruoxi Shi, Yanchao Yang, Leonidas J. Guibas

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments ICML 2023. Project page: https://yijiaweng.github.io/geo-eigen-length

Journal ref Proceedings of the 40th International Conference on Machine Learning, PMLR 202:36958-36977, 2023

FM-OV3D: Foundation Model-based Cross-modal Knowledge Blending for Open-Vocabulary 3D Detection

Dongmei Zhang, Chang Li, Ray Zhang, Shenghao Xie, Wei Xue, Xiaodong Xie, Shanghang Zhang

专题命中 视觉定位与Grounding ：visual language model(abstract)；分类 cs.CV

Comments Accepted by AAAI 2024. Code will be released at https://github.com/dmzhang0425/FM-OV3D.git

CLIM: Contrastive Language-Image Mosaic for Region Representation

Size Wu, Wenwei Zhang, Lumin Xu, Sheng Jin, Wentao Liu, Chen Change Loy

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Simple Image-level Classification Improves Open-vocabulary Object Detection

Ruohuan Fang, Guansong Pang, Xiao Bai

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments Accepted at AAAI 2024

Relax Image-Specific Prompt Requirement in SAM: A Single Generic Prompt for Segmenting Camouflaged Objects

Jian Hu, Jiayi Lin, Weitong Cai, Shaogang Gong

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments Accepted by AAAI2024

Meta-Referential Games to Learn Compositional Learning Behaviours

Kevin Denamganaï, Sondess Missaoui, James Alfred Walker

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.LG

Comments work in progress

Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation

Qin Guo, Tianwei Lin

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments 14 pages, 9 figures

ETHER: Aligning Emergent Communication for Hindsight Experience Replay

Kevin Denamganaï, Daniel Hernandez, Ozan Vardal, Sondess Missaoui, James Alfred Walker

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

Comments work in progress

What a MESS: Multi-Domain Evaluation of Zero-Shot Semantic Segmentation

Benedikt Blumenstiel, Johannes Jakubik, Hilde Kühne, Michael Vössing

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments 37th Conference on Neural Information Processing Systems (NeurIPS 2023) Track on Datasets and Benchmarks

Knowledge-enhanced Agents for Interactive Text Games

Prateek Chhikara, Jiarui Zhang, Filip Ilievski, Jonathan Francis, Kaixin Ma

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI

Comments Published at K-CAP '23

General Object Foundation Model for Images and Videos at Scale

Junfeng Wu, Yi Jiang, Qihao Liu, Zehuan Yuan, Xiang Bai, Song Bai

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments Project homepage: https://glee-vision.github.io

CLIP-guided Federated Learning on Heterogeneous and Long-Tailed Data

Jiangming Shi, Shanshan Zheng, Xiangbo Yin, Yang Lu, Yuan Xie, Yanyun Qu

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments This paper has been accepted by AAAI24

See, Say, and Segment: Teaching LMMs to Overcome False Premises

Tsung-Han Wu, Giscard Biamby, David Chan, Lisa Dunlap, Ritwik Gupta, Xudong Wang, Joseph E. Gonzalez, Trevor Darrell

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Comments Project Page: https://see-say-segment.github.io

Fine-Grained Visual Prompting

Lingfeng Yang, Yueze Wang, Xiang Li, Xinlong Wang, Jian Yang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Holistic Evaluation of GPT-4V for Biomedical Imaging

Zhengliang Liu, Hanqi Jiang, Tianyang Zhong, Zihao Wu, Chong Ma, Yiwei Li, Xiaowei Yu, Yutong Zhang, Yi Pan, Peng Shu, Yanjun Lyu, Lu Zhang, Junjie Yao, Peixin Dong, Chao Cao, Zhenxiang Xiao, Jiaqi Wang, Huan Zhao, Shaochen Xu, Yaonai Wei, Jingyuan Chen, Haixing Dai, Peilong Wang, Hao He, Zewei Wang, Xinyu Wang, Xu Zhang, Lin Zhao, Yiheng Liu, Kai Zhang, Liheng Yan, Lichao Sun, Jun Liu, Ning Qiang, Bao Ge, Xiaoyan Cai, Shijie Zhao, Xintao Hu, Yixuan Yuan, Gang Li, Shu Zhang, Xin Zhang, Xi Jiang, Tuo Zhang, Dinggang Shen, Quanzheng Li, Wei Liu, Xiang Li, Dajiang Zhu, Tianming Liu

专题命中 视觉定位与Grounding ：multimodal large language model(abstract)；分类 cs.AI

SYNC-CLIP: Synthetic Data Make CLIP Generalize Better in Data-Limited Scenarios

Mushui Liu, Weijie He, Ziqian Lu, Yunlong Yu

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV

Comments Under Review

Aligning and Prompting Everything All at Once for Universal Visual Perception

Yunhang Shen, Chaoyou Fu, Peixian Chen, Mengdan Zhang, Ke Li, Xing Sun, Yunsheng Wu, Shaohui Lin, Rongrong Ji

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV

Revisiting DETR Pre-training for Object Detection

Yan Ma, Weicong Liang, Bohan Chen, Yiduo Hao, Bojian Hou, Xiangyu Yue, Chao Zhang, Yuhui Yuan

专题命中 视觉定位与Grounding ：LLaVA(abstract)；分类 cs.CV