视觉大模型 / VLM

Open-Vocabulary Semantic Segmentation with Mask-adapted CLIP

Feng Liang, Bichen Wu, Xiaoliang Dai, Kunpeng Li, Yinan Zhao, Hang Zhang, Peizhao Zhang, Peter Vajda, Diana Marculescu

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments CVPR 2023. Project page: https://jeff-liangf.github.io/projects/ovseg

CoReS: Compatible Representations via Stationarity

Niccolo Biondi, Federico Pernici, Matteo Bruni, Alberto Del Bimbo

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments in IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023. Code: https://github.com/NiccoBiondi/cores-compatibility

WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentation

Jongheon Jeong, Yang Zou, Taewan Kim, Dongqing Zhang, Avinash Ravichandran, Onkar Dabeer

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted to Conference on Computer Vision and Pattern Recognition (CVPR) 2023

Open-Vocabulary Object Detection using Pseudo Caption Labels

Han-Cheol Cho, Won Young Jhoo, Wooyoung Kang, Byungseok Roh

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Side Adapter Network for Open-Vocabulary Semantic Segmentation

Mengde Xu, Zheng Zhang, Fangyun Wei, Han Hu, Xiang Bai

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments CVPR2023 Highlight

Open-vocabulary Attribute Detection

María A. Bravo, Sudhanshu Mittal, Simon Ging, Thomas Brox

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Accepted at CVPR 2023. https://ovad-benchmark.github.io

The Effect of Modeling Human Rationality Level on Learning Rewards from Multiple Feedback Types

Gaurav R. Ghosal, Matthew Zurek, Daniel S. Brown, Anca D. Dragan

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments Published at AAAI 2023; 10 pages, 5 figures plus appendices

Learning to Retrieve Engaging Follow-Up Queries

Christopher Richardson, Sudipta Kar, Anjishnu Kumar, Anand Ramachandran, Omar Zia Khan, Zeynab Raeesy, Abhinav Sethy

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments EACL 2023

LiT Tuned Models for Efficient Species Detection

Andre Nakkab, Benjamin Feuer, Chinmay Hegde

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments 5 pages, 5 figures, 1 table, presented at AAAI 2023 conference for the AIAFS workshop

WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents

Shunyu Yao, Howard Chen, John Yang, Karthik Narasimhan

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments Project page with code, data, demos: https://webshop-pnlp.github.io. v3 is NeurIPS camera ready version. v4 fixes the choice oracle result as per https://github.com/princeton-nlp/WebShop/issues/15

Learning Generalized Zero-Shot Learners for Open-Domain Image Geolocalization

Lukas Haas, Silas Alberti, Michal Skreta

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Universal Multimodal Representation for Language Understanding

Zhuosheng Zhang, Kehai Chen, Rui Wang, Masao Utiyama, Eiichiro Sumita, Zuchao Li, Hai Zhao

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

Open-Vocabulary DETR with Conditional Matching

Yuhang Zang, Wei Li, Kaiyang Zhou, Chen Huang, Chen Change Loy

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments ECCV 2022 Oral

Noisy Symbolic Abstractions for Deep RL: A case study with Reward Machines

Andrew C. Li, Zizhao Chen, Pashootan Vaezipoor, Toryn Q. Klassen, Rodrigo Toro Icarte, Sheila A. McIlraith

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments NeurIPS Deep Reinforcement Learning Workshop 2022

Detect Only What You Specify : Object Detection with Linguistic Target

Moyuru Yamada

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Understanding the Evolution of Linear Regions in Deep Reinforcement Learning

Setareh Cohan, Nam Hee Kim, David Rolnick, Michiel van de Panne

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2022 camera ready

Example-Driven Model-Based Reinforcement Learning for Solving Long-Horizon Visuomotor Tasks

Bohan Wu, Suraj Nair, Li Fei-Fei, Chelsea Finn

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments Equal advising and contribution for last two authors

Ask Before You Act: Generalising to Novel Environments by Asking Questions

Ross Murphy, Sergey Mosesov, Javier Leguina Peral, Thymo ter Doest

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Multimodal Open-Vocabulary Video Classification via Pre-Trained Vision and Language Models

Rui Qian, Yeqing Li, Zheng Xu, Ming-Hsuan Yang, Serge Belongie, Yin Cui

专题命中 视觉定位与Grounding ：VLM(abstract)；分类 cs.CV、cs.LG

PROTOtypical Logic Tensor Networks (PROTO-LTN) for Zero Shot Learning

Simone Martone, Francesco Manigrasso, Lamberti Fabrizio, Lia Morra

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

A Distributional Approach for Soft Clustering Comparison and Evaluation

Andrea Campagner, Davide Ciucci, Thierry Denœux

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments This is the extended version of article "A Distributional Approach for Soft Clustering Comparison and Evaluation", accepted at BELIEF 2022 (http://hebergement.universite-paris-saclay.fr/belief2022/). Please cite the proceedings version of the article

RoViST:Learning Robust Metrics for Visual Storytelling

Eileen Wang, Caren Han, Josiah Poon

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Consensus Graph Representation Learning for Better Grounded Image Captioning

Wenqiao Zhang, Haochen Shi, Siliang Tang, Jun Xiao, Qiang Yu, Yueting Zhuang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments 9 pages, 5 figures, AAAI 2021

Adapting CLIP For Phrase Localization Without Further Training

Jiahao Li, Greg Shakhnarovich, Raymond A. Yeh

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Neural Fields in Visual Computing and Beyond

Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments Equal advising: Vincent Sitzmann and Srinath Sridhar

To Find Waldo You Need Contextual Cues: Debiasing Who's Waldo

Yiran Luo, Pratyay Banerjee, Tejas Gokhale, Yezhou Yang, Chitta Baral

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments Accepted at ACL 2022 (Short Paper)

Linking Emergent and Natural Languages via Corpus Transfer

Shunyu Yao, Mo Yu, Yang Zhang, Karthik R Narasimhan, Joshua B. Tenenbaum, Chuang Gan

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2022 Spotlight. Github repo: https://github.com/ysymyth/ec-nl

Possibility Before Utility: Learning And Using Hierarchical Affordances

Robby Costales, Shariq Iqbal, Fei Sha

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2022 camera-ready

Accelerating Integrated Task and Motion Planning with Neural Feasibility Checking

Lei Xu, Tianyu Ren, Georgia Chalvatzaki, Jan Peters

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments 6 pages, 6 figures,

When, Why, and Which Pretrained GANs Are Useful?

Timofey Grigoryev, Andrey Voynov, Artem Babenko

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG