视觉大模型 / VLM

One Model for All Domains: Collaborative Domain-Prefix Tuning for Cross-Domain NER

Xiang Chen, Lei Li, Shuofei Qiao, Ningyu Zhang, Chuanqi Tan, Yong Jiang, Fei Huang, Huajun Chen

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments IJCAI 2023

UniBrain: Universal Brain MRI Diagnosis with Hierarchical Knowledge-enhanced Pre-training

Jiayu Lei, Lisong Dai, Haoyun Jiang, Chaoyi Wu, Xiaoman Zhang, Yao Zhang, Jiangchao Yao, Weidi Xie, Yanyong Zhang, Yuehua Li, Ya Zhang, Yanfeng Wang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes

Ran Gong, Jiangyong Huang, Yizhou Zhao, Haoran Geng, Xiaofeng Gao, Qingyang Wu, Wensi Ai, Ziheng Zhou, Demetri Terzopoulos, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments The first two authors contributed equally; 20 pages; 17 figures; project availalbe: https://arnold-benchmark.github.io/ ICCV 2023

Collecting Visually-Grounded Dialogue with A Game Of Sorts

Bram Willemsen, Dmytro Kalpakchi, Gabriel Skantze

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments Published at LREC 2022

Journal ref Proceedings of the Thirteenth Language Resources and Evaluation Conference (LREC 2022), pages 2257-2268, Marseille, France. European Language Resources Association

FACET: Fairness in Computer Vision Evaluation Benchmark

Laura Gustafson, Chloe Rolland, Nikhila Ravi, Quentin Duval, Aaron Adcock, Cheng-Yang Fu, Melissa Hall, Candace Ross

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Pretrained Language Models as Visual Planners for Human Assistance

Dhruvesh Patel, Hamid Eghbalzadeh, Nitin Kamra, Michael Louis Iuzzolino, Unnat Jain, Ruta Desai

专题命中 视觉定位与Grounding ：visual language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted at ICCV 2023

PØDA: Prompt-driven Zero-shot Domain Adaptation

Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Patrick Pérez, Raoul de Charette

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Accepted to ICCV 2023, Project Page: https://astra-vision.github.io/PODA/

Sample-Specific Debiasing for Better Image-Text Models

Peiqi Wang, Yingcheng Liu, Ching-Yun Ko, William M. Wells, Seth Berkowitz, Steven Horng, Polina Golland

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments Machine Learning for Healthcare Conference 2023

CLIP-Count: Towards Text-Guided Zero-Shot Object Counting

Ruixiang Jiang, Lingbo Liu, Changwen Chen

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted by ACM MM 2023

Simple Rule Injection for ComplEx Embeddings

Haodi Ma, Anthony Colas, Yuejie Wang, Ali Sadeghian, Daisy Zhe Wang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

$C^3$: Compositional Counterfactual Contrastive Learning for Video-grounded Dialogues

Hung Le, Nancy F. Chen, Steven C. H. Hoi

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments 24th Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL)

Fuzzy Logic Visual Network (FLVN): A neuro-symbolic approach for visual features matching

Francesco Manigrasso, Lia Morra, Fabrizio Lamberti

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments Accepted for publication at ICIAP 2023

Factoring the Matrix of Domination: A Critical Review and Reimagination of Intersectionality in AI Fairness

Anaelia Ovalle, Arjun Subramonian, Vagrant Gautam, Gilbert Gee, Kai-Wei Chang

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments To appear at AIES 2023

Journal ref 2023 AAAI/ACM Conference on AI, Ethics, and Society

CREPE: Learnable Prompting With CLIP Improves Visual Relationship Prediction

Rakshith Subramanyam, T. S. Jayram, Rushil Anirudh, Jayaraman J. Thiagarajan

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learning

Ini Oguntola, Joseph Campbell, Simon Stepputtis, Katia Sycara

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments To appear at ICML 2023 Workshop on Theory of Mind

Learning to Solve Constraint Satisfaction Problems with Recurrent Transformer

Zhun Yang, Adam Ishay, Joohyung Lee

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments 22 pages. The Eleventh International Conference on Learning Representations (ICLR 2023)

Embodied Task Planning with Large Language Models

Zhenyu Wu, Ziwei Wang, Xiuwei Xu, Jiwen Lu, Haibin Yan

专题命中 视觉定位与Grounding ：LLaVA(abstract)；分类 cs.CV、cs.AI

Comments Project Page: https://gary3410.github.io/TaPA

DesCo: Learning Object Recognition with Rich Language Descriptions

Liunian Harold Li, Zi-Yi Dou, Nanyun Peng, Kai-Wei Chang

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.LG

Peekaboo: Text to Image Diffusion Models are Zero-Shot Segmentors

Ryan Burgert, Kanchana Ranasinghe, Xiang Li, Michael S. Ryoo

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments 19 pages; contains appendix

Read, look and detect: Bounding box annotation from image-caption pairs

Eduardo Hugo Sanchez

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Dealing with Semantic Underspecification in Multimodal NLP

Sandro Pezzelle

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments To appear in the Proceedings of ACL 2023 (main conference). 13 pages, 3 figures

Learning to Ground Instructional Articles in Videos through Narrations

Effrosyni Mavroudi, Triantafyllos Afouras, Lorenzo Torresani

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

Comments 17 pages, 4 figures and 10 tables

"I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generation

Anaelia Ovalle, Palash Goyal, Jwala Dhamala, Zachary Jaggers, Kai-Wei Chang, Aram Galstyan, Richard Zemel, Rahul Gupta

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Journal ref 2023 ACM Conference on Fairness, Accountability, and Transparency

RLang: A Declarative Language for Describing Partial World Knowledge to Reinforcement Learning Agents

Rafael Rodriguez-Sanchez, Benjamin A. Spiegel, Jennifer Wang, Roma Patel, Stefanie Tellex, George Konidaris

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Language-Guided 3D Object Detection in Point Cloud for Autonomous Driving

Wenhao Cheng, Junbo Yin, Wei Li, Ruigang Yang, Jianbing Shen

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.AI

On Reality and the Limits of Language Data: Aligning LLMs with Human Norms

Nigel H. Collier, Fangyu Liu, Ehsan Shareghi

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.AI、cs.LG

Comments 9 pages; data available, see https://sites.google.com/site/nhcollier/projects/art

GlyphDiffusion: Text Generation as Image Generation

Junyi Li, Wayne Xin Zhao, Jian-Yun Nie, Ji-Rong Wen

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments working in progress

CLIP-S$^4$: Language-Guided Self-Supervised Semantic Segmentation

Wenbin He, Suphanut Jamonnak, Liang Gou, Liu Ren

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023

A Comprehensive Review of Data-Driven Co-Speech Gesture Generation

Simbarashe Nyatsanga, Taras Kucherenko, Chaitanya Ahuja, Gustav Eje Henter, Michael Neff

专题命中 视觉定位与Grounding ：grounding(abstract)；分类 cs.CV、cs.LG

Comments Accepted for EUROGRAPHICS 2023

VLPD: Context-Aware Pedestrian Detection via Vision-Language Semantic Self-Supervision

Mengyin Liu, Jie Jiang, Chao Zhu, Xu-Cheng Yin

专题命中 视觉定位与Grounding ：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted by CVPR 2023