Existing vision-language models (VLMs) such as CLIP have showcased an impressive capability to generalize well across various downstream tasks. These models leverage the synergy between visual and textual information, enabling them to understand and reason about the content present in images and text in a unified manner. This article provides a brief overview of CLIP based on few-shot prompt learning, including experimental data and technical characteristics of some methods. The purpose of this review is to provide a reference for researchers who have just started their research in generalizable prompting of CLIP through few-shot training for classification across 15 datasets and also to facilitate the integration of this field by researchers in other downstream tasks.
CILP-FGDI: Exploiting Vision-Language Model for Generalizable Person Re-Identification
School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education(教育部新一代人工智能技术及其交叉应用重点实验室(东南大学))
Beyond Semantic Priors: Mitigating Optimization Collapse for Generalizable Visual Forensics
Institute of Information Engineering, Chinese Academy of Sciences(信息工程研究所,中国科学院);School of Cyber Science and Technology, Beihang University(北京航空航天大学信息与科学学院)
Extracting Multimodal Learngene in CLIP: Unveiling the Multimodal Generalizable Knowledge
School of Computer Science and Engineering, Southeast University, Nanjing 210096, China(东南大学计算机科学与工程学院);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新一代人工智能技术及其跨学科应用关键实验室)
GLAD: Generalizable Tuning for Vision-Language Models
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院);Northeastern University(东北大学);The Hong Kong Polytechnic University(香港理工大学);Shenzhen University of Advanced Technology(深圳先进技术大学)
Adapt2Reward: Adapting Video-Language Models to Generalizable Robotic Rewards via Failure Prompts
School of Software Technology, Zhejiang University(浙江大学软件学院);School of Computer Sciene and Technology, Hangzhou Dianzi University(杭州电子科技大学计算机学院);China Mobile (Zhejiang) Research & Innovation Institute(中国移动(浙江)研究院);State Key Lab of CAD&CG, Zhejiang University(浙江大学CAD&CG国家重点实验室);The Hong Kong Polytechnic University(香港理工大学);Zhiyuan Research Institute(智源研究院);School of Computer Sciene and Technology, Xidian University(西安电子科技大学计算机学院)
Knowledge-Aware Prompt Tuning for Generalizable Vision-Language Models
United Imaging Healthcare(联影医疗);Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Southern University of Science and Technology(南方科技大学);The University of Hong Kong(香港大学)
DictAS: A Framework for Class-Generalizable Few-Shot Anomaly Segmentation via Dictionary Lookup
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Casivision;Longmen Laboratory(龙门实验室);HDU;UTS;UCLA(加州大学洛杉矶分校);Tsinghua University(清华大学)
CLARA: Clip-Level Multimodal Alignment with VLM-Derived Rationales for Hateful Video Detection
Institute for Analytics and Data Science, University of Essex(埃塞克斯大学分析与数据科学研究所);University of Exeter(埃克塞特大学);Queen Mary University of London(伦敦大学玛丽皇后学院)
NS-Net: Decoupling CLIP Semantic Information through NULL-Space for Generalizable AI-Generated Image Detection
Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology(数字取证工程研究中心,教育部,南京信息科技大学);University of Macau(澳门大学)
A CLIP-Powered Framework for Robust and Generalizable Data Selection
National Key Laboratory for Novel Software Technology, Nanjing University(南京大学新型软件技术国家重点实验室);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
MFCLIP: Multi-modal Fine-grained CLIP for Generalizable Diffusion Face Forgery Detection
Faculty of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences)(计算机科学与技术学院,齐鲁工业大学(山东科学院));School of Computing, National University of Singapore(computing 学院,新加坡国立大学);School of Computing and Information Technology, Great Bay University(computing 与信息学院,大湾大学);National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University(大数据系统计算技术国家工程实验室,深圳大学)
Towards Completeness: A Generalizable Action Proposal Generator for Zero-Shot Temporal Action Localization
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education(教育部机器智能与先进计算重点实验室);Guangdong Province Key Laboratory of Information Security Technology, Sun Yat-sen University(广东省信息安全技术重点实验室(中山大学))
A Hierarchical Semantic Distillation Framework for Open-Vocabulary Object Detection
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Peng Cheng Laboratory(鹏城实验室);Tongyi Lab, Alibaba Group(阿里巴巴集团通义实验室);Guangdong Key Laboratory of Information Security Technology, Sun Yat-sen University(中山大学广东省信息安全技术重点实验室);Key Laboratory of Machine Intelligence and Advanced Computing, Sun Yat-sen University, Ministry of Education(中山大学机器智能与先进计算教育部重点实验室)
Wavelet-Driven Generalizable Framework for Deepfake Face Forgery Detection
International Institute of Information Technology Hyderabad(印度信息技术学院海得拉巴分校);Indian Institute of Technology Hyderabad(印度理工学院海得拉巴分校);Michigan State University(密歇根州立大学)
Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection
Shenzhen Technology University(深圳技术大学);Singapore Institute of Technology(新加坡理工学院);The University of Hong Kong(香港大学);Nanyang Technological University(南洋理工大学)
Multimodal Causal-Driven Representation Learning for Generalizable Medical Image Segmentation
City University of Hong Kong(香港城市大学);Shenzhen Loop Area Institute(深圳河套学院);CAIR, HKISI, Chinese Academy of Sciences(中国科学院计算智能研究所);UESTC(电子科技大学);MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
The Illusion of Progress? A Critical Look at Test-Time Adaptation for Vision-Language Models
University of Science and Technology of China(中国科学技术大学);NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
DeeCLIP: A Robust and Generalizable Transformer-Based Framework for Detecting AI-Generated Images
Laboratory of IEMN, Univ. Polytechnique Hauts-de-France(里莫恩实验室,法国高等技术大学);Khalifa University(卡利法大学);Sorbonne Center for Artificial Intelligence, Sorbonne University(索邦人工智能中心,索邦大学)
C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detection
Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学研究所);School of Information Science and Engineering, Yanshan University(燕山大学信息科学与工程学院);School of Data Science, The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen)(香港中文大学(深圳)数据科学学院)