Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training approach, wherein it learns a shared representation space for images and text, enabling cross-modal understanding. This model demonstrates the capability to understand the semantic relationships between diverse image and text pairs, allowing for efficient and accurate retrieval of images based on natural language queries. By training on a large-scale dataset containing images and their associated textual descriptions, CLIP achieves remarkable generalization, providing a powerful tool for tasks such as zero-shot learning and few-shot classification. This abstract summarizes the foundational principles of CLIP and highlights its potential impact on advancing the field of photo search, fostering a seamless integration of natural language understanding and computer vision for improved information retrieval in multimedia applications
AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIP
School of Biomedical Engineering, Division of Life Sciences and Medicine, USTC(中国科学技术大学生命科学与医学部生物医学工程学院);MIRACLE Center, Suzhou Institute for Advance Research, USTC(中国科学技术大学苏州高等研究院MIRACLE中心);Key Laboratory of Intelligent Information Processing of CAS, ICT, CAS(中国科学院计算技术研究所中国科学院智能信息处理重点实验室);State Key Laboratory of Precision and Intelligent Chemistry, USTC(中国科学技术大学精准与智能化学国家重点实验室);Stanford University(斯坦福大学)
Enhancing Zero-Shot Anomaly Detection: CLIP-SAM Collaboration with Cascaded Prompts
School of Artificial Intelligence, Anhui University, Hefei, China(人工智能学院,安徽大学,合肥,中国);Anhui Provincial Key Laboratory of Security Artificial Intelligence, Anhui University(安徽省安全人工智能重点实验室,安徽大学);Anhui Provincial Engineering Research Center for Unmanned System(安徽省无人系统与智能技术工程研究中心)
本文提出一种用于工业异常检测的两阶段零样本异常分割框架,协同利用 CLIP 的异常定位与 SAM 的边界感知能力,通过 PPG 和 CPS 模块优化点提示与分割精度,在 Visa 等数据集上取得 SOTA 表现。
CLIP4VI-ReID: Learning Modality-shared Representations via CLIP Semantic Bridge for Visible-Infrared Person Re-identification
Shandong Key Laboratory of Ubiquitous Intelligent Computing, School of Information Science and Engineering, University of Jinan(山东 ubiquitous 智能计算重点实验室,信息科学与工程学院,济南大学);College of Information Science and Technology & College of Artificial Intelligence, Nanjing Forestry University(信息科学与技术学院及人工智能学院,南京林业大学);Computer Systems Engineering Department, Universidad Politécnica de Madrid(计算机系统工程系,马德里理工大学)
AF-CLIP: Zero-Shot Anomaly Detection via Anomaly-Focused CLIP Adaptation
School of Computer Science and Engineering(计算机科学与工程学院);Sun Yat-sen University(中山大学);Guangdong Key Laboratory of Big Data Analysis and Processing(大数据分析与处理广东省重点实验室)
CLIP3D-AD: Extending CLIP for 3D Few-Shot Anomaly Detection with Multi-View Images Generation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人机混合增强智能全国重点实验室与人工智能与机器人研究所);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳));Xiamen University(厦门大学);Shenzhen University(深圳大学)
CIBR: Cross-modal Information Bottleneck Regularization for Robust CLIP Generalization
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校);Harvard Medical School(哈佛医学院);Wuhan University(武汉大学);Bowling Green State University(鲍灵格林州立大学);University of California, Irvine(加州大学欧文分校);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
Enhancing Concept Localization in CLIP-based Concept Bottleneck Models
Unité d’Informatique et d’Ingénierie des Systèmes ENSTA Paris, Institut Polytechnique de Paris(ENSTA巴黎信息与系统工程单位,巴黎理工学院);Department of Information Engineering and Computer Science University of Trento(信息工程与计算机科学系,特伦托大学)
fine-CLIP: Enhancing Zero-Shot Fine-Grained Surgical Action Recognition with Vision-Language Models
University of Strasbourg(斯特拉斯堡大学);CNRS(法国国家科学研究中心);INSERM(法国国家健康与医学研究院);ICube(ICube实验室);IHU Strasbourg(斯特拉斯堡大学医院研究所);University Hospital of Strasbourg(斯特拉斯堡大学医院)
Know "No" Better: A Data-Driven Approach for Enhancing Negation Awareness in CLIP
Department of Electrical and Computer Engineering, Seoul National University(首尔国立大学电子与计算机工程系);Amazon(亚马逊);Samsung Research(三星研究院);School of Computer Science and Engineering, Soongsil University(顺天大学计算机科学与工程学院);IPAI, AIIS, ASRI, INMC, and ISRC, Seoul National University(首尔国立大学IPAI、AIIS、ASRI、INMC和ISRC)
Enhancing Vision-Language Model with Unmasked Token Alignment
Institute for AI Industry Research (AIR)(人工智能产业研究院);Tsinghua University(清华大学);Sensetime Research(商汤科技研究院);CPII under InnoHK(InnoHK下属CPII);Shanghai AI Laboratory(上海人工智能实验室)