Vision-Language Models (VLMs) like CLIP struggle to understand negation, often embedding affirmatives and negatives similarly (e.g., matching "no dog" with dog images). Existing methods refine negation understanding via fine-tuning CLIP's text encoder, risking overfitting. In this work, we propose CLIPGlasses, a plug-and-play framework that enhances CLIP's ability to comprehend negated visual descriptions. CLIPGlasses adopts a dual-stage design: a Lens module disentangles negated semantics from text embeddings, and a Frame module predicts context-aware repulsion strength, which is integrated into a modified similarity computation to penalize alignment with negated semantics, thereby reducing false positive matches. Experiments show that CLIP equipped with CLIPGlasses achieves competitive in-domain performance and outperforms state-of-the-art methods in cross-domain generalization. Its superiority is especially evident under low-resource conditions, indicating stronger robustness across domains.
HANCLIP: A Family of Hyperbolic Angular Negation Vision Language Models
ADAPT Centre Dublin City University, Ireland(爱尔兰都柏林城市大学ADAPT中心);University of East Anglia Norwich, UK(英国东英吉利大学);Queen’s University Belfast Belfast, UK(英国贝尔法斯特女王大学);University of Science Vietnam National University Ho Chi Minh City, Vietnam(越南胡志明市国家大学理科大学)
ShotBench: Expert-Level Cinematic Understanding in Vision-Language Models
Tongji University(同济大学);The Chinese University of Hong Kong(香港中文大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);S-Lab, Nanyang Technological University(南洋理工大学S-Lab)
Alpha-CLIP: A CLIP Model Focusing on Wherever You Want
Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);University of Macau(澳门大学);MThreads, Inc.(摩尔线程公司);Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学)
RATLIP: Generative Adversarial CLIP Text-to-Image Synthesis Based on Recurrent Affine Transformations
School of Artificial Intelligence, Guangxi Colleges and Universities Key Laboratory of AI Algorithm Engineering(人工智能学院、广西 Colleges and Universities AI 算法工程重点实验室)
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
School of Electronic and Computer Engineering, Shenzhen Graduate School, Peking University(北京大学深圳研究生院电子与计算机工程学院);Peng Cheng Laboratory(鹏城实验室);Applied Research Center (ARC), Tencent PCG(腾讯PCG应用研究中心)