Few-shot adaptation of vision-language models (VLMs) like CLIP typically relies on learning textual prompts matched to global image embeddings. Recent works extend this paradigm by incorporating local image-text alignment to capture fine-grained visual cues, yet these approaches often select local regions independently for each prompt, leading to redundant local feature usage and prompt overlap. We propose SOT-GLP, which introduces a shared sparse patch support and balanced optimal transport allocation to explicitly partition salient visual regions among class-specific local prompts while preserving global alignment. Our method learns shared global prompts and class-specific local prompts. The global branch maintains standard image-text matching for robust category-level alignment. The local branch constructs a class-conditioned sparse patch set using V-V attention and aligns it to multiple class-specific prompts via balanced entropic optimal transport, yielding a soft partition of patches that prevents prompt overlap and collapse. We evaluate our method on two complementary objectives: (i) few-shot classification accuracy on 11 standard benchmarks and (ii) out-of-distribution (OOD) detection. On the standard 11-dataset benchmark with 16-shot ViT-B/16, SOT-GLP achieves 85.1% average accuracy, outperforming prior prompt-learning methods. We identify a distinct accuracy-robustness trade-off in prompt learning: while learnable projections optimize in-distribution fit, they alter the foundational feature space. We demonstrate that a projection-free local alignment preserves the native geometry of the CLIP manifold, yielding state-of-the-art OOD detection performance (94.2% AUC) that surpasses fully adapted models. Implementation available at: https://github.com/Deniz2304988/SOT-GLP
GRASP: Guided Region-Aware Sparse Prompting for Adapting MLLMs to Remote Sensing
School of Computing, Kyung Hee University(京畿大学计算机学院);School of Information and Software Engineering, University of Electronic Science and Technology of China(电子科技大学信息与软件工程学院);School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);College of Computer Science and Information Engineering, Harbin Normal University(哈尔滨师范大学计算机科学与信息工程学院);College of Professional and Continuing Education, The Hong Kong Polytechnic University(香港理工大学专业及继续教育学院);School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院)
PLOT: Prompt Learning with Optimal Transport for Vision-Language Models
Carnegie Mellon University(卡内基梅隆大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Tsinghua University(清华大学);New York University(纽约大学)
Prompt-OT: An Optimal Transport Regularization Paradigm for Knowledge Preservation in Vision-Language Model Adaptation
Morgan Stanley(摩根士丹利);Clemson University(克莱姆森大学);Arizona State University(亚利桑那州立大学);Washington University in St. Louis(圣路易斯华盛顿大学);University of Arizona(亚利桑那大学);University of Notre Dame(圣母大学)
Dude: Dual Distribution-Aware Context Prompt Learning For Large Vision-Language Model
University of Stuttgart(斯图加特大学);German Research Center for Artificial Intelligence(德国人工智能研究中心);Max Planck Research School for Intelligent Systems(马克斯·普朗克智能系统研究学校);Technical University of Darmstadt(达姆施塔特工业大学);Technical University of Munich(慕尼黑工业大学);United States Naval Academy(美国海军学院);Oldenburg University(奥尔登堡大学);University of Pennsylvania(宾夕法尼亚大学)
Beyond Low-Rank: Low-Rank Sparse Prompting via Spiking Neural Network and Prompt Factorization
Information Materials and Intelligent Sensing Laboratory of Anhui Province(安徽省信息材料与智能感知实验室);Anhui Provincial Key Laboratory of Multimodal Cognitive Computation(安徽省多模态认知计算重点实验室);School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院)
NLPrompt: Noise-Label Prompt Learning for Vision-Language Models
ShanghaiTech University(上海科技大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));RIKEN Center for Advanced Intelligence Project(日本RIKEN高级智能项目中心);University of Technology Sydney(悉尼科技大学);University of Melbourne(墨尔本大学)
Exploring Sparse Visual Prompt for Domain Adaptive Dense Prediction
Peking University(北京大学);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));University of Science and Technology of China(中国科学技术大学);Beihang University(北京航空航天大学)
Sparse Anatomical Prompt Semi-Supervised Learning with Masked Image Modeling for CBCT Tooth Segmentation
Institute of Innovative Research, Tokyo Institute of Technology(东京工业大学创新研究院);Stomatological Hospital of Chongqing Medical University(重庆医科大学附属口腔医院);School of Mechanical Engineering, Zhejiang University(浙江大学机械工程学院)
Prompt Guiding Multi-Scale Adaptive Sparse Representation-driven Network for Low-Dose CT MAR
School of Information Science and Engineering, Yanshan University(信息科学与工程学院,燕山大学);School of Electronics and Information Technology, Sun Yat-sen University(电子与信息学院,中山大学);School of Computer Science and Technology, Beijing Institute of Technology(计算机科学与技术学院,北京理工大学);Institute of High Performance Computing, Agency for Science, Technology and Research(高性能计算研究所,科技研究局);Institute of Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(生物医学成像研究所以及深圳先进技术研究所,中国科学院)
Sparse Needlets for Lighting Estimation with Spherical Transport Loss
Nanyang Technological University(南洋理工大学);DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);Inception Institute of Artificial Intelligence(启元人工智能研究院);The Chinese University of Hong Kong(香港中文大学)
MADPOT: Medical Anomaly Detection with CLIP Adaptation and Partial Optimal Transport
Department of Computer Science, University of Verona(威尼斯大学计算机科学系);AI for Good (AIGO) Research Unit, Istituto Italiano di Tecnologia(意大利技术研究院人工智能为善研究单元)
Prompt Learning for Oriented Power Transmission Tower Detection in High-Resolution SAR Images
Key Laboratory of Digital Earth Science, Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院数字地球科学重点实验室);International Research Center of Big Data for Sustainable Development Goals(可持续发展目标大数据国际研究中心);College of Resources and Environment, University of Chinese Academy of Sciences(中国科学院大学资源与环境学院)
Point-Based 3D Reconstruction from Sparse Views under Known Illumination
Aalborg University(奥尔堡大学);Centre for Software Technology, University of Southern Denmark(南丹麦大学软件技术中心);Pioneer Centre for Artificial Intelligence(先锋人工智能中心);Technical University of Denmark(丹麦技术大学);Technische Universität Berlin(柏林工业大学)
Conditioned Activation Transport for T2I Safety Steering
NASK National Research Institute(NASK国家研究所);Warsaw University of Technology(华沙技术大学);IDEAS Research Institute(IDEAS研究 institute);CISPA Helmholtz Center for Information Security(CISPA海德堡中心 for 信息安全)