Although massive pre-trained vision-language models like CLIP show impressive generalization capabilities for many tasks, still it often remains necessary to fine-tune them for improved performance on specific datasets. When doing so, it is desirable that updating the model is fast and that the model does not lose its capabilities on data outside of the dataset, as is often the case with classical fine-tuning approaches. In this work we suggest a lightweight adapter, that only updates the models predictions close to seen datapoints. We demonstrate the effectiveness and speed of this relatively simple approach in the context of few-shot learning, where our results both on classes seen and unseen during training are comparable with or improve on the state of the art.
iLoRA: Bayesian Low-Rank Adaptation with Latent Interaction Graphs for Microbiome Diagnosis
University of Copenhagen, Copenhagen, Denmark;Rutgers University, New Brunswick, NJ, USA;Section of Health Data Science \& AI, Department of Public Health, University of Copenhagen, Copenhagen, Denmark;MRC Centre for Global Infectious Disease Analysis, Department of Infectious Disease Epidemiology, School of Public Health, Faculty of Medicine, Imperial College London, London, United Kingdom
Localized Latent Editing for Dose-Response Modeling in Botulinum Toxin Injection Planning
Univ. Lille, CNRS, Centrale Lille, Institut Mines-Télécom, UMR 9189 CRIStAL(里尔大学、国家科学研究中心、Centrale Lille、Institut Mines-Télécom、UMR 9189 CRIStAL);IMT Nord Europe, Institut Mines-Télécom, Univ. Lille, Centre for Digital Systems(IMT Nord Europe、Institut Mines-Télécom、里尔大学、数字系统中心);Lille University Hospital (CHU), Department of Plastic Surgery(里尔大学医院(CHU)、整形外科部门);SATT Nord
Energy-based Latent Aligner for Incremental Learning
Indian Institute of Technology Hyderabad(印度理工学院海得拉巴分校);Mohamed bin Zayed University of AI(穆罕默德·本·扎耶德人工智能大学);Australian National University(澳大利亚国立大学);Linköping University(林雪平大学);Aalto University(阿尔托大学)
Affine-Equivariant Kernel Space Encoding for NeRF Editing
Poznan University of Technology, Institute of Robotics and Machine Intelligence(波兹南技术大学机器人与机器智能研究所);Jagiellonian University, Faculty of Mathematics and Computer Science(雅盖隆大学数学与计算机科学学院);IDEAS Research Institute(IDEAS研究所)
Controllable Localized Face Anonymization Via Diffusion Inpainting
Center for Machine Vision and Signal Analysis (CMVS)(机器视觉与信号分析中心);University of Oulu(奥卢大学);ELLIS Institute Finland(芬兰ELLIS研究所);The Machine Learning Group(机器学习小组);UiT The Arctic University of Norway(挪威北冰洋大学)