DomainVerse: A Benchmark Towards Real-World Distribution Shifts For Tuning-Free Adaptive Domain Generalization
Institute of Computing Technology (ICT), Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Southeast University(东南大学);Lenovo Research(联想研究院);Lenovo Ltd.(联想有限公司)
Feng Hou, Jin Yuan, Ying Yang, Yang Liu, Yang Zhang, Cheng Zhong, Zhongchao Shi, Jianping Fan, Yong Rui, Zhiqiang He
Traditional cross-domain tasks, including domain adaptation and domain generalization, rely heavily on training model by source domain data. With the recent advance of vision-language models (VLMs), viewed as natural source models, the cross-domain task changes to directly adapt the pre-trained source model to arbitrary target domains equipped with prior domain knowledge, and we name this task Adaptive Domain Generalization (ADG). However, current cross-domain datasets have many limitations, such as unrealistic domains, unclear domain definitions, and the inability to fine-grained domain decomposition, which drives us to establish a novel dataset DomainVerse for ADG. Benefiting from the introduced hierarchical definition of domain shifts, DomainVerse consists of about 0.5 million images from 390 fine-grained realistic domains. With the help of the constructed DomainVerse and VLMs, we propose two methods called Domain CLIP and Domain++ CLIP for tuning-free adaptive domain generalization. Extensive and comprehensive experiments demonstrate the significance of the dataset and the effectiveness of the proposed methods.
Continual Adapter Tuning with Semantic Shift Compensation for Class-Incremental Learning
HUST AI & Visual Learning Lab (HAIV Lab)(华中科技大学人工智能与视觉学习实验室);Huazhong University of Science and Technology (HUST)(华中科技大学);Department of Computer Science(计算机科学系);Boston University(波士顿大学);ByteDance, Inc.(字节跳动公司)
University of Washington(华盛顿大学);OpenAI;Columbia University(哥伦比亚大学);Google Research(谷歌研究院);Allen Institute for Artificial Intelligence(艾伦人工智能研究所);Toyota Research Institute(丰田研究院)
Exploiting Layer Normalization Fine-tuning in Visual Transformer Foundation Models for Classification
Shanghai Academy of Artificial Intelligence for Science(上海人工智能科学研究院);Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学);University of Liverpool(利物浦大学);AI 3 Fudan University(复旦大学);Duke Kunshan University(杜克-昆山大学);BII, A ∗ STAR;Zhejiang University(浙江大学)
MetaTPT: Meta Test-time Prompt Tuning for Vision-Language Models
UCAS-Terminus AI Lab, University of Chinese Academic of Sciences(中国科学院大学Terminus AI实验室,中国科学院大学);AIM Lab, University of Amsterdam(阿姆斯特丹大学AIM实验室);Jarvis Research Center, Tencent Youtu Lab(腾讯优图实验室 Jarvis 研究中心);Central Research Institue, United Imaging Healthcare Co., Ltd(联合影像医疗科技有限公司中央研究所)
Quantifying and Mitigating Domain Shift in Peach Leaf Damage Classification: Attention Mechanisms and Fine-Tuning Strategies
Department of Information and Communication Engineering(信息与通信工程系);University of Murcia(穆尔西亚大学);Department of Irrigation, Centro de Edafología y Biología Aplicada del Segura CEBAS-CSIC(灌溉系,塞格拉应用土壤学与生物技术中心CEBAS-CSIC)
Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,计算机科学学院,北京大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院自动化研究所人工智能学院)