Domain generalization (DG), aiming to make models work on unseen domains, is a surefire way toward general artificial intelligence. Limited by the scale and diversity of current DG datasets, it is difficult for existing methods to scale to diverse domains in open-world scenarios (e.g., science fiction and pixelate style). Therefore, the source-free domain generalization (SFDG) task is necessary and challenging. To address this issue, we propose an approach based on large-scale vision-language pretraining models (e.g., CLIP), which exploits the extensive domain information embedded in it. The proposed scheme generates diverse prompts from a domain bank that contains many more diverse domains than existing DG datasets. Furthermore, our method yields domain-unified representations from these prompts, thus being able to cope with samples from open-world domains. Extensive experiments on mainstream DG datasets, namely PACS, VLCS, OfficeHome, and DomainNet, show that the proposed method achieves competitive performance compared to state-of-the-art (SOTA) DG methods that require source domain data for training. Besides, we collect a small datasets consists of two domains to evaluate the open-world domain generalization ability of the proposed method. The source code and the dataset will be made publicly available at https://github.com/muse1998/Source-Free-Domain-Generalization
Prompt Disentanglement via Language Guidance and Representation Alignment for Domain Generalization
School of Telecommunications Engineering, the State Key Laboratory of Integrated Services Networks (ISN), Xidian University, Xi’an, China(电信工程学院、集成服务网络国家重点实验室(ISN)、西安电子科技大学);Microsoft Research Asia, Shanghai, China(微软亚洲研究院,上海,中国)
Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所);School of Electrical Engineering, Xi’an University of Technology(西安理工大学电气工程学院)
PromptIQA: Boosting the Performance and Generalization for No-Reference Image Quality Assessment via Prompts
State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA(中国科学院自动化研究所多模态人工智能系统国家重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院);OPPO(OPPO公司)
Prompt-Driven Dynamic Object-Centric Learning for Single Domain Generalization
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);School of Electronic Engineering, Xidian University(西安电子科技大学电子工程学院);Peng Cheng Laboratory(鹏城实验室)
From Adaptation to Generalization: Adaptive Visual Prompting for Medical Image Segmentation
Technical University of Munich(慕尼黑技术大学);Korea University(韩国大学);Kyung Hee University(庆熙大学);Seoul National University of Science and Technology(首尔科学技术大学)
BioVLM: Routing Prompts, Not Parameters, for Cross-Modality Generalization in Biomedical VLMs
University of Trento(特伦托大学);Carnegie Mellon University(卡内基梅隆大学);LNMIIT Jaipur(贾伊普尔 LNMIIT);MBZUAI;Sunandan Divatia School of Science(Sunandan Divatia 科学学院);IIT Bombay(博伊斯大学)
Concept-Guided Prompt Learning for Generalization in Vision-Language Models
Harbin Institute of Technology(哈尔滨工业大学);Southern University of Science and Technology(南方科技大学);Carnegie Mellon University(卡内基梅隆大学);Pengcheng Laboratory(鹏城实验室)
Cluster-Aware Neural Collapse Prompt Tuning for Long-Tailed Generalization of Vision-Language Models
Hangzhou Dianzi University(杭州电子科技大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);The Hong Kong Polytechnic University(香港理工大学);Macao Polytechnic University(澳门理工学院);Zhejiang Provincial Key Laboratory of Low Altitude Ubiquitous Networking Technology, HDU(浙江省低空 ubiquitous 网络技术重点实验室,HDU)
Prompt-Free Lightweight SAM Adaptation for Histopathology Nuclei Segmentation with Strong Cross-Dataset Generalization
School of Information and Communication Technology, Griffith University, QLD, Australia(信息与通信技术学院,格里菲斯大学,昆士兰,澳大利亚);School of MDP -- Clinical Medicine, Griffith University, QLD, Australia(MDP临床医学学院,格里菲斯大学,昆士兰,澳大利亚)
CoDoL: Conditional Domain Prompt Learning for Out-of-Distribution Generalization
East China Normal University(东华师范大学);Xidian University(西安电子科技大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));The University of Oxford(牛津大学);Tsinghua University(清华大学)
Domain Generalization for Face Anti-spoofing via Content-aware Composite Prompt Engineering
School of Computer Science, Hefei University of Technology(合肥工业大学计算机学院);State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);School of Electronic Information Engineering, Taiyuan University of Technology(太原理工大学电子信息工程学院);School of Computer Science and Engineering, Faculty of Innovation Engineering, Macau University of Science and Technology(澳门科技大学创新工程学院计算机科学与工程学院);School of Cyber Science and Engineering, Wuhan University(武汉大学网络空间安全学院)
GA2-CLIP: Generic Attribute Anchor for Efficient Prompt Tuningin Video-Language Models
Shandong Provincial Key Laboratory of New Power Distribution & Utilization Technology and Equipment, School of Electrical and Electronic Engineering, Shandong University of Technology(山东省新型电力分布与利用技术及设备重点实验室,山东理工大学电气与电子工程学院);School of Computer Science and Technology, Shandong University of Technology(山东理工大学计算机科学与技术学院);School of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics(南京航空航天大学人工智能学院);Pillar of Information Systems Technology and Design, Singapore University of Technology and Design(新加坡科技设计大学信息系统技术与设计 pillar);School of Control Science and Engineering, Shandong University(山东大学控制科学与工程学院)
Department of Computer Science and Engineering, Southern University of Science and Technology(南方科技大学计算机科学与工程系);Department of Computer Science and Engineering, Hong Kong University of Science and Technology(香港科技大学计算机科学与工程系);School of Information and Control Engineering, China University of Mining and Technology(中国矿业大学信息与控制工程学院)
Fully Automated SAM for Single-source Domain Generalization in Medical Image Segmentation
Anhui Provincial Key Laboratory of Multimodal Cognitive Computation(安徽省多模态认知计算重点实验室);School of Computer Science and Technology(计算机科学与技术学院);Anhui University(安徽大学)
针对 SAM 医学分割依赖专家提示且易受劣质提示误导的问题,提出 FA-SAM,通过 AGM-SUFM 自动生成边界框并用 IPEF 融合图像与提示嵌入,在前列腺和眼底血管数据集上验证有效。
Bayesian Prompt Learning for Image-Language Model Generalization
University of Amsterdam(阿姆斯特丹大学);Samsung AI Cambridge(三星人工智能剑桥研究院);Technical University of Iasi(雅西技术大学);University of Trento(特伦托大学);Queen Mary University of London(伦敦玛丽女王大学)