The black-box domain adaptation (BBDA) topic is developed to address the privacy and security issues where only an application programming interface (API) of the source model is available for domain adaptations. Although the BBDA topic has attracted growing research attentions, existing works mostly target the vision applications and are not directly applicable to the time-series applications possessing unique spatio-temporal characteristics. In addition, none of existing approaches have explored the strength of foundation model for black box time-series domain adaptation (BBTSDA). This paper proposes a concept of Cross-Prompt Foundation Model (CPFM) for the BBTSDA problems. CPFM is constructed under a dual branch network structure where each branch is equipped with a unique prompt to capture different characteristics of data distributions. In the domain adaptation phase, the reconstruction learning phase in the prompt and input levels is developed. All of which are built upon a time-series foundation model to overcome the spatio-temporal dynamic. Our rigorous experiments substantiate the advantage of CPFM achieving improved results with noticeable margins from its competitors in three time-series datasets of different application domains.
Low-Rank Adaptation for Foundation Models: A Comprehensive Review
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Yale University(耶鲁大学);Nanyang Technological University(南洋理工大学);Central University of Finance and Economics(中央财经大学);The Chinese University of Hong Kong(香港中文大学);Xi’an University of Electronic Science and Technology(西安电子科技大学);University of California, Davis(加州大学戴维斯分校);The University of Cambridge(剑桥大学);LOGS AI
Unsupervised Domain Adaptation for Segmentation with Black-box Source Model
Gordon Center for Medical Imaging, Massachusetts General Hospital and Harvard Medical School(戈登医学影像中心,麻省总医院与哈佛医学院);Ewha Womans University(梨花女子大学);University of Southern California(南加州大学)
Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models
Technical University of Munich(慕尼黑工业大学);Hong Kong Baptist University(香港浸会大学);Aalto University(阿尔托大学);University of Oulu(奥卢大学);University of Bonn(波恩大学);EPFL(洛桑联邦理工学院)
Box Pose and Shape Estimation and Domain Adaptation for Large-Scale Warehouse Automation
Laboratory for Information & Decision Systems (LIDS)(信息与决策系统实验室);Massachusetts Institute of Technology(麻省理工学院);Symbotic(Symbotic公司);Vector Institute University of Toronto(多伦多大学向量研究所)
South China University of Technology(华南理工大学);Hong Kong Polytechnic University(香港理工大学)
在本文中,我们研究了一个可以说是最少的限制设置的领域自适应在实际部署的意义上,只有源模型的接口是可用的目标域,并允许两个域之间的标签空间关系是不同的和未知的。我们将这样的设置称为通用黑盒领域自适应(UB $^2$ DA)。然而,由于领域自适应只能通过访问源模型的接口,依赖于部分重叠标签空间中未标记目标数据的预测,因此UB $^2$ DA带来了巨大的学习挑战。为了应对这些挑战,我们首先注意到学习任务可以转换为类内\footnote{In this paper we use in-class (out-class) to describe the classes observed (not observed) in the source black-box model.}判别和类外检测两个子任务,它们可以分别通过模型蒸馏和熵分离来学习。我们建议将它们统一到一个自训练框架中,通过目标样本局部邻域中预测的一致性进行正则化。我们的框架是简单的,强大的,易于优化。在领域自适应基准上的实验表明了该方法的有效性。值得注意的是,通过仅访问源模型的接口,我们的框架优于现有的通用领域自适应方法,这些方法利用源数据和/或源模型,具有新提出的(并且可以说是更合理的)H分数度量,并且与平均类准确度度量的性能相当。
Prototypical Distillation and Debiased Tuning for Black-box Unsupervised Domain Adaptation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);University of Science and Technology of China(中国科学技术大学);School of Intelligence Science and Technology, University of Science and Technology Beijing(北京科技大学智能科学与技术学院)
Adaptive Dual-Teacher Distillation with Subnetwork Rectification for Bridging Semantic Gaps in Black-Box Domain Adaptation
School of Computer Science and Engineering, Tianjin University of Technology(天津理工大学计算机科学与工程学院);School of Artificial Intelligence, Tianjin University(天津大学人工智能学院)
Towards Foundation Model for Chemical Reactor Modeling: Meta-Learning with Physics-Informed Adaptation
Department of Chemical and Biomolecular Engineering, National University of Singapore(化学与生物分子工程系,新加坡国立大学);Artificial Intelligence Institute, National University of Singapore(人工智能研究所,新加坡国立大学)
AutoMiSeg: Automatic Medical Image Segmentation via Test-Time Adaptation of Foundation Models
Carnegie Mellon University(卡内基梅隆大学);Brown University(布朗大学);National Institute of Technology Karnataka(印度卡纳塔克国家理工学院);University of Pittsburgh(匹兹堡大学);University of Alabama at Birmingham(阿拉巴马大学伯明翰分校)
MEMTS: Internalizing Domain Knowledge via Parameterized Memory for Retrieval-Free Domain Adaptation of Time Series Foundation Models
East China Normal University(东华师范大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Peking University(北京大学);University of Chinese Academy of Sciences(中国科学院大学)
Bayesian Low-Rank Factorization for Robust Model Adaptation
Interactive Systems Lab, Karlsruhe Institut of Technology (KIT), Germany(交互系统实验室,卡尔斯鲁厄理工学院(KIT),德国);InterACT, Carnegie Mellon University (CMU), USA(InterACT,卡内基梅隆大学(CMU),美国)
LFM: Leveraging Foundation Models for Source-Free Universal Domain Adaptation
School of Computer Science and Engineering, Tianjin University of Technology(天津理工大学计算机科学与工程学院);Engineering Research Center of Learning-Based Intelligent System, Ministry of Education of the People’s Republic of China, Tianjin University of Technology(中华人民共和国教育部基于学习的智能系统工程研究中心,天津理工大学);School of Artificial Intelligence, Tianjin University(天津大学人工智能学院);Engineering Research Center of City Intelligence and Digital Governance, Ministry of Education of the People’s Republic of China, Tianjin University(中华人民共和国教育部城市智能与数字治理工程研究中心,天津大学)
ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning
Tsinghua University(清华大学);Microsoft Research(微软研究院);Idiap Research Institute(Idiap研究所);UIUC(伊利诺伊大学厄巴纳-香槟分校);Chinese Academy of Sciences(中国科学院);Hong Kong University of Science and Technology(香港科技大学)
VESSA: Video-based objEct-centric Self-Supervised Adaptation for Visual Foundation Models
Departamento de Ciência da Computação, Universidade Federal de Minas Gerais (UFMG)(巴西联邦大学矿务学院计算机科学系(UFMG));Recod.ai, Instituto de Computação, Universidade Estadual de Campinas (UNICAMP)(Recod.ai,计算机学院,坎皮纳斯州立大学(UNICAMP));Google DeepMind(谷歌DeepMind)