arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.19635cs.LGcs.CV
收藏

面向时序无源无监督域适应的时序源恢复

Temporal Source Recovery for Time-Series Source-Free Unsupervised Domain Adaptation

Institute for Infocomm Research, A ∗ STAR, Singapore(信息与通信研究所,新加坡A ∗ STAR);School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore(电气与电子工程学院,南洋理工大学);College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics, China(人工智能学院,南京航空航天大学);Fraunhofer Institute for Integrated Circuits, Germany(弗劳恩霍夫集成电路研究所,德国);College of Computing and Data Science, Nanyang Technological University, Singapore(计算与数据科学学院,南洋理工大学)

Yucheng Wang, Peiliang Gong, Min Wu, Felix Ott, Xiaoli Li, Lihua Xie, Zhenghua Chen

AI总结:

针对现有无源无监督域适应方法难迁移时序依赖、需源域特定预训练的问题,提出TemSR框架,通过掩码恢复等技术生成类源域并恢复时序依赖,在无需源数据的情况下实现有效时序域适应,性能超越同类需源域设计的方法。

摘要:

随着传感器等物联网设备的兴起,时序(TS)数据的重要性日益提升,但这类数据的标注成本高昂且过程复杂。无监督域适应(UDA)虽能提供有效解决方案,但日益严峻的数据隐私问题推动了无源无监督域适应(SFUDA)的发展,该技术可在无需访问源数据的前提下,让模型适配目标域。尽管SFUDA潜力可观,但将现有SFUDA方法应用于时序数据仍面临挑战,原因在于时序数据的核心特征——时序依赖关系难以迁移,尤其是在没有源样本的情况下。此前的研究尝试通过特定的源预训练设计解决这一问题,但这类要求往往不切实际,因为无法要求源数据所有者遵循特定的预训练方案。为解决该问题,我们提出时序源恢复(TemSR)框架,该框架利用时序数据的固有属性生成类源域,并恢复源域的时序依赖关系。借助该域,TemSR无需访问源数据,也不依赖源域特定设计,即可实现依赖关系向目标域的迁移,从而推动有效且实用的时序无源无监督域适应(TS-SFUDA)落地。TemSR采用掩码恢复优化流程,生成时序依赖关系已修复的类源分布;该分布进一步通过局部上下文感知正则化优化,以保留局部依赖关系,同时通过基于锚点的恢复多样性最大化提升分布多样性。这些组件共同实现了有效的时序依赖恢复,并可借助标准UDA技术推动跨域迁移。我们在多个时序任务上开展了大量实验,结果证明了TemSR的有效性,其性能甚至超越了现有需要源域特定设计的TS-SFUDA方法。

英文摘要:

Time-Series (TS) data has grown in importance with the rise of Internet of Things devices like sensors, but its labeling remains costly and complex. While Unsupervised Domain Adaptation (UDAs) offers an effective solution, growing data privacy concerns have led to the development of Source-Free UDA (SFUDAs), enabling model adaptation to target domains without accessing source data. Despite their potential, applying existing SFUDAs to TS data is challenging due to the difficulty of transferring temporal dependencies, an essential characteristic of TS data, particularly in the absence of source samples. Although prior works attempt to address this by specific source pretraining designs, such requirements are often impractical, as source data owners cannot be expected to adhere to particular pretraining schemes. To address this, we propose Temporal Source Recovery (TemSR), a framework that leverages the intrinsic properties of TS data to generate a source-like domain and recover source temporal dependencies. With this domain, TemSR enables dependency transfer to the target domain without accessing source data or relying on source-specific designs, thereby facilitating effective and practical TS-SFUDA. TemSR features a masking recovery optimization process to generate a source-like distribution with restored temporal dependencies. This distribution is further refined through local context-aware regularization to preserve local dependencies, and anchor-based recovery diversity maximization to promote distributional diversity. Together, these components enable effective temporal dependency recovery and facilitate transfer across domains using standard UDA techniques. Extensive experiments across multiple TS tasks demonstrate the effectiveness of TemSR, which even surpasses existing TS-SFUDA methods that require source-specific designs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑