arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.02473cs.LG
收藏

基于提示的时序领域泛化

Prompting-based Temporal Domain Generalization

Simon Fraser University(西蒙菲莎大学);Borealis AI

Sepidehsadat Hosseini, Mengyao Zhai, Hossein Hajimirsadegh, Frederick Tung

AI总结:

针对数据分布随时间变化导致模型泛化差的问题,提出基于提示的时序领域泛化方法,通过学习全局、领域特定和感知漂移的提示适应时间漂移,在分类、回归和预测任务上验证了其有效性与通用性。

摘要:

机器学习传统上假设训练和测试数据是独立同分布的。然而,在许多现实场景中,数据分布会随时间变化,导致训练好的模型在未来时间段泛化能力较差。本文提出了一种新颖的基于提示的时序领域泛化方法,该方法参数高效、时间高效,且在训练期间不需要访问未来数据。我们的方法通过学习全局提示、领域特定提示和感知漂移的提示来适应训练好的模型以应对时间漂移,这些提示能够捕捉潜在的时序动态。在分类、回归和时间序列预测任务上的实验证明了所提方法的通用性。代码仓库将公开分享。

英文摘要:

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of trained models in future time periods. This paper presents a novel prompting-based approach to temporal domain generalization that is parameter-efficient, time-efficient, and does not require access to future data during training. Our method adapts a trained model to temporal drift by learning global prompts, domain-specific prompts, and drift-aware prompts that capture underlying temporal dynamics. Experiments on classification, regression, and time series forecasting tasks demonstrate the generality of the proposed approach. The code repository will be publicly shared.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑