arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.20307cs.LG
收藏

上下文预训练时间序列基础模型适应于未见任务

In-context Pre-trained Time-Series Foundation Models adapt to Unseen Tasks

Georgia Institute of Technology(佐治亚理工学院)

Shangqing Xu, Harshavardhan Kamarthi, Haoxin Liu, B. Aditya Prakash

AI总结:

本文提出ICTP框架,通过增强时间序列基础模型的上下文学习能力,使其无需微调即可提升在未见任务上的性能。

摘要:

时间序列基础模型(TSFMs)在多样数据集和任务上展示了强大的泛化能力。然而,现有基础模型通常在特定任务上进行预训练以提高性能,且在没有微调的情况下难以泛化到未见任务。为了解决这一限制,我们提出了通过增强TSFMs的上下文学习(ICL)能力,使其能够通过动态适应输入输出关系来执行测试时间推断。我们的框架,即上下文时间序列预训练(ICTP),重新组织原始预训练数据,使基础TSFM具备ICL能力,从而适应未见任务。实验表明,ICT在不需微调的情况下,使最先进的TSFMs在未见任务上的性能提升了约11.4%。

英文摘要:

Time-series foundation models (TSFMs) have demonstrated strong generalization capabilities across diverse datasets and tasks. However, existing foundation models are typically pre-trained to enhance performance on specific tasks and often struggle to generalize to unseen tasks without fine-tuning. To address this limitation, we propose augmenting TSFMs with In-Context Learning (ICL) capabilities, enabling them to perform test-time inference by dynamically adapting to input-output relationships provided within the context. Our framework, In-Context Time-series Pre-training (ICTP), restructures the original pre-training data to equip the backbone TSFM with ICL capabilities, enabling adaptation to unseen tasks. Experiments demonstrate that ICT improves the performance of state-of-the-art TSFMs by approximately 11.4% on unseen tasks without requiring fine-tuning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑