arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.20140cs.AI
收藏

通过噪声注入增强现成大语言模型在零样本时间序列预测中的性能

Enhancing Zero-Shot Time Series Forecasting in Off-the-Shelf LLMs via Noise Injection

Xingyou Yin, Ceyao Zhang, Min Hu, Kai Chen

AI总结:

本文提出通过在时间序列数据分词前注入噪声,提升现成大语言模型在零样本时间序列预测中的性能。

摘要:

大语言模型(LLMs)在零样本时间序列(TS)预测中已显示出有效性。关键挑战在于将时间序列数据转换为文本表示,以与LLM的预训练知识对齐。尽管现有工作常依赖于微调专用模块来弥合这一差距,但一种不同的、却具有挑战性的范式旨在利用真正的现成LLM,而无需任何微调,仅通过数值序列的战略文本化来实现。这些完全冻结模型的性能对输入数据的文本表示极为敏感,因为它们的参数无法适应分布变化。在本文中,我们引入了一种简单但高度有效的策略来克服这种脆弱性:在分词前向原始时间序列注入噪声。这种非侵入性的干预作为一种推理时间增强,迫使冻结的LLM基于稳健的底层时间模式进行外推,而不是表面的数值特征。我们从理论上分析了这一现象,并在多样本基准上经验验证了其有效性。值得注意的是,为了完全消除潜在的数据污染在LLM预训练期间可能引入的偏见,我们引入了两个新的时间序列数据集,这些数据集超出了所有使用LLM的预训练范围,并且一致观察到性能的提升。本研究为直接利用现成LLM进行时间序列预测提供了进一步的步骤。

英文摘要:

Large Language Models (LLMs) have demonstrated effectiveness as zero-shot time series (TS) forecasters. The key challenge lies in tokenizing TS data into textual representations that align with LLMs' pre-trained knowledge. While existing work often relies on fine-tuning specialized modules to bridge this gap, a distinct, yet challenging, paradigm aims to leverage truly off-the-shelf LLMs without any fine-tuning whatsoever, relying solely on strategic tokenization of numerical sequences. The performance of these fully frozen models is acutely sensitive to the textual representation of the input data, as their parameters cannot adapt to distribution shifts. In this paper, we introduce a simple yet highly effective strategy to overcome this brittleness: injecting noise into the raw time series before tokenization. This non-invasive intervention acts as a form of inference-time augmentation, compelling the frozen LLM to extrapolate based on robust underlying temporal patterns rather than superficial numerical artifacts. We theoretically analyze this phenomenon and empirically validate its effectiveness across diverse benchmarks. Notably, to fully eliminate potential biases from data contamination during LLM pre-training, we introduce two novel TS datasets that fall outside all utilized LLMs' pre-training scopes, and consistently observe improved performance. This study provides a further step in directly leveraging off-the-shelf LLMs for time series forecasting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑