arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.05249cs.CEcs.AI
收藏

一种语言模型引导的具有分布偏移的时间序列挖掘框架

A Language Model-Guided Framework for Mining Time Series with Distributional Shifts

J.P. Morgan AI Research(摩根大通AI研究院)

Haibei Zhu, Yousef El-Laham, Elizabeth Fons, Svitlana Vyetrenko

AI总结:

本文提出利用大型语言模型和数据源接口收集与原始时间序列共享关键统计特性的外部数据集,以缓解分布偏移下数据稀缺问题,并通过微调时间序列预测基础模型验证其有效性。

摘要:

时间序列数据的有效利用往往受到数据量稀缺的限制,这些数据难以反映复杂动态,尤其是在分布偏移的条件下。现有数据集可能无法涵盖稳健且全面的分析所需的全部统计特性。此外,在金融和医疗等领域,隐私问题可能进一步限制其可获取性。本文提出一种利用大型语言模型和数据源接口来探索并收集时间序列数据集的方法。尽管收集到的数据来自外部来源,但它们与原始时间序列数据集共享关键的统计特性,从而使得对各种场景进行建模和适应成为可能。当原始数据有限或缺乏必要特性时,该方法能够扩大数据量。研究表明,收集到的数据集可以有效地补充现有数据集,尤其是在涉及数据分布变化的情况下。我们通过实际示例展示了所收集数据集的有效性,并表明在这些数据集上微调的时间序列预测基础模型能够取得与未进行微调的模型相当的性能。

英文摘要:

Effective utilization of time series data is often constrained by the scarcity of data quantity that reflects complex dynamics, especially under the condition of distributional shifts. Existing datasets may not encompass the full range of statistical properties required for robust and comprehensive analysis. And privacy concerns can further limit their accessibility in domains such as finance and healthcare. This paper presents an approach that utilizes large language models and data source interfaces to explore and collect time series datasets. While obtained from external sources, the collected data share critical statistical properties with primary time series datasets, making it possible to model and adapt to various scenarios. This method enlarges the data quantity when the original data is limited or lacks essential properties. It suggests that collected datasets can effectively supplement existing datasets, especially involving changes in data distribution. We demonstrate the effectiveness of the collected datasets through practical examples and show how time series forecasting foundation models fine-tuned on these datasets achieve comparable performance to those models without fine-tuning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑