Time series modeling techniques based on deep learning have seen many advancements in recent years, especially in data-abundant settings and with the central aim of learning global models that can extract patterns across multiple time series. While the crucial importance of appropriate data pre-processing and scaling has often been noted in prior work, most studies focus on improving model architectures. In this paper we empirically investigate the effect of data input and output transformations on the predictive performance of several neural forecasting architectures. In particular, we investigate the effectiveness of several forms of data binning, i.e. converting real-valued time series into categorical ones, when combined with feed-forward, recurrent neural networks, and convolution-based sequence models. In many non-forecasting applications where these models have been very successful, the model inputs and outputs are categorical (e.g. words from a fixed vocabulary in natural language processing applications or quantized pixel color intensities in computer vision). For forecasting applications, where the time series are typically real-valued, various ad-hoc data transformations have been proposed, but have not been systematically compared. To remedy this, we evaluate the forecasting accuracy of instances of the aforementioned model classes when combined with different types of data scaling and binning. We find that binning almost always improves performance (compared to using normalized real-valued inputs), but that the particular type of binning chosen is of lesser importance.
From Values to Tokens: An LLM-Driven Framework for Context-aware Time Series Forecasting via Symbolic Discretization
State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室);University of Science and Technology of China(中国科学技术大学);College of Intelligence and Computing(智能科学与计算学院);iFLYTEK Research(iFLYTEK研究院)
Lag Selection for Univariate Time Series Forecasting using Deep Learning: An Empirical Study
Faculdade de Ciências da Universidade do Porto(波尔图大学理学院);Faculdade de Engenharia da Universidade do Porto(波尔图大学工程学院);Laboratory for Artificial Intelligence and Computer Science (LIACC)(人工智能与计算机科学实验室(LIACC));Fraunhofer Portugal AICOS(弗劳恩霍夫葡萄牙AICOS机构)
A New Unified Deep Learning Approach with Decomposition-Reconstruction-Ensemble Framework for Time Series Forecasting
Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);School of Mathematical Sciences, University of Chinese Academy of Sciences(中国科学院大学数学科学学院);School of Management, Xi'an Jiaotong University(西安交通大学管理学院)
Energy Price Modelling: A Comparative Evaluation of four Generations of Forecasting Methods
Bucharest University of Economic Studies(布加勒斯特经济研究大学);Humboldt University of Berlin(柏林洪堡大学);California Institute of Technology(加州理工学院);Institute for Economic Forecasting, Romanian Academy(罗马尼亚科学院经济预测研究所)
Energy time series forecasting-Analytical and empirical assessment of conventional and machine learning models
Center for Artificial Intelligence and RObotics (CAIRO), Faculty of Science, Aswan University, Egypt(阿斯旺大学科学学院人工智能与机器人中心);Department of Computers and Systems Engineering, Faculty of Engineering, Minia University, Egypt(米尼亚大学工程学院计算机与系统工程系);College of Computer Science and Information Technology, King Faisal University, Saudi Arabia(费萨尔国王大学计算机科学与信息技术学院)
Physics-Informed Singular-Value Learning for Cross-Covariances Forecasting in Financial Markets
Université Paris-Saclay, CentraleSupélec, Mathématiques et Informatique pour la Complexité et les Systèmes(巴黎-萨克雷大学,CentraleSupélec,复杂性与系统数学与计算机科学);Università degli Studi di Palermo, Dipartimento di Fisica e Chimica "Emilio Segrè"(巴勒莫大学,Emilio Segrè物理与化学系)
Macroeconomic forecasting with LSTM and mixed frequency time series data
Faculty of Economics, Khon Kaen University(孔敬大学经济学院);Khon Kaen University(孔敬大学)
本文展示了长短期记忆(LSTM)在应用于不同频率采样的宏观经济时间序列数据时的潜力。我们首先介绍了当对所有低频输出和高频变量对应用相同的失配比时,传统的LSTM模型如何适应在混合频率下观察到的时间序列。为了将LSTM推广到多个失配率的情况,我们采用了无限制混合数据采样(U-MIDAS)方案(Foroni et al.,2015年)引入LSTM架构。我们评估通过bothMonte Carlo模拟和实证应用的样本预测性能。我们提出的模型优于限制MIDAS模型,即使在一个设置有利于MIDAS估计。对于现实世界的应用,我们研究预测泰国实际GDP的季度增长率,使用大量的宏观经济指标季度和月度。我们使用U-MIDAS方案的LSTM在所有范围内都轻松击败了简单的基准AR(1)模型,但仅在一个月和六个月的时间内优于强基准单变量LSTM。尽管如此,我们发现,我们提出的模型可能是非常有帮助的,在大的经济低迷时期的短期预测。模拟和实验结果似乎支持我们提出的LSTM with U-MIDAS方案用于临近预报应用。
Optimal starting point for time series forecasting
School of Statistics and Mathematics, Central University of Finance and Economics(中央财经大学统计与数学学院);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);Smart Campus Construction Center, Central University of Finance and Economics(中央财经大学智慧校园建设中心);Guanghua School of Management, Peking University(北京大学光华管理学院);School of Statistics, Beijing Normal University(北京师范大学统计学院)
TimeFound: A Foundation Model for Time Series Forecasting
Baidu Research(百度研究院);University of Science and Technology of China(中国科学技术大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Cherry-Picking in Time Series Forecasting: How to Select Datasets to Make Your Model Shine
Faculdade de Engenharia, Universidade do Porto(波尔图大学工程学院);Laboratory for AI and CS (LIACC)(人工智能与计算机科学实验室(LIACC));Fraunhofer Portugal AICOS(弗劳恩霍夫葡萄牙人工智能与计算机科学研究所);Dalhousie University(达尔豪斯大学)