In recent work on time-series prediction, Transformers and even large language models have garnered significant attention due to their strong capabilities in sequence modeling. However, in practical deployments, time-series prediction often requires operation in resource-constrained environments, such as edge devices, which are unable to handle the computational overhead of large models. To address such scenarios, some lightweight models have been proposed, but they exhibit poor performance on non-stationary sequences. In this paper, we propose $\textit{SWIFT}$, a lightweight model that is not only powerful, but also efficient in deployment and inference for Long-term Time Series Forecasting (LTSF). Our model is based on three key points: (i) Utilizing wavelet transform to perform lossless downsampling of time series. (ii) Achieving cross-band information fusion with a learnable filter. (iii) Using only one shared linear layer or one shallow MLP for sub-series' mapping. We conduct comprehensive experiments, and the results show that $\textit{SWIFT}$ achieves state-of-the-art (SOTA) performance on multiple datasets, offering a promising method for edge computing and deployment in this task. Moreover, it is noteworthy that the number of parameters in $\textit{SWIFT-Linear}$ is only 25\% of what it would be with a single-layer linear model for time-domain prediction. Our code is available at https://github.com/LancelotXWX/SWIFT.
Wavelet-Enhanced Neural ODE and Graph Attention for Interpretable Energy Forecasting
organization= School of Science, Engineering \& Technology, East Delta University , addressline = Abdullah Al Noman Road, Noman Society , city= Chattagram , postcode= 4209 , country= Bangladesh
Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University(清华大学交叉信息研究院)
交通预测对于公共安全和资源优化至关重要,但由于三个方面而非常具有挑战性:i)当前现有的工作大多利用复杂的时间模式(例如,短期雷暴和长期每日趋势),这不能准确地捕获不同模式下的时空依赖性; i i)图位置编码的探索不足限制了常用的全图注意力网络中的空间信息的提取; iii)全图注意力的二次复杂性引入了大量的计算需求。为了实现有效的交通流预测,我们提出了一个有效的谱图注意力网络与解开交通序列。具体而言,利用离散小波变换来获得流量序列的低频和高频分量,并且精心设计了双通道编码器,以准确地捕获低频和高频分量的长期和短期模式下的时空依赖性。此外,一种新的基于小波的图位置编码和查询采样策略引入到我们的频谱图的注意力,有效地引导消息传递和有效地计算的注意力。在四个真实世界数据集上的大量实验表明了我们模型的优越性,即,以较低的计算代价获得较高的预测精度。
DB2-TransF: All You Need Is Learnable Daubechies Wavelets for Time Series Forecasting
organization= Department of Computer Science \& Engineering \& Communication \& Engineering , addressline= G B Pant , city= New Delhi , postcode= 580007 , state= Delhi , country= India;organization= Department of Computer Science \& Engineering , addressline= Indian Institute of Technology , city= Dharwad , postcode= 580007 , state= Karnataka , country= India
AWEMixer: Adaptive Wavelet-Enhanced Mixer Network for Long-Term Time Series Forecasting
School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院);Department of Research and Development, Shandong New Beiyang Information Technology Co., Ltd.(山东新北洋信息技术有限公司);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术学院)
WDformer: A Wavelet-based Differential Transformer Model for Time Series Forecasting
School of Computer Science and Technology, Zhejiang Normal University(浙江师范大学计算机科学与技术学院);Zhejiang Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University(浙江智能教育技术与应用重点实验室)
针对时间序列多域信息利用不足及传统注意力易引入噪声的问题,提出 WDformer,融合小波多分辨率分析、反转维度注意力与差分注意力,并在多个真实数据集上取得 SOTA 表现。
WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecasting
School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications(北京邮电大学计算机学院(国家示范性软件学院));School of Computer Science and Engineering, University of Texas at Arlington(德克萨斯大学阿灵顿分校计算机科学与工程学院)
TwinS: Revisiting Non-Stationarity in Multivariate Time Series Forecasting
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Squirrel AI(松鼠AI);Beijing Institute of Technology(北京理工大学);Chongqing University(重庆大学)
Epicasting: An Ensemble Wavelet Neural Network (EWNet) for Forecasting Epidemics
International Institute of Information Technology Bangalore(班加罗尔国际信息技术学院);Sorbonne University Abu Dhabi(索邦大学阿布扎比分校);Sorbonne Center for Artificial Intelligence(索邦人工智能中心);National University of Singapore(新加坡国立大学)
Scale-Equivariant Generative Forecasting: Weight-Tied Dilated Convolutions, Wavelet Scattering Inputs, and Spectral-Consistency Training for Self-Similar Time Series
WaveCatBoost for Probabilistic Forecasting of Regional Air Quality Data
NIT Meghalaya(梅加拉亚国家理工学院);Sorbonne University(索邦大学);Sorbonne Center for Artificial Intelligence(索邦人工智能中心);Universiti Kebangsaan(马来西亚国民大学);University of Philippines(菲律宾大学);Institute of Environmental Science and Meteorology(环境科学与气象研究所)
Frequency-aware forecasting for short-term typhoon gust prediction
School of Artificial Intelligence, Hubei University(湖北大学人工智能学院);School of Economics and Management, Wuhan University(武汉大学经济与管理学院);School of Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电气工程学院)
Quantum Long Short-Term Memory (QLSTM) vs Classical LSTM in Time Series Forecasting: A Comparative Study in Solar Power Forecasting
National University of Sciences and Technology(国家科学技术大学);Ghulam Ishaq Khan Institute of Engineering Sciences and Technology(古拉姆·伊沙克·汗工程科学与技术学院);King Abdulaziz University(阿卜杜勒阿齐兹国王大学);Uppsala University(乌普萨拉大学)