TimeSQL: Improving Multivariate Time Series Forecasting with Multi-Scale Patching and Smooth Quadratic Loss
College of Electrical Engineering, Sichuan University(四川大学电气工程学院);College of Architecture and Environment, Sichuan University(四川大学建筑与环境学院);State Grid Sichuan Electric Power Research Institute(国网四川省电力公司电力科学研究院);College of Computer Science, Sichuan University(四川大学计算机学院)
Site Mo, Haoxin Wang, Bixiong Li, Songhai Fan, Yuankai Wu, Xianggen Liu
Time series is a special type of sequence data, a sequence of real-valued random variables collected at even intervals of time. The real-world multivariate time series comes with noises and contains complicated local and global temporal dynamics, making it difficult to forecast the future time series given the historical observations. This work proposes a simple and effective framework, coined as TimeSQL, which leverages multi-scale patching and smooth quadratic loss (SQL) to tackle the above challenges. The multi-scale patching transforms the time series into two-dimensional patches with different length scales, facilitating the perception of both locality and long-term correlations in time series. SQL is derived from the rational quadratic kernel and can dynamically adjust the gradients to avoid overfitting to the noises and outliers. Theoretical analysis demonstrates that, under mild conditions, the effect of the noises on the model with SQL is always smaller than that with MSE. Based on the two modules, TimeSQL achieves new state-of-the-art performance on the eight real-world benchmark datasets. Further ablation studies indicate that the key modules in TimeSQL could also enhance the results of other models for multivariate time series forecasting, standing as plug-and-play techniques.
DA-SPS: A Dual-stage Network based on Singular Spectrum Analysis, Patching-strategy and Spearman-correlation for Multivariate Time-series Prediction
Department of Automation, University of Science and Technology of China(自动化系,中国科学技术大学);Institute of Advanced Technology, University of Science and Technology of China(先进技术研究院,中国科学技术大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(人工智能研究院,合肥综合性国家科学中心)
Structured Latent Space Modeling over Multi-Scale Temporal Patches for Multivariate Time Series Forecasting
School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院);Innovation Engineering College, Macau University of Science and Technology(澳门科技大学创新工程学院)
TSGym: Design Choices for Deep Multivariate Time-Series Forecasting
AI Lab, Shanghai University of Finance and Economics(上海财经大学金融学院人工智能实验室);Ant Group(蚂蚁集团);MoE Key Laboratory of Interdisciplinary Research of Computation and Economics(计算与经济学交叉学科关键实验室)
SPAT: Sensitivity-based Multihead-attention Pruning on Time Series Forecasting Models
School of Artificial Intelligence, Nanjing University, China(人工智能学院,南京大学);National Key Laboratory for Novel Software Technology, Nanjing University, China(新型软件技术国家重点实验室,南京大学);School of Electronic Science and Engineering, Nanjing University, China(电子科学与工程学院,南京大学)
本文提出 SPAT 结构化剪枝方法,利用动态 SEND 指标识别并移除整个冗余注意力模块,在多元时间序列预测中降低误差与 FLOPs,并超越多种 SOTA 方法。
SimAD: A Simple Dissimilarity-based Approach for Time Series Anomaly Detection
Pengcheng Laboratory, Shenzhen, Guangdong, 518066, China(鹏城实验室,深圳,广东,518066,中国);School of Future Technology, South China University of Technology, Guangzhou, Guangdong 510650, China(未来技术学院,华南理工大学,广州,广东 510650,中国);School of Computer Science and Engineering, South China University of Technology, Guangzhou, Guangdong 510650, China(计算机科学与工程学院,华南理工大学,广州,广东 510650,中国);Department of Information and Computing Science, Chongqing Jiaotong University(信息与计算科学系,重庆交通大学);Department of Computer Science at the University of Oxford(牛津大学计算机科学系);Alibaba Group(阿里巴巴集团);Department of Industrial and Systems Engineering in The Hong Kong Polytechnic University, China(香港理工大学工业与系统工程系,中国)
PLanTS: Periodicity-aware Latent-state Representation Learning for Multivariate Time Series
Department of Computer Science(计算机科学系);Indiana University(印第安纳大学);Department of Biomedical Engineering(生物医学工程系);Oregon Health & Science University(俄勒冈健康与科学大学)
A Multi-Scale Decomposition MLP-Mixer for Time Series Analysis
The Hong Kong University of Science and Technology(香港科技大学);BNU-HKBU United International College(北京师范大学-香港浸会大学联合国际学院);Guangzhou Urban Planning and Design Survey Research Institute(广州市城市规划勘测设计研究院)