MSTN: 一种轻量且快速的通用时间序列分析模型
MSTN: A Lightweight and Fast Model for General TimeSeries Analysis
AI总结:
本文提出了一种轻量且快速的MSTN模型,通过多尺度时间网络架构,结合早期内部聚合原理,有效处理时间序列中的非平稳性、非线性动态和多时间尺度行为,实现了在多个时间尺度上的灵活建模,同时保持了模型的轻量级和低延迟特性。
摘要:
现实世界的时间序列往往表现出强烈的非平稳性、复杂的非线性动态以及在多个时间尺度上的行为,从快速的局部波动到缓慢演变的长期趋势。然而,许多现代架构施加了刚性的、固定尺度的结构先验,如基于补丁的标记化、预定义的感受野或冻结的主干编码器,这可能会过度正则化时间动态并限制对突发高幅事件的适应性。为此,我们引入了多尺度时间网络(MSTN),一种基于早期内部聚合原理的混合神经架构。MSTN集成了三个互补的组件:(i)多尺度卷积编码器,用于捕捉细粒度的局部结构;(ii)序列建模模块,通过递归或注意力机制学习长距离依赖;(iii)自我门控融合阶段,结合挤压激活和单个密集层,动态重新加权和融合多尺度表示。ETA确保下游模块在O(1)时间内运行,而编码器保留O(L^2)(Transformer)或O(L)(BiLSTM)。这种设计使MSTN能够灵活地建模从毫秒到长期的时间模式,同时避免了通常与长上下文模型相关的计算负担。在广泛的基准测试中,包括填补缺失值、长期预测、分类和跨数据集泛化,MSTN实现了最先进的性能,在27个数据集中的21个上建立了新的最佳结果,同时保持轻量级(MSTN-BiLSTM约为0.40M参数,MSTN-Transformer约为1.06M参数)并适合低延迟推理(<1秒,通常在毫秒级),资源受限的部署。
英文摘要:
Real-world time series often exhibit strong non-stationarity, complex nonlinear dynamics, and behavior expressed across multiple temporal scales, from rapid local fluctuations to slow-evolving long-range trends. However, many contemporary architectures impose rigid, fixed-scale structural priors such as patch-based tokenization, predefined receptive fields, or frozen backbone encoders - which can over-regularize temporal dynamics and limit adaptability to abrupt high-magnitude events. To handle this, we introduce the Multi-scale Temporal Network (MSTN), a hybrid neural architecture grounded in an Early Temporal Aggregation principle. MSTN integrates three complementary components: (i) a multi-scale convolutional encoder that captures fine-grained local structure; (ii) a sequence modeling module that learns long-range dependencies through either recurrent or attention-based mechanisms; and (iii) a self-gated fusion stage incorporating squeeze-excitation and a single dense layer to dynamically reweight and fuse multi-scale representations. ETA ensures downstream modules operate in O(1) time, while the encoder retains O(L^2) (Transformer) or O(L) (BiLSTM). This design enables MSTN to flexibly model temporal patterns spanning milliseconds to extended horizons, while avoiding the computational burden typically associated with long-context models. Across extensive benchmarks covering imputation, long-term forecasting, classification, and cross-dataset generalization, MSTN achieves state-of-the-art performance, establishing new best results on 21 of 27 datasets, while remaining lightweight (~0.40M params for MSTN-BiLSTM and ~1.06M for MSTN-Transformer) and suitable for low-latency inference (<1 sec, often in milliseconds), resource-constrained deployment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。