SEDformer: 事件同步脉冲变换器用于不规则遥测时间序列预测
SEDformer: Event-Synchronous Spiking Transformers for Irregular Telemetry Time Series Forecasting
AI总结:
SEDformer是一种基于脉冲变换器的遥测不规则时间序列预测模型,通过事件同步脉冲编码和事件保留下采样模块,提升预测精度并降低能耗。
摘要:
来自大规模互联网连接系统(例如物联网部署和在线平台)的遥测流自然形成一个不规则多变量时间序列(IMTS),其准确预测在操作上至关重要。更深入的检查揭示了IMTS的一个定义性特征,即长段稀疏或没有观测的时期被短而密集的爆发所打断,其中大部分语义事件(观测)发生。然而,现有的图和变换器预测器忽略了SED:预对齐到均匀网格并使用大量填充会通过膨胀序列和在非信息性步骤强制计算来破坏稀疏性,而关系重述会通过破坏局部时间连续性来削弱事件语义。这些限制促使了一种更忠实和自然的IMTS建模范式,该范式与SED属性一致。我们发现脉冲神经网络满足这一要求,因为它们通过稀疏二进制脉冲进行通信,并以事件驱动的方式更新,这与IMTS的SED性质自然一致。因此,我们提出了SEDformer,一种增强SED的脉冲变换器,用于遥测IMTS预测,它结合了:(1)基于SED的脉冲编码器将原始观测转换为事件同步脉冲,使用事件对齐的LIF神经元;(2)事件保留时间下采样模块在压缩长间隔的同时保留显著的放电;(3)基于SED的脉冲变换器堆叠模块通过膜基线性注意力驱动,由EA-LIF脉冲特征驱动,实现系列内依赖性建模。在公共遥测IMTS数据集上的实验表明,SEDformer在减少能耗和内存使用的同时实现了最先进的预测准确性,为IMTS建模提供了一条自然且高效的道路。
英文摘要:
Telemetry streams from large-scale Internet-connected systems (e.g., IoT deployments and online platforms) naturally form an irregular multivariate time series (IMTS) whose accurate forecasting is operationally vital. A closer examination reveals a defining Sparsity-Event Duality (SED) property of IMTS, i.e., long stretches with sparse or no observations are punctuated by short, dense bursts where most semantic events (observations) occur. However, existing Graph- and Transformer-based forecasters ignore SED: pre-alignment to uniform grids with heavy padding violates sparsity by inflating sequences and forcing computation at non-informative steps, while relational recasting weakens event semantics by disrupting local temporal continuity. These limitations motivate a more faithful and natural modeling paradigm for IMTS that aligns with its SED property. We find that Spiking Neural Networks meet this requirement, as they communicate via sparse binary spikes and update in an event-driven manner, aligning naturally with the SED nature of IMTS. Therefore, we present SEDformer, an SED-enhanced Spiking Transformer for telemetry IMTS forecasting that couples: (1) a SED-based Spike Encoder converts raw observations into event synchronous spikes using an Event-Aligned LIF neuron, (2) an Event-Preserving Temporal Downsampling module compresses long gaps while retaining salient firings and (3) a stack of SED-based Spike Transformer blocks enable intra-series dependency modeling with a membrane-based linear attention driven by EA-LIF spiking features. Experiments on public telemetry IMTS datasets show that SEDformer attains state-of-the-art forecasting accuracy while reducing energy and memory usage, providing a natural and efficient path for modeling IMTS.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。