arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01124cs.LG
收藏

ChronoSpike: 一种自适应脉冲图神经网络用于动态图

ChronoSpike: An Adaptive Spiking Graph Neural Network for Dynamic Graphs

University of Southern California(南加州大学);Islamic University of Technology(伊斯兰科技大学)

Md Abrar Jahin, Taufikur Rahman Fuad, Jay Pujara, Craig Knoblock

AI总结:

本文提出ChronoSpike,结合可学习LIF神经元、多头空间注意力聚合和轻量Transformer时间编码器,实现动态图的高效表示学习,优于现有方法并在训练速度上更优。

摘要:

动态图表示学习需要捕捉结构关系和时间演化,但现有方法面临核心权衡:注意力方法在$O(T^2)$复杂度下具有表达力,而递归架构则面临梯度病理和密集状态存储问题。脉冲神经网络提供事件驱动效率,但受限于顺序传播、二进制信息丢失和缺乏全局上下文的局部聚合。我们提出ChronoSpike,一种自适应脉冲图神经网络,结合可学习LIF神经元与通道膜动力学、多头空间注意力聚合连续特征,以及轻量Transformer时间编码器。该设计使细粒度局部建模和长距离依赖捕捉成为可能,激活/状态内存为$O(T \cdot d)$,并具有额外的$O(T^2)$每节点注意力项,此处评估的范围内保持较小。ChronoSpike在三个大型基准上优于十二种最先进的基线,平均宏F1提升2.0%,微F1提升2.4%,同时在105K参数预算下,与递归方法相比训练速度快3-10倍。我们提供了膜电位有界性的理论保证,梯度流稳定性在收缩因子$ρ<1$下,以及BIBO稳定性;可解释性分析揭示了异质时间感受野和具有83-88%稀疏性的学习优先效应。

英文摘要:

Dynamic graph representation learning requires capturing both structural relations and temporal evolution, yet existing approaches face a core trade-off: attention-based methods offer expressiveness at O(T^2) complexity, while recurrent architectures suffer from gradient pathologies and dense state storage. Spiking neural networks provide event-driven efficiency but are constrained by sequential propagation, binary information loss, and local aggregation that lacks global context. We propose ChronoSpike, an adaptive spiking graph neural network that integrates learnable LIF neurons with per-channel membrane dynamics, multi-head spatially-attentive aggregation over continuous features, and a lightweight Transformer temporal encoder. This design enables fine-grained local modeling and long-range dependency capture with O(T.d) activation/state memory and an additional O(T^2) per-node attention term that remains small for the horizons evaluated here. ChronoSpike outperforms twelve state-of-the-art baselines on three large benchmarks by 2.0%~Macro-F1 and 2.4%~Micro-F1 on average while achieving 3-10 times faster training than recurrent methods with a constant 105K-parameter budget independent of graph size. We provide theoretical guarantees for membrane potential boundedness, gradient flow stability under contraction factor \r{ho}<1, and BIBO stability; interpretability analyses reveal heterogeneous temporal receptive fields and a learned primacy effect with 83-88% sparsity. Our code is publicly available at: https://github.com/Abrar2652/ChronoSpike

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑