arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2506.14802cs.LGcs.AI

ss-Mamba:语义样条选择性状态空间模型

ss-Mamba: Semantic-Spline Selective State-Space Model

Department of Statistics(统计系)

Zuochen Ye

AI总结:

ss-Mamba通过融合语义嵌入和样条KAN编码的选择性状态空间模型,实现线性复杂度的高效、鲁棒且可解释的时间序列预测。

摘要:

我们提出了ss-Mamba,一种新颖的基础模型,通过在选择性状态空间建模框架内整合语义感知嵌入和自适应样条时间编码,增强了时间序列预测。基于Transformer架构近期的成功,ss-Mamba采用Mamba选择性状态空间模型作为高效替代方案,在实现相当性能的同时,将计算复杂度从二次方显著降低至线性时间。语义索引嵌入,初始化自预训练语言模型,通过有意义的语义先验,能够有效泛化到未见过的序列。此外,基于样条的Kolmogorov-Arnold网络(KAN)动态且可解释地捕捉复杂的季节性和非平稳时间效应,为传统时间特征编码提供了强有力的增强。大量实验评估证实,ss-Mamba在时间序列预测中展现出卓越的准确性、鲁棒性和可解释性,证明了其作为传统基于Transformer模型的多功能且计算高效的替代方案的潜力。

英文摘要:

We propose ss-Mamba, a novel foundation model that enhances time series forecasting by integrating semantic-aware embeddings and adaptive spline-based temporal encoding within a selective state-space modeling framework. Building upon the recent success of Transformer architectures, ss-Mamba adopts the Mamba selective state space model as an efficient alternative that achieves comparable performance while significantly reducing computational complexity from quadratic to linear time. Semantic index embeddings, initialized from pretrained language models, allow effective generalization to previously unseen series through meaningful semantic priors. Additionally, spline-based Kolmogorov-Arnold Networks (KAN) dynamically and interpretably capture complex seasonalities and non-stationary temporal effects, providing a powerful enhancement over conventional temporal feature encodings. Extensive experimental evaluations confirm that ss-Mamba delivers superior accuracy, robustness, and interpretability, demonstrating its capability as a versatile and computationally efficient alternative to traditional Transformer-based models in time-series forecasting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑