欧拉状态网络:无耗散储备池计算
Euler State Networks: Non-dissipative Reservoir Computing
摘要:
受常微分方程数值解的启发,本文提出了一种新的储备池计算(RC)模型,称为欧拉状态网络(EuSN)。所提出的方法利用前向欧拉离散和反对称递归矩阵来设计水库动态,这是稳定的和非耗散的建设。我们的数学分析表明,所得到的模型是偏向于一个单一的有效谱半径和零局部李雅普诺夫指数,本质上接近稳定的边缘。长期记忆任务的实验表明,所提出的方法比标准的RC模型的问题,需要在多个时间步长的输入信息的有效传播的明显优势。此外,时间序列分类基准测试的结果表明,EuSN能够匹配(甚至超过)可训练的递归神经网络的准确性,同时保持RC系列的训练效率,从而节省高达$\approx$ 490倍的计算时间和$\approx$ 1750倍的能耗。
英文摘要:
Inspired by the numerical solution of ordinary differential equations, in this paper we propose a novel Reservoir Computing (RC) model, called the Euler State Network (EuSN). The presented approach makes use of forward Euler discretization and antisymmetric recurrent matrices to design reservoir dynamics that are both stable and non-dissipative by construction. Our mathematical analysis shows that the resulting model is biased towards a unitary effective spectral radius and zero local Lyapunov exponents, intrinsically operating near to the edge of stability. Experiments on long-term memory tasks show the clear superiority of the proposed approach over standard RC models in problems requiring effective propagation of input information over multiple time-steps. Furthermore, results on time-series classification benchmarks indicate that EuSN is able to match (or even exceed) the accuracy of trainable Recurrent Neural Networks, while retaining the training efficiency of the RC family, resulting in up to $\approx$ 490-fold savings in computation time and $\approx$ 1750-fold savings in energy consumption.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。