求解神经元常微分方程的随机舍入和降精度定点运算
Stochastic rounding and reduced-precision fixed-point arithmetic for solving neural ordinary differential equations
摘要:
虽然双精度浮点运算目前在高性能计算中占主导地位,但人们对更小、更简单的运算类型的兴趣越来越大。主要原因是能源效率、内存占用和带宽方面的潜在改进。但是,简单地切换到较低精度类型通常会导致数值错误增加。我们调查的方法,以提高精度降低定点运算类型的准确性,使用的例子在神经科学中的数值计算的一个重要领域:常微分方程(ODE)的解决方案。Izhikevich神经元模型被用来证明,舍入有一个重要的作用,从显式ODE解决方案算法产生准确的尖峰时间。特别地,与单精度的浮点和具有跨一系列神经元行为和ODE求解器的舍入到最近的定点运算相比,具有随机舍入的定点运算一致地导致更小的误差。一个计算上更便宜的替代方案也调查,灵感来自抖动的概念,这是一个广泛理解的机制,用于提供分辨率低于最低有效位(LSB)在数字信号处理。这些结果将对其他学科领域的常微分方程的解决方案产生影响,也应该与偏微分方程(PDE)所代表的大量实际问题直接相关。
英文摘要:
Although double-precision floating-point arithmetic currently dominates high-performance computing, there is increasing interest in smaller and simpler arithmetic types. The main reasons are potential improvements in energy efficiency and memory footprint and bandwidth. However, simply switching to lower-precision types typically results in increased numerical errors. We investigate approaches to improving the accuracy of reduced-precision fixed-point arithmetic types, using examples in an important domain for numerical computation in neuroscience: the solution of Ordinary Differential Equations (ODEs). The Izhikevich neuron model is used to demonstrate that rounding has an important role in producing accurate spike timings from explicit ODE solution algorithms. In particular, fixed-point arithmetic with stochastic rounding consistently results in smaller errors compared to single precision floating-point and fixed-point arithmetic with round-to-nearest across a range of neuron behaviours and ODE solvers. A computationally much cheaper alternative is also investigated, inspired by the concept of dither that is a widely understood mechanism for providing resolution below the least significant bit (LSB) in digital signal processing. These results will have implications for the solution of ODEs in other subject areas, and should also be directly relevant to the huge range of practical problems that are represented by Partial Differential Equations (PDEs).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。