分数阶硬件用于神经形态计算:阶数真的是问题所在吗?
Fractional-order hardware for neuromorphic computing: Is the order really the problem?
AI总结:
本文综述分数阶硬件在神经形态计算中的成本与限制,指出阶数差距已基本弥合,真正瓶颈是低频端约三个数量级的频带缺口。
AI中文摘要:
神经形态系统是否需要真正的幂律记忆核,如果需要,有人能构建出这样的系统吗?神经形态系统同时处理跨越多个时间尺度的信号,从毫秒到数十秒。整数阶电路每增加一个额外的时间尺度就需要增加一个状态变量。分数阶动力学提供了另一种权衡:一个算子,其幂律核携带连续的时间尺度,并通过一个参数(阶数α)进行调谐。分数阶导数是非局部的,因此对其进行评估所需的存储和算术运算量随保留的历史记录增长,而整数阶导数的成本则是恒定的。本综述围绕这一成本组织硬件文献。我们推导了将截断误差保持在容差ε以下所需的保留历史长度,表明其按ε^(-1/α)缩放,并在此基础上提出了直接形式的第二个独立限制:在定点数中,权重本身会下溢,因此无论缓冲区多长,字长都会限制可用的历史长度。这两个限制随阶数的变化速率非常不同,它们的交叉点决定了字长是否能服务于某个阶数。我们利用这两个限制将已发表的硬件分为三种策略,并指出数值文献中已发展但硬件尚未采用的第四种策略,同时调查了数字、模拟和器件方面的工作。在此过程中,我们质疑该领域是否担心了正确的障碍。答案是否定的。已制造的恒相角器件已经覆盖了两个研究小组认为是任务最优的阶数范围,因此阶数差距已基本弥合,仅在接近0.1处以及描述皮层适应的较低阶数处留下残余差距。剩下的问题是在低频端存在约三个数量级的频带差距。这个角落并非空白,因为双层电极可在该区域工作,但该区域中的每个器件都是离散的,且尚无集成的薄膜元件在该区域得到表征。
英文摘要:
Does a neuromorphic system need a true power-law memory kernel, and if so, can anyone build one? Neuromorphic systems process signals spanning many timescales at once, from milliseconds to tens of seconds. Integer-order circuits buy each additional timescale with an additional state variable. Fractional-order dynamics offer a different bargain: one operator whose power-law kernel carries a continuum of timescales, tuned by one parameter, the order alpha. A fractional derivative is non-local, so evaluating it costs storage and arithmetic that grow with the retained history, where an integer-order derivative costs a constant. This review organizes the hardware literature around that cost. We derive the retained history needed to hold the truncation error below a tolerance epsilon, show that it scales as epsilon^(-1/alpha), and set beside it a second and independent limit on the direct form: in fixed point the weights themselves underflow, so word length caps the usable history however long the buffer is. The two limits move at very different rates with the order, and where they cross decides whether a word length can serve an order at all. We use both to sort published hardware into three strategies, note a fourth the numerical literature has developed and this hardware has not, and survey digital, analog and device work. Along the way we ask whether the field is worried about the right obstacle. It is not. Fabricated constant-phase devices already span the orders two groups identify as task-optimal, so the order gap has largely closed, leaving a residual gap near 0.1 and at the lower order describing cortical adaptation. What remains is a frequency-band gap of about three decades at the low end. That corner is not empty, since double-layer electrodes work there, but every device in it is discrete, and no integrable thin-film element has been characterized there.