arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.07518cs.ETcs.ARcs.LGnlin.AO
收藏

基于可重构非线性处理单元的物理模拟Kolmogorov-Arnold网络

Physical Analogue Kolmogorov-Arnold Networks based on Reconfigurable Nonlinear-Processing Units

NanoElectronics Group, MESA+ Institute and BRAINS Center for Brain-Inspired Computing, University of Twente(纳米电子组、MESA+研究所和脑启发计算中心、代尔夫特理工大学);CAES Group and BRAINS Center for Brain-Inspired Computing, University of Twente(CAES组和脑启发计算中心、代尔夫特理工大学)

Manuel Escudero, Mohamadreza Zolfagharinejad, Sjoerd van den Belt, Nikolaos Alachiotis, Wilfred G. van der Wiel

AI总结:

提出一种基于可重构非线性处理单元(RNPU)的物理模拟KAN架构,通过硬件实现可编程非线性变换,在回归和分类任务中以更少参数达到与MLP相当的精度,并实现约10²-10³倍能效提升和约10倍面积缩减。

摘要:

Kolmogorov-Arnold网络(KAN)将神经计算从线性层转移到可学习的非线性边函数,但在硬件中高效实现这些非线性仍是一个开放挑战。本文介绍了一种物理模拟KAN架构,其中边函数通过可重构非线性处理单元(RNPU)在材料中实现:RNPU是多端纳米级硅器件,其输入输出特性通过控制电压调谐。通过将多个RNPU组合成边处理器,并将这些模块组装成具有集成混合信号接口的可重构模拟KAN(aKAN)架构,我们建立了一个现实的系统级硬件实现,能够以可编程非线性变换实现紧凑的KAN式回归和分类。使用实验校准的RNPU模型和硬件测量,我们展示了在任务复杂度增加时准确函数逼近的能力,同时所需可训练参数少于或相当于多层感知器(MLP)。系统级估计表明,对于代表性工作负载,每次推理能耗约为250 pJ,端到端推理延迟约为600 ns,与具有相似逼近误差的数字定点MLP相比,能耗降低约10²-10³倍,面积减少约10倍。这些结果确立了RNPU作为可扩展的硬件原生非线性计算基元,并指出模拟KAN架构是实现能量、延迟和面积高效的模拟神经网络硬件的现实硅基路径,特别适用于边缘推理。

英文摘要:

Kolmogorov-Arnold Networks (KANs) shift neural computation from linear layers to learnable nonlinear edge functions, but implementing these nonlinearities efficiently in hardware remains an open challenge. Here we introduce a physical analogue KAN architecture in which edge functions are realized in materia using reconfigurable nonlinear-processing units (RNPUs): multi-terminal nanoscale silicon devices whose input-output characteristics are tuned via control voltages. By combining multiple RNPUs into an edge processor and assembling these blocks into a reconfigurable analogue KAN (aKAN) architecture with integrated mixed-signal interfacing, we establish a realistic system-level hardware implementation that enables compact KAN-style regression and classification with programmable nonlinear transformations. Using experimentally calibrated RNPU models and hardware measurements, we demonstrate accurate function approximation across increasing task complexity while requiring fewer or comparable trainable parameters than multilayer perceptrons (MLPs). System-level estimates indicate an energy per inference of roughly 200 pJ and an end-to-end inference latency of roughly 0.6 $μ$s for a representative workload, corresponding to over 100$\times$ reduction in energy accompanied by $>$10$\times$ reduction in area compared to a digital fixed-point MLP at similar approximation error. These results establish RNPUs as scalable, hardware-native nonlinear computing primitives and identify analogue KAN architectures as a realistic silicon-based pathway toward energy-, latency-, and footprint-efficient analogue neural-network hardware, particularly for edge inference.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑