Frequency propagation:非线性物理网络中的多机制学习
Frequency propagation: Multi-mechanism learning in nonlinear physical networks
摘要:
我们介绍了频率传播,非线性物理网络的学习算法。在具有可变电阻器的电阻电路中,在一组输入节点处以一个频率施加激活电流,并且在一组输出节点处以另一频率施加误差电流。电路对这些边界电流的电压响应是“激活信号”和“误差信号”的叠加,其系数可以在频域的不同频率中读取。每个电导与两个系数的乘积成比例地更新。学习规则是局部的,并证明了执行梯度下降的损失函数。我们认为,频率传播是物理网络的多机制学习策略的一个实例,无论是电阻,弹性,或流网络。多机制学习策略包含至少两个物理量,可能由独立的物理机制控制,作为训练过程中的激活和错误信号。然后使用关于这两个信号的本地可用信息来更新可训练参数以执行梯度下降。我们展示了早期的工作如何通过流网络中的化学信号来实现学习,也属于多机制学习的范畴。
英文摘要:
We introduce frequency propagation, a learning algorithm for nonlinear physical networks. In a resistive electrical circuit with variable resistors, an activation current is applied at a set of input nodes at one frequency, and an error current is applied at a set of output nodes at another frequency. The voltage response of the circuit to these boundary currents is the superposition of an `activation signal' and an `error signal' whose coefficients can be read in different frequencies of the frequency domain. Each conductance is updated proportionally to the product of the two coefficients. The learning rule is local and proved to perform gradient descent on a loss function. We argue that frequency propagation is an instance of a multi-mechanism learning strategy for physical networks, be it resistive, elastic, or flow networks. Multi-mechanism learning strategies incorporate at least two physical quantities, potentially governed by independent physical mechanisms, to act as activation and error signals in the training process. Locally available information about these two signals is then used to update the trainable parameters to perform gradient descent. We demonstrate how earlier work implementing learning via chemical signaling in flow networks also falls under the rubric of multi-mechanism learning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。