无反向传播光子网络中的一元巴甫洛夫联想学习
Monadic Pavlovian associative learning in a backpropagation-free photonic network
摘要:
一个多世纪以前,伊万·巴甫洛夫(Ivan P. Pavlov)在一个经典的实验中展示了狗如何学会将铃声与食物联系起来,从而导致铃声导致唾液分泌。今天,很少发现巴甫洛夫类型的联想学习用于人工智能(AI)应用,即使其他学习概念,特别是人工神经网络(ANN)的反向传播已经蓬勃发展。然而,在“传统”ANN上使用反向传播方法进行训练,特别是以现代深度神经网络(DNN)的形式,是计算和能量密集型的。在这里,我们通过实验证明了一种使用单个(或一元)关联硬件元素的反向传播自由学习形式。我们实现了这一集成的光子平台上使用相变材料与片上级联定向耦合器相结合。然后,我们使用我们的一元巴甫洛夫光子硬件开发了一个放大的电路网络,该硬件提供了一个基于单元素关联的独特机器学习框架,重要的是,使用无反向传播架构来解决一般的学习任务。我们的方法减少了传统神经网络方法中学习所带来的计算负担,从而提高了速度,同时也为我们的光子实现提供了更高的带宽。
英文摘要:
Over a century ago, Ivan P. Pavlov, in a classic experiment, demonstrated how dogs can learn to associate a ringing bell with food, thereby causing a ring to result in salivation. Today, it is rare to find the use of Pavlovian type associative learning for artificial intelligence (AI) applications even though other learning concepts, in particular backpropagation on artificial neural networks (ANNs) have flourished. However, training using the backpropagation method on 'conventional' ANNs, especially in the form of modern deep neural networks (DNNs), is computationally and energy intensive. Here we experimentally demonstrate a form of backpropagation-free learning using a single (or monadic) associative hardware element. We realize this on an integrated photonic platform using phase-change materials combined with on-chip cascaded directional couplers. We then develop a scaled-up circuit network using our monadic Pavlovian photonic hardware that delivers a distinct machine-learning framework based on single-element associations and, importantly, using backpropagation-free architectures to address general learning tasks. Our approach reduces the computational burden imposed by learning in conventional neural network approaches, thereby increasing speed, whilst also offering higher bandwidth inherent to our photonic implementation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。