光学神经常微分方程
Optical Neural Ordinary Differential Equations
摘要:
增加片上光子神经网络(PNN)的层数是提高其模型性能的关键。然而,网络隐藏层的连续级联导致更大的集成光子芯片面积。为了解决这个问题,我们提出了光学神经常微分方程(ON-ODE)的架构,参数化的连续动态的隐藏层与光学ODE求解器。ON-ODE包括PNN,其后是光子积分器和光学反馈回路,其可以被配置为表示具有有效减少的芯片面积占用的残余神经网络(ResNet)和递归神经网络。对于基于干涉的光电非线性隐层,数值实验表明,在图像分类任务中,单隐层ON-ODE可以达到与两层光学ResNet近似相同的精度。此外,ONODE提高了基于衍射的全光学线性隐藏层的模型分类精度。ON-ODE的时变动力学特性进一步应用于高精度的轨迹预测。
英文摘要:
Increasing the layer number of on-chip photonic neural networks (PNNs) is essential to improve its model performance. However, the successively cascading of network hidden layers results in larger integrated photonic chip areas. To address this issue, we propose the optical neural ordinary differential equations (ON-ODE) architecture that parameterizes the continuous dynamics of hidden layers with optical ODE solvers. The ON-ODE comprises the PNNs followed by the photonic integrator and optical feedback loop, which can be configured to represent residual neural networks (ResNet) and recurrent neural networks with effectively reduced chip area occupancy. For the interference-based optoelectronic nonlinear hidden layer, the numerical experiments demonstrate that the single hidden layer ON-ODE can achieve approximately the same accuracy as the two-layer optical ResNet in image classification tasks. Besides, the ONODE improves the model classification accuracy for the diffraction-based all-optical linear hidden layer. The time-dependent dynamics property of ON-ODE is further applied for trajectory prediction with high accuracy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。