arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2306.11268cs.ARphysics.optics
收藏

LightRidge:一种面向衍射光学神经网络的端到端敏捷设计框架

LightRidge: An End-to-end Agile Design Framework for Diffractive Optical Neural Networks

Yingjie Li, Ruiyang Chen, Minhan Lou, Berardi Sensale-Rodriguez, Weilu Gao, Cunxi Yu

AI总结:

本研究提出首个端到端光学机器学习编译框架LightRidge,通过可微光物理核、计算加速及易用DSL降低DONNs设计部署门槛,经物理系统实验验证其精度、速度、架构探索有效性及任务支撑能力。

摘要:

为降低衍射光学神经网络(DONNs)设计、探索与部署的门槛,我们提出LightRidge——首个端到端光学机器学习编译框架,该框架包含三部分:(1)精确可微的光物理核,支持DONNs架构的全面探索;(2)光物理计算核加速,大幅降低DONNs训练、仿真与部署的运行时开销;(3)通用灵活的光学系统建模与易用的领域特定语言(DSL)。由此,LightRidge框架可实现DONNs高效的端到端设计与部署,显著减少编程、软硬件协同设计及芯片集成的工作量。我们通过物理光学系统开展实验,结果表明:(1)光物理核与底层物理及系统精确关联;(2)与当前最先进的商用系统相比,物理感知仿真工作负载的运行速度大幅提升;(3)硬件原型与片上集成案例研究验证了架构设计空间探索的有效性;(4)提出了新颖的DONN设计原则,包括成功演示利用DONNs架构与拓扑完成高级图像分类和图像分割任务。

英文摘要:

To lower the barrier to diffractive optical neural networks (DONNs) design, exploration, and deployment, we propose LightRidge, the first end-to-end optical ML compilation framework, which consists of (1) precise and differentiable optical physics kernels that enable complete explorations of DONNs architectures, (2) optical physics computation kernel acceleration that significantly reduces the runtime cost in training, emulation, and deployment of DONNs, and (3) versatile and flexible optical system modeling and user-friendly domain-specific-language (DSL). As a result, LightRidge framework enables efficient end-to-end design and deployment of DONNs, and significantly reduces the efforts for programming, hardware-software codesign, and chip integration. Our results are experimentally conducted with physical optical systems, where we demonstrate: (1) the optical physics kernels precisely correlated to low-level physics and systems, (2) significant speedups in runtime with physics-aware emulation workloads compared to the state-of-the-art commercial system, (3) effective architectural design space exploration verified by the hardware prototype and on-chip integration case study, and (4) novel DONN design principles including successful demonstrations of advanced image classification and image segmentation task using DONNs architecture and topology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑