arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.10688physics.opticscs.LGcs.NEeess.IVphysics.app-ph

可编程衍射与数字神经网络的集成

Integration of Programmable Diffraction with Digital Neural Networks

University of California, Los Angeles(加州大学洛杉矶分校);California NanoSystems Institute (CNSI)(加州纳米系统研究所(CNSI))

Md Sadman Sakib Rahman, Aydogan Ozcan

AI总结:

本文调研了可编程衍射与数字神经网络联合优化的混合(光学+数字)处理器的相关创新,介绍了其协同效用与应用价值,该类处理器兼具模拟波处理与数字神经网络的优势。

摘要:

基于衍射元件的光学成像与传感系统在过去几十年间取得了巨大进展。早期的衍射光学处理器通常被设计为向独立优化的独立系统传递信息,这类系统主要由人类视觉或感知驱动。随着深度学习与数字神经网络的最新发展,研究人员已开始致力于构建与作为后端的数字神经网络联合优化的衍射处理器。这些联合优化的混合(光学+数字)处理器在承载模拟信息的输入电磁波与后端处理数字化信息的神经网络之间建立了一种全新的“衍射语言”,兼具两者的优势。此类混合设计可处理空间与时间相干、部分相干或非相干的输入波,能通用覆盖任何随空间变化的点扩散函数集合,这些函数可针对给定任务优化,并与数字神经网络协同执行。在本文中,我们重点介绍了经过工程设计与编程的衍射和数字神经网络之间这种令人振奋的协同作用在各类应用中的效用。我们调研了由模拟波处理与数字神经网络之间的推拉关系所催生的一些重大创新,同时也涵盖了通过这两种互补范式之间的协同作用所能获得的显著效益。

英文摘要:

Optical imaging and sensing systems based on diffractive elements have seen massive advances over the last several decades. Earlier generations of diffractive optical processors were, in general, designed to deliver information to an independent system that was separately optimized, primarily driven by human vision or perception. With the recent advances in deep learning and digital neural networks, there have been efforts to establish diffractive processors that are jointly optimized with digital neural networks serving as their back-end. These jointly optimized hybrid (optical+digital) processors establish a new "diffractive language" between input electromagnetic waves that carry analog information and neural networks that process the digitized information at the back-end, providing the best of both worlds. Such hybrid designs can process spatially and temporally coherent, partially coherent, or incoherent input waves, providing universal coverage for any spatially varying set of point spread functions that can be optimized for a given task, executed in collaboration with digital neural networks. In this article, we highlight the utility of this exciting collaboration between engineered and programmed diffraction and digital neural networks for a diverse range of applications. We survey some of the major innovations enabled by the push-pull relationship between analog wave processing and digital neural networks, also covering the significant benefits that could be reaped through the synergy between these two complementary paradigms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑