arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.09774cs.CV
收藏

用于端到端计算成像系统优化的可微分波动光学模型

A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimization

University of California, San Diego(加州大学圣地亚哥分校)

Chi-Jui Ho, Yash Belhe, Steve Rotenberg, Ravi Ramamoorthi, Tzu-Mao Li, Nicholas Antipa

AI总结:

本文提出一种高效可微分的波动光学模拟器,用于复合光学系统的端到端优化,实验表明忽略波动光学会导致性能下降,凸显精确建模的重要性。

摘要:

端到端优化同时优化光学元件和算法,已成为计算成像系统设计的一种强大的数据驱动方法。该方法通过反向传播实现联合优化,其做法是引入可微分的光学模拟器来生成测量数据,并引入算法来从测量数据中提取信息。然而,由于计算成本高昂,在复合光学系统的端到端优化中,对光传输中的像差和衍射两者进行建模颇具挑战。因此,现有的大多数方法通过忽略波动光学效应或离轴像差来折中物理精度,这引发了人们对由此产生的设计之鲁棒性的担忧。在本文中,我们提出了一种可微分的光学模拟器,它能高效地对复合光学系统的像差和衍射进行建模。利用该模拟器,我们针对场景重建和分类任务进行了端到端优化。实验结果表明,是否对波动光学进行建模,会导致镜头和算法采用不同的配置。我们还表明,在测试阶段引入波动光学效应时,未经波动光学优化的系统会出现性能下降。这些发现凸显了在优化成像系统以实现鲁棒且高性能的应用时,对波动光学进行精确建模的重要性。

英文摘要:

End-to-end optimization, which simultaneously optimizes optics and algorithms, has emerged as a powerful data-driven method for computational imaging system design. This method achieves joint optimization through backpropagation by incorporating differentiable optics simulators to generate measurements and algorithms to extract information from measurements. However, due to high computational costs, it is challenging to model both aberration and diffraction in light transport for end-to-end optimization of compound optics. Therefore, most existing methods compromise physical accuracy by neglecting wave optics effects or off-axis aberrations, which raises concerns about the robustness of the resulting designs. In this paper, we propose a differentiable optics simulator that efficiently models both aberration and diffraction for compound optics. Using the simulator, we conduct end-to-end optimization on scene reconstruction and classification. Experimental results demonstrate that both lenses and algorithms adopt different configurations depending on whether wave optics is modeled. We also show that systems optimized without wave optics suffer from performance degradation when wave optics effects are introduced during testing. These findings underscore the importance of accurate wave optics modeling in optimizing imaging systems for robust, high-performance applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑