arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.23761cs.LGcs.CV
收藏

OPTIAGENT:一种基于物理的代理框架用于自动光学设计

OPTIAGENT: A Physics-Driven Agentic Framework for Automated Optical Design

Zhejiang University(浙江大学);INSAIT, Sofia University(INSAIT,索菲亚大学)

Yuyu Geng, Lei Sun, Yao Gao, Xinxin Hu, Zhonghua Yi, Xiaolong Qian, Weijian Hu, Jian Bai, Kaiwei Wang

AI总结:

OPTIAGENT通过结合LLM与物理驱动的优化方法,首次实现了无需专业光学知识即可自动设计光学系统,提升了光学设计的自动化水平和精度。

摘要:

光学设计是配置光学元件以精确操控光线以实现高保真成像的过程。它本质上是一个高度非凸优化问题,严重依赖于人类启发式专业知识和领域特定知识。尽管大语言模型(LLMs)具有广泛的光学知识,但它们在设计镜头系统方面利用知识的能力仍然受到显著限制。本工作代表了首次尝试将LLMs应用于光学设计领域。我们通过使没有正式光学培训的用户成功开发功能性的镜头系统来弥合专家差距。具体而言,我们整理了一个全面的数据集,名为OptiDesignQA,其中包括来自标准光学教科书的经典镜头系统以及由自动化设计算法生成的新配置,用于训练和评估。此外,我们通过全系统合成和镜头完成的混合目标将领域特定的光学专业知识注入LLM中。为了使模型与光学原理对齐,我们采用由光学词典奖励引导的Group Relative Policy Optimization Done Right(DrGRPO)方法。该奖励系统结合了结构格式奖励、物理可行性奖励、光线操控准确性以及基于LLM的启发式方法。最后,我们的模型与专门的光学优化程序集成,用于端到端微调和精度细化。我们将所提出的方法与传统的基于优化的自动化设计算法和LLM对照方法进行了基准测试,实验结果表明了我们方法的优越性。

英文摘要:

Optical design is the process of configuring optical elements to precisely manipulate light for high-fidelity imaging. It is inherently a highly non-convex optimization problem that relies heavily on human heuristic expertise and domain-specific knowledge. While Large Language Models (LLMs) possess extensive optical knowledge, their capabilities in leveraging the knowledge in designing lens system remain significantly constrained. This work represents the first attempt to employ LLMs in the field of optical design. We bridge the expertise gap by enabling users without formal optical training to successfully develop functional lens systems. Concretely, we curate a comprehensive dataset, named OptiDesignQA, which encompasses both classical lens systems sourced from standard optical textbooks and novel configurations generated by automated design algorithms for training and evaluation. Furthermore, we inject domain-specific optical expertise into the LLM through a hybrid objective of full-system synthesis and lens completion. To align the model with optical principles, we employ Group Relative Policy Optimization Done Right (DrGRPO) guided by Optical Lexicographic Reward for physics-driven policy alignment. This reward system incorporates structural format rewards, physical feasibility rewards, light-manipulation accuracy, and LLM-based heuristics. Finally, our model integrates with specialized optical optimization routines for end-to-end fine-tuning and precision refinement. We benchmark our proposed method against both traditional optimization-based automated design algorithms and LLM counterparts, and experimental results show the superiority of our method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑