基于大语言模型的启发式合成在工业过程控制中的应用:来自热轧的启示
From Language Models to Control Policies: Search, Selection, and Verification
AI总结:
本文提出了一种基于大语言模型的启发式合成框架,用于热轧过程控制,通过可解释的Python控制器生成和自动审计流程,结合结构化战略构思和可执行代码生成,实现对轧制高度、间歇时间和轧制速度的控制。
摘要:
工业过程控制需要可解释和可审计的策略,而黑盒神经策略难以满足这些要求。我们研究了一种由大语言模型驱动的热轧启发式合成框架,其中语言模型通过物理模拟器提供的丰富行为反馈,迭代提出并改进可读的Python控制器。该框架结合了结构化战略构思、可执行代码生成和组件级反馈,以在不同操作条件下搜索控制逻辑。我们的第一个贡献是为工业过程控制设计的可审计控制器合成管道。生成的控制器是可访问的显式程序,供专家审查,并与自动审计流程配对,正式验证最佳合成启发式的安全性和单调性属性。我们的第二个贡献是为大语言模型驱动的启发式搜索设计的原理化预算分配策略:我们证明了Luby风格的通用重启策略——最初为随机算法开发的——可以直接应用于此领域,消除了对问题特定预算调整的需求。单个160次迭代的Luby活动接近由52次随机运行总共730次迭代得出的 hindsight-最优预算分配。
英文摘要:
Industrial process control demands policies that are interpretable and auditable, requirements that black-box neural policies struggle to meet. LLM-driven heuristic synthesis offers an alternative: a language model iteratively proposes and refines human-readable Python controllers using rich behavioral feedback from a simulator. We study this form of programmatic policy search on hot steel rolling, a physics-simulated, multi-pass control problem with competing objectives and hard equipment constraints, and address three questions that arise once the search is run at scale: how to split a fixed budget of LLM iterations between restarting and refining, how to deploy the resulting pool of heuristics, and how to verify it. Treating each search run as a randomized algorithm, we find across 52 independent runs that runs of moderate length match the hindsight-optimal budget allocation, and that Luby-style universal restarts reach this regime without problem-specific tuning. Because each heuristic is cheap to simulate, a small portfolio selected per job outperforms the best single heuristic, also under cross-validation and on out-of-distribution operating conditions on which the best heuristic stalls. Finally, an automated audit pipeline combining static analysis, Z3 proofs, and property-based testing proves key safety properties for all 174 synthesized heuristics; the stall, which neither the search reward nor these properties reveal, shows that the specifications must also cover progress.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。