嵌入神经网络的双层优化:在调度与控制集成中的应用
Bilevel optimisation with embedded neural networks: Application to scheduling and control integration
AI总结:
本文针对调度与控制集成的双层优化难题,提出用 ReLU 神经网络表示控制层响应,并借助 big-M 重构将其转化为单层级 MILP,在间歇过程案例中显著缩短计算时间且保持高精度。
摘要:
调度问题需要在其优化过程中明确考虑控制因素。文献提出了两种解决该集成问题的传统方法:分层方法和单体方法。单体方法忽略控制层的目标,并将其作为约束纳入上层,其代价是次优性。分层方法则需求解一个数学上复杂的双层问题,其中调度充当领导者,控制充当跟随者。两个层级之间的耦合变量属于调度与控制决策变量的一个小子集。对于这一变量子集,数据驱动的代理模型已被用于学习跟随者对不同领导者决策的响应。在本研究中,我们提出在控制层使用 ReLU 神经网络。由此,双层问题被转化为一个单层级 MILP,同时仍能够考虑控制层的目标。该单层级 MILP 重构与单体方法进行了比较,并以将神经网络的非线性表达式嵌入优化中的做法作为基准进行评测。此外,还使用一个神经网络来预测控制层的可行性。案例研究涉及间歇反应器和顺序间歇过程调度问题。所提出的方法能够找到最优解,同时在计算时间方面大幅优于两种对比方法。此外,得益于成熟的 MILP 求解器,以 MILP 形式加入 ReLU 神经网络只会对计算时间产生轻微影响。由预测精度导致的解误差与神经网络训练误差相关。总体而言,我们展示了如何通过利用现有的 big-M 重构并谨慎整合机器学习与优化流程,以更高精度、更高效地求解调度-控制双层问题。
英文摘要:
Scheduling problems requires to explicitly account for control considerations in their optimisation. The literature proposes two traditional ways to solve this integrated problem: hierarchical and monolithic. The monolithic approach ignores the control level's objective and incorporates it as a constraint into the upper level at the cost of suboptimality. The hierarchical approach requires solving a mathematically complex bilevel problem with the scheduling acting as the leader and control as the follower. The linking variables between both levels belong to a small subset of scheduling and control decision variables. For this subset of variables, data-driven surrogate models have been used to learn follower responses to different leader decisions. In this work, we propose to use ReLU neural networks for the control level. Consequently, the bilevel problem is collapsed into a single-level MILP that is still able to account for the control level's objective. This single-level MILP reformulation is compared with the monolithic approach and benchmarked against embedding a nonlinear expression of the neural networks into the optimisation. Moreover, a neural network is used to predict control level feasibility. The case studies involve batch reactor and sequential batch process scheduling problems. The proposed methodology finds optimal solutions while largely outperforming both approaches in terms of computational time. Additionally, due to well-developed MILP solvers, adding ReLU neural networks in a MILP form marginally impacts the computational time. The solution's error due to prediction accuracy is correlated with the neural network training error. Overall, we expose how - by using an existing big-M reformulation and being careful about integrating machine learning and optimisation pipelines - we can more efficiently solve the bilevel scheduling-control problem with high accuracy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。