面向材料挤出增材制造系统温度控制的带参数优化的输出反馈强化学习
Output Feedback Reinforcement Learning with Parameter Optimisation for Temperature Control in a Material Extrusion Additive Manufacturing system
AI总结:
针对增材制造系统温度控制中系统状态不可全测的问题,提出带状态估计的无模型输出反馈强化学习方法,在BAAM系统温度控制上取得与基于模型方法相当的效果,推动自主智能制造发展。
摘要:
随着增材制造(Additive Manufacturing, AM)的快速发展,迫切需要对该工艺进行先进的监测与控制。增材制造工艺的诸多方面对其效率、精度和可重复性有着重要影响,其中温度调节是最重要的因素之一。本研究解决了大尺寸增材制造(Big Area Additive Manufacturing, BAAM)系统状态空间温度模型的最优跟踪控制问题。具体而言,我们探讨了在无法获取精确系统状态、仅能获得测量值的情况下,线性二次跟踪(Linear Quadratic Tracking, LQT)控制器的设计问题。我们首先基于强化学习概念采用基于模型的方法求解该问题,通过观测器进行状态估计。随后,我们设计了一种带内部状态估计步骤的无模型强化学习控制器,并通过系统行为仿真器验证了其性能。结果表明,无需精确复杂的工艺模型,直接从工艺数据中学习最优策略即可取得相当的控制效果。我们认为这一成果是迈向自主智能制造的重要一步。
英文摘要:
With the rapid development of Additive Manufacturing (AM) comes an urgent need for advanced monitoring and control of the process. Many aspects of the AM process play a significant role in the efficiency, accuracy and repeatability of the process, with temperature regulation being one of the most important ones. In this work, we solve the problem of optimal tracking control for a state space temperature model of a Big Area Additive Manufacturing (BAAM) system. In particular, we address the problem of designing a Linear Quadratic Tracking (LQT) controller when access to the exact system state is not possible, except in the form of measurements. We initially solve the problem with a model-based approach based on reinforcement learning concepts, with state estimation through an observer. We then design a model-free reinforcement-learning based controller with an internal state estimation step and demonstrate its performance through a simulator of the systems' behaviour. Our results showcase the possibility of achieving comparable results while learning optimal policies directly from process data, without the need for an accurate, intricate model of the process. We consider this outcome to be a significant stride towards autonomous intelligent manufacturing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。