arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.12822eess.SYcs.AIcs.LGcs.SY
收藏

基于深度学习的模拟器:用于通过深度强化学习算法控制废水处理中的除磷过程

Deep Learning Based Simulators for the Phosphorus Removal Process Control in Wastewater Treatment via Deep Reinforcement Learning Algorithms

Krüger A/S(克鲁格公司);Aalborg University(奥尔堡大学);AAU Energy(奥尔堡大学AAU能源机构)

Esmaeel Mohammadi, Mikkel Stokholm-Bjerregaard, Aviaja Anna Hansen, Per Halkjær Nielsen, Daniel Ortiz-Arroyo, Petar Durdevic

AI总结:

本研究训练六个模型构建深度强化学习(DRL)环境模拟器以优化废水处理除磷过程,发现模型复合误差限制了其长期模拟性能,提出利用SCADA系统数据创建仿真环境以改进过程控制。

摘要:

除磷在废水处理中对于减少对有限资源的依赖至关重要。深度强化学习(DRL)是一种机器学习技术,可以通过试错学习控制策略来优化复杂和非线性系统,包括废水处理厂中的过程。然而,由于需要准确的模拟器,将 DRL 应用于化学和生物过程具有挑战性。本研究训练了六个模型来识别除磷过程,并使用它们为 DRL 环境创建模拟器。尽管这些模型达到了高准确率(>97%),但不确定性和错误的预测行为限制了它们作为模拟器在较长时间范围内的性能。模型预测中的复合误差被确定为造成此问题的原因之一。这种改进过程控制的方法涉及为 DRL 算法创建仿真环境,使用来自监控与数据采集(SCADA)系统的数据,且具有足够的历史范围,而无需复杂的系统建模或参数估计。

英文摘要:

Phosphorus removal is vital in wastewater treatment to reduce reliance on limited resources. Deep reinforcement learning (DRL) is a machine learning technique that can optimize complex and nonlinear systems, including the processes in wastewater treatment plants, by learning control policies through trial and error. However, applying DRL to chemical and biological processes is challenging due to the need for accurate simulators. This study trained six models to identify the phosphorus removal process and used them to create a simulator for the DRL environment. Although the models achieved high accuracy (>97%), uncertainty and incorrect prediction behavior limited their performance as simulators over longer horizons. Compounding errors in the models' predictions were identified as one of the causes of this problem. This approach for improving process control involves creating simulation environments for DRL algorithms, using data from supervisory control and data acquisition (SCADA) systems with a sufficient historical horizon without complex system modeling or parameter estimation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑