用于铝电解槽辨识的带跳跃连接的稀疏神经网络
Sparse neural networks with skip-connections for identification of aluminum electrolysis cell
AI总结:
针对铝电解槽数据稀缺且长期预测需稳定的问题,提出结合拼接跳跃连接与 $\ell_1$ 正则化的稀疏 InputSkip 模型,在各数据规模和预测时域下均提升开环稳定性与预测精度。
摘要:
神经网络因其能够直接从数据中捕获复杂的输入-输出关系,在非线性系统辨识领域迅速引起关注。然而,尽管该方法具有灵活性,但在此背景下这些模型的安全性仍令人担忧,同时还需要大量可能成本高昂的数据。铝电解是一个高度非线性的生产过程,大部分数据必须人工采样,导致采样过程昂贵且不频繁。在状态变量测量不频繁的情况下,长期预测的准确性和开环稳定性变得极为重要。标准神经网络在训练数据有限的情况下难以提供稳定的长期预测。在本工作中,我们研究了将拼接跳跃连接与促进稀疏性的 $\ell_1$ 正则化相结合,对短、中、长预测时域下预测的开环稳定性和准确性的影响。案例研究在一个代表铝电解槽质量与能量平衡的高维非线性仿真器上进行。所提出的模型结构包含从输入层和所有中间层到输出层的拼接跳跃连接,称为 InputSkip。经 $\ell_1$ 正则化的 InputSkip 称为稀疏 InputSkip。结果表明,在开环稳定性和长期预测准确性方面,稀疏 InputSkip 优于稠密和稀疏的标准前馈神经网络以及稠密 InputSkip。在各种规模数据集(小型、中型和大型训练集)上训练模型时,以及对于所有预测时域(短、中、长预测时域),结果均十分显著。
英文摘要:
Neural networks are rapidly gaining interest in nonlinear system identification due to the model's ability to capture complex input-output relations directly from data. However, despite the flexibility of the approach, there are still concerns about the safety of these models in this context, as well as the need for large amounts of potentially expensive data. Aluminum electrolysis is a highly nonlinear production process, and most of the data must be sampled manually, making the sampling process expensive and infrequent. In the case of infrequent measurements of state variables, the accuracy and open-loop stability of the long-term predictions become highly important. Standard neural networks struggle to provide stable long-term predictions with limited training data. In this work, we investigate the effect of combining concatenated skip-connections and the sparsity-promoting $\ell_1$ regularization on the open-loop stability and accuracy of forecasts with short, medium, and long prediction horizons. The case study is conducted on a high-dimensional and nonlinear simulator representing an aluminum electrolysis cell's mass and energy balance. The proposed model structure contains concatenated skip connections from the input layer and all intermittent layers to the output layer, referred to as InputSkip. $\ell_1$ regularized InputSkip is called sparse InputSkip. The results show that sparse InputSkip outperforms dense and sparse standard feedforward neural networks and dense InputSkip regarding open-loop stability and long-term predictive accuracy. The results are significant when models are trained on datasets of all sizes (small, medium, and large training sets) and for all prediction horizons (short, medium, and long prediction horizons.)
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。