云计算中用于数字孪生的基于价值的强化学习
Value-Based Reinforcement Learning for Digital Twins in Cloud Computing
AI总结:
本文针对网络化控制系统中数字孪生模型的数据传输问题,提出REVERB方法,结合强化学习与基于信息价值的算法进行最优控制与传感器选择,在保证预测精度的同时将通信开销最多减少五倍。
摘要:
本文考虑的设置由网络化控制系统中的传感器组成,这些传感器用于构建系统动态的数字孪生(DT)模型。重点在于控制、调度和资源分配,以确保观测数据及时交付给部署在云端的DT模型。低延迟和通信及时性对于确保DT模型能够准确估计和预测系统状态至关重要。然而,鉴于分布式传感器面临的有限网络资源、部分状态向量信息和测量误差,获取用于高效状态估计和控制计算的数据构成了一个非平凡的问题。我们提出了REinforcement learning and Variational Extended Kalman filter with Robust Belief(REVERB),它利用强化学习解决方案结合基于信息价值的算法,以执行最优控制并选择最具信息量的传感器,从而满足DT的预测精度。数值结果表明,DT平台能够提供令人满意的性能,同时将通信开销最多减少五倍。
英文摘要:
The setup considered in the paper consists of sensors in a Networked Control System that are used to build a digital twin (DT) model of the system dynamics. The focus is on control, scheduling, and resource allocation for sensory observation to ensure timely delivery to the DT model deployed in the cloud. Low latency and communication timeliness are instrumental in ensuring that the DT model can accurately estimate and predict system states. However, acquiring data for efficient state estimation and control computing poses a non-trivial problem given the limited network resources, partial state vector information, and measurement errors encountered at distributed sensors. We propose the REinforcement learning and Variational Extended Kalman filter with Robust Belief (REVERB), which leverages a reinforcement learning solution combined with a Value of Information-based algorithm for performing optimal control and selecting the most informative sensors to satisfy the prediction accuracy of DT. Numerical results demonstrate that the DT platform can offer satisfactory performance while reducing the communication overhead up to five times.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。